-- Logs begin at Sat 2022-03-26 20:01:24 UTC, end at Sat 2022-03-26 22:09:19 UTC. -- Mar 26 20:38:30.080617 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 26 20:38:30.089770 ncdv-master-1 devstack@n-api.service[125996]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 26 20:38:30 2022] *** Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: nodename: ncdv-master-1 Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: machine: x86_64 Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: clock source: unix Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: pcre jit disabled Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: detected number of CPU cores: 4 Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: current working directory: / Mar 26 20:38:30.091430 ncdv-master-1 devstack@n-api.service[125996]: detected binary path: /usr/bin/uwsgi-core Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: your processes number limit is 47680 Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: your memory page size is 4096 bytes Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: detected max file descriptor number: 2048 Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: lock engine: pthread robust mutexes Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: thunder lock: enabled Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 26 20:38:30.092032 ncdv-master-1 devstack@n-api.service[125996]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 26 20:38:30.140607 ncdv-master-1 devstack@n-api.service[125996]: Python main interpreter initialized at 0x55c823ff79c0 Mar 26 20:38:30.140607 ncdv-master-1 devstack@n-api.service[125996]: python threads support enabled Mar 26 20:38:30.140607 ncdv-master-1 devstack@n-api.service[125996]: your server socket listen backlog is limited to 100 connections Mar 26 20:38:30.140607 ncdv-master-1 devstack@n-api.service[125996]: your mercy for graceful operations on workers is 90 seconds Mar 26 20:38:30.140941 ncdv-master-1 devstack@n-api.service[125996]: mapped 403077 bytes (393 KB) for 2 cores Mar 26 20:38:30.141014 ncdv-master-1 devstack@n-api.service[125996]: *** Operational MODE: preforking *** Mar 26 20:38:30.141841 ncdv-master-1 devstack@n-api.service[125996]: *** uWSGI is running in multiple interpreter mode *** Mar 26 20:38:30.141841 ncdv-master-1 devstack@n-api.service[125996]: spawned uWSGI master process (pid: 125996) Mar 26 20:38:30.142036 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 26 20:38:30.142568 ncdv-master-1 devstack@n-api.service[125996]: spawned uWSGI worker 1 (pid: 125997, cores: 1) Mar 26 20:38:30.142914 ncdv-master-1 devstack@n-api.service[125996]: spawned uWSGI worker 2 (pid: 125998, cores: 1) Mar 26 20:38:30.143070 ncdv-master-1 devstack@n-api.service[125996]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 26 20:38:31.367168 ncdv-master-1 devstack@n-api.service[125997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 26 20:38:31.382877 ncdv-master-1 devstack@n-api.service[125998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 26 20:38:32.218827 ncdv-master-1 devstack@n-api.service[125997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:38:32.218827 ncdv-master-1 devstack@n-api.service[125997]: from cryptography.utils import int_from_bytes Mar 26 20:38:32.219156 ncdv-master-1 devstack@n-api.service[125997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:38:32.219156 ncdv-master-1 devstack@n-api.service[125997]: from cryptography.utils import int_from_bytes Mar 26 20:38:32.222181 ncdv-master-1 devstack@n-api.service[125998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:38:32.222181 ncdv-master-1 devstack@n-api.service[125998]: from cryptography.utils import int_from_bytes Mar 26 20:38:32.222502 ncdv-master-1 devstack@n-api.service[125998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:38:32.222502 ncdv-master-1 devstack@n-api.service[125998]: from cryptography.utils import int_from_bytes Mar 26 20:38:34.709597 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:38:34.710208 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:38:34.710292 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:38:34.710292 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:38:34.710722 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:38:34.710813 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:38:34.710894 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:38:34.710980 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:38:34.711064 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:38:34.711293 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:38:34.711390 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.711652 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.711739 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712000 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712092 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712329 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712430 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712661 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712755 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.712973 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713065 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713311 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713401 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713619 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713720 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.713939 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714023 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714200 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714285 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714514 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714603 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714832 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.714915 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715159 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715243 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715470 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715562 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715783 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.715875 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716124 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716210 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716433 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716526 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716737 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.716829 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.717054 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.717138 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.717361 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.717554 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718123 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718266 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718436 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718549 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718745 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.718857 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.719059 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.719734 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.719952 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720043 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720269 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720371 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720584 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720670 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.720909 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721043 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721224 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721338 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721555 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721665 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.721869 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722040 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722389 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722576 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722670 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722892 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.722985 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.723209 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.723337 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.723609 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.723703 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.723946 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724036 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724261 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724364 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724586 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724678 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724898 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.724983 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725208 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725304 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725540 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725627 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725860 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.725951 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726183 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726276 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726490 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726575 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726799 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.726883 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727114 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727237 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727423 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727524 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727729 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.727820 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728063 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728167 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728314 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728414 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728608 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728707 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.728921 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729007 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729246 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729332 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729567 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729663 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729821 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.729955 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730074 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730161 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730368 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730455 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730692 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.730778 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731003 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731094 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731316 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731410 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731627 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731732 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.731942 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732043 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732263 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732358 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732571 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732662 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.732881 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733020 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733190 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733275 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733500 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733585 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733818 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.733920 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.734131 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.734222 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.734441 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.734531 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.734752 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.735441 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.735632 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.735719 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.735974 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736065 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736291 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736377 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736605 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736696 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.736945 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737038 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737345 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737570 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737653 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737893 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.737985 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738203 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738289 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738514 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738618 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738826 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.738923 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739151 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739239 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739472 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739564 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739779 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.739864 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740062 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740158 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740362 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740453 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740669 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740766 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.740979 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741072 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741289 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741380 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741597 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741750 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741905 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.741990 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742208 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742300 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742510 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742603 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742819 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.742903 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743129 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743270 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743438 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743532 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743745 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.743829 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744074 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744164 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744383 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744477 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744689 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744781 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.744996 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745079 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745306 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745398 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745627 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745712 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.745936 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746027 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746246 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746331 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746555 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746646 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746862 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.746954 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747170 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747332 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747482 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747567 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747789 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.747872 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748122 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748209 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748432 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748516 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748741 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.748825 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749047 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749138 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749357 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749444 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749666 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749750 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.749978 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.750063 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.750280 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.750373 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751124 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751216 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751438 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751524 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751750 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.751880 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752085 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752185 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752393 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752479 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752699 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.752784 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753004 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753095 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753310 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753396 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753613 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753704 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.753917 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754009 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754216 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754298 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754517 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754601 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754837 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.754931 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755150 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755233 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755464 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755554 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755771 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.755867 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.756102 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.756188 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.756431 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:38:34.756516 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.756762 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.756847 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757095 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757178 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757411 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757495 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757743 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.757834 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758075 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758159 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758395 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758487 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758708 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.758792 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759020 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759105 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759337 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759431 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759651 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759735 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.759989 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760079 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760308 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760408 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760623 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760707 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.760941 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761031 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761262 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761359 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761580 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761664 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761899 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.761983 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762220 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762318 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762535 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762620 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762847 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.762939 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763171 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763308 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763495 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763587 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763808 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.763893 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764145 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764246 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764491 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764577 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764810 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.764902 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765139 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765225 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765466 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765551 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765779 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.765863 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.766134 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.766709 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.766970 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767055 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767287 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767372 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767615 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767701 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.767965 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768065 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768291 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768383 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768607 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768699 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.768926 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769017 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769241 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769337 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769554 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769642 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769868 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.769953 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770184 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770276 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770515 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770602 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770831 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.770915 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771147 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771312 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771464 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771549 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771780 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.771872 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772138 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772234 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772454 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772538 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772761 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.772845 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773069 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773162 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773375 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773458 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773684 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773783 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.773989 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774073 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774294 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774385 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774618 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774703 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.774926 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775011 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775243 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775326 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775566 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775650 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.775874 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776000 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776212 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776297 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776528 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776612 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776839 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.776924 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777147 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777232 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777461 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777558 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777774 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.777858 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778086 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778178 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778405 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778497 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778719 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.778811 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779028 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779112 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779350 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779442 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779659 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779743 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.779997 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780098 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780315 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780412 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780630 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780722 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.780946 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781030 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781262 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781351 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781578 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781670 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.781923 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782006 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782245 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782332 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782565 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782657 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782904 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.782989 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783213 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783298 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783532 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783623 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783859 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.783970 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784216 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784306 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784522 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784606 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784831 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.784923 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785138 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785230 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785446 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785531 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785754 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.785852 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786063 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786148 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786367 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786469 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786676 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786772 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.786982 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787066 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787285 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787377 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787589 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787685 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.787894 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788031 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788237 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788333 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788546 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788632 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788852 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.788937 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789157 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789242 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789465 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789551 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789794 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.789885 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790103 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790187 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790447 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790546 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790773 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.790857 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791096 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791188 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791411 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791496 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791727 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.791818 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792065 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792166 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792381 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792464 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792695 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.792787 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793011 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793103 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793327 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793419 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793643 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793734 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.793958 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794107 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794273 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794360 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794583 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794674 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794902 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.794995 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795216 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795301 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795527 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795610 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795834 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.795957 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796184 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796271 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796525 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796610 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796847 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.796934 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797167 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797258 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797511 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797595 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797828 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.797913 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798139 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798223 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798453 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798536 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798768 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.798853 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799081 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799166 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799399 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799485 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799714 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.799800 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800051 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800139 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800365 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800526 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800678 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800762 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.800993 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801079 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801304 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801396 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801611 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801696 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.801924 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802008 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802242 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802375 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802574 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802660 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802884 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.802978 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803202 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803296 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803515 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803600 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803826 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.803949 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804166 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804262 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804481 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804573 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804792 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.804884 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805102 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805221 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805418 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805534 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805745 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.805851 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806060 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806176 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806376 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806493 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806685 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.806808 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807001 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807117 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807314 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807436 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807622 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807747 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.807937 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808077 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808266 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808387 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808591 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808688 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.808907 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809020 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809231 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809337 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809554 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809648 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809861 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.809972 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810167 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810280 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810490 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810585 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810802 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.810887 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811108 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811192 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811415 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811501 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811724 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.811809 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812098 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812189 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812416 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812511 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812725 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.812811 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.813556 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.813650 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.813904 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814002 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814233 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814319 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814548 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814640 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814862 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.814948 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815176 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815260 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815504 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815627 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815804 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.815889 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816145 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816231 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816460 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816557 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816779 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.816867 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817093 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817178 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817407 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817500 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817722 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.817810 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818033 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818117 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818347 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818439 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818660 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818745 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.818967 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819051 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819271 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819363 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819587 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819695 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.819908 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.820179 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.820491 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.820578 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.820823 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.820954 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821141 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821233 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821464 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821558 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821785 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.821870 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822107 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822194 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822436 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822522 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822766 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.822850 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823075 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823172 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823388 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823488 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823697 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.823784 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824034 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824151 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824338 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824424 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824645 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824730 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.824951 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825034 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825255 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825340 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825559 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825646 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825866 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.825950 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826174 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826269 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826479 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826564 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826787 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.826879 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827093 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827186 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827403 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827514 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827715 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.827808 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.828036 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.828148 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.828347 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.828438 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829207 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829308 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829527 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829622 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829836 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.829920 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830142 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830227 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830448 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830542 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830781 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.830866 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831090 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831175 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831429 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831525 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831760 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.831846 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832095 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832183 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832408 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832503 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832717 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.832810 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833032 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833117 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833339 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833425 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833643 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833727 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.833947 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834092 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834352 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834566 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834653 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834872 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.834965 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835183 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835267 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835494 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835579 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835804 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.835897 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836141 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836240 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836451 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836544 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836761 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.836858 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837066 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837158 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837378 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837503 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837687 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837775 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.837992 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838076 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838298 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838384 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838608 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838694 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.838918 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839003 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839222 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839307 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839529 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839614 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839834 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.839955 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840166 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840251 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840471 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840557 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840776 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.840862 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841079 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841223 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841389 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841475 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841696 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.841781 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842000 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842098 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842323 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842408 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842631 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.842723 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843210 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843305 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843515 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843601 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843820 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.843904 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844150 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844270 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844484 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844578 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844798 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.844930 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845124 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845215 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845430 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845513 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845734 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.845818 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846045 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846131 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846350 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846435 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846653 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846737 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.846958 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847051 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847261 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847354 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847564 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847648 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847870 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.847985 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848205 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848290 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848509 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848606 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848812 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.848897 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849129 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849221 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849438 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849531 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849742 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.849833 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850045 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850129 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850378 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850497 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850686 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.850775 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851019 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851110 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851338 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851441 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851657 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851749 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.851995 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852088 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852310 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852402 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852623 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852714 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.852935 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853026 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853243 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853335 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853545 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853636 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853859 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.853949 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854224 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854319 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854474 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854580 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854776 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.854865 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855082 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855178 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855401 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855495 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855716 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.855800 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856058 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856150 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856384 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856471 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856710 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.856809 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857019 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857105 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857330 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857421 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857642 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857737 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.857953 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.858039 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.858264 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.858347 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.858573 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859029 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859029 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859266 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859348 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859424 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859501 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859588 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859808 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.859902 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860152 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860238 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860465 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860557 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860770 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.860856 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861079 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861172 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861387 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861474 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861691 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.861776 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862013 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862173 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862321 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862495 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862634 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862804 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.862946 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.863121 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.863259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.863429 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.863566 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.863744 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864017 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864126 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864336 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864491 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864651 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864809 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.864961 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865124 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865275 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865432 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865588 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865749 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.865907 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866063 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866228 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866383 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866534 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866706 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.866957 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867052 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867277 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867420 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867594 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867737 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.867911 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868077 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868244 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868392 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868553 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868700 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.868869 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869008 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869199 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869323 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869510 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869650 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869824 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.869957 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870133 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870264 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870458 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870570 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870766 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.870894 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.871089 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.871201 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.871508 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.871603 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.871828 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872057 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872167 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872253 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872541 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872639 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872885 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.872969 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873201 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873308 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873525 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873620 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873851 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.873936 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874177 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874341 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874469 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874675 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874782 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.874984 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.875072 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.875301 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.875386 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876157 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876253 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876487 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876575 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876816 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.876903 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877140 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877235 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877468 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877558 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877763 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.877850 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878089 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878185 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878413 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878506 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878725 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.878832 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879048 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879143 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879460 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879544 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879783 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.879869 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880137 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880238 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880450 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880537 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880761 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.880850 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881067 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881153 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881374 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881460 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881680 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881773 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.881987 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882072 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882296 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882382 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882611 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882695 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.882918 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883003 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883230 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883337 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883539 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883633 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883848 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.883973 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884178 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884270 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884553 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884659 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884809 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.884898 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885112 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885198 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885436 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885551 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885753 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.885840 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886058 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886143 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886384 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886480 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886689 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.886782 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887001 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887086 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887309 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887408 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887615 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887704 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.887951 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888046 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888252 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888340 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888582 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888667 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888891 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.888983 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889215 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889302 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889533 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889618 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889864 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.889949 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890179 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890266 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890501 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890587 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890823 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.890918 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.891674 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.891769 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892016 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892106 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892329 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892428 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892641 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892727 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.892948 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893041 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893256 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893412 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893563 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893649 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893870 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.893963 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894174 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894289 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894482 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894576 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894786 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.894881 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895092 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895187 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895398 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895520 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895719 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.895804 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896043 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896132 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896366 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896464 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896676 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896769 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.896980 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897066 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897293 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897385 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897600 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897686 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.897947 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898033 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898255 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898341 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898582 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898667 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898899 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.898985 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899218 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899303 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899549 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899644 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899863 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.899974 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900209 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900302 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900530 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900628 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900849 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.900942 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901166 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901251 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901485 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901579 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901802 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.901887 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902112 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902197 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902428 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902525 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902743 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.902829 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903059 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903154 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903375 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903581 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903699 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.903979 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904246 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904333 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904562 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904649 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904880 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.904968 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905196 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905294 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905512 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905649 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905831 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.905916 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906143 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906237 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906457 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906544 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906804 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.906894 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907139 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907232 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907462 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907550 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907791 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.907877 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908139 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908239 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908464 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908550 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908783 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.908869 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909100 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909187 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909416 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909508 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909735 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.909821 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910052 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910146 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910370 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910455 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910688 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.910787 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911007 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911093 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911323 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911409 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911635 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911732 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.911967 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912056 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912287 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912372 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912602 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912699 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.912914 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913002 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913228 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913314 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913543 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913635 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913855 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.913942 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914173 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914493 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914588 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914817 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.914946 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915136 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915222 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915453 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915540 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915769 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.915856 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.916110 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.916311 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.916429 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.916637 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.916951 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917038 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917279 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917375 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917603 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917696 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.917924 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918010 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918244 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918338 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918566 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918650 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918872 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.918956 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919179 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919274 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919492 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919578 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919805 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.919899 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920187 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920286 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920447 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920533 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920758 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.920843 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921064 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921149 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921385 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921480 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921696 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.921782 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.922021 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.922228 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.922867 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.923120 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.923403 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.923498 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.923755 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.923853 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924104 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924204 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924423 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924526 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924738 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.924831 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925059 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925144 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925368 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925465 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925678 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925806 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.925990 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926074 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926300 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926400 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926605 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926697 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.926914 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927000 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927220 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927313 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927534 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927664 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927843 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.927957 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928182 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928282 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928489 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928585 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928803 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.928889 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929113 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929199 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929420 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929505 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929726 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.929811 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930034 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930126 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930340 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930426 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930646 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930731 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.930951 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931038 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931256 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931341 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931562 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931654 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931865 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.931999 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932203 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932301 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932508 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932601 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932819 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.932904 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933125 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933211 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933435 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933529 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933739 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.933824 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934051 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934137 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934407 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934501 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934715 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.934801 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935028 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935157 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935337 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935432 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935656 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.935755 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936001 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936092 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936307 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936406 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936625 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936710 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.936943 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.937029 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.937293 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.937481 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.937618 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.937820 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.938683 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.938786 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939018 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939105 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939343 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939438 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939652 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939745 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.939981 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940073 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940295 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940382 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940625 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940725 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.940930 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941015 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941244 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941334 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941560 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941656 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941872 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.941958 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942183 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942275 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942495 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942582 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942808 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.942894 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943120 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943205 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943431 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943524 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943760 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.943891 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944080 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944167 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944392 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944479 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944705 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.944792 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945018 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945118 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945336 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945432 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945663 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945749 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.945983 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946127 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946300 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946385 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946610 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946702 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.946923 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947017 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947232 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947317 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947539 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947623 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947847 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.947976 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948183 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948270 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948502 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948598 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948809 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.948896 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949134 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949219 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949442 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949528 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949844 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.949931 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950168 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950252 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950480 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950566 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950805 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.950892 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951119 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951206 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951434 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951527 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951756 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.951843 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952095 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952184 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952422 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952519 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952737 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.952824 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953069 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953162 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953395 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953493 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953733 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.953829 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954045 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954142 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954355 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954443 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954661 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954753 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.954968 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955054 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955278 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955401 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955586 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955673 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.955894 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956036 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956222 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956309 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956525 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956610 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956834 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.956928 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957140 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957226 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957444 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957529 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957753 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.957854 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958056 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958153 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958365 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958451 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958668 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958765 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.958972 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959058 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959276 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959370 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959577 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959710 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959881 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.959988 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960209 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960304 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960516 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960602 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960819 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.960904 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961126 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961210 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961434 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961527 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961742 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.961828 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962049 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962135 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962383 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962470 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962708 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.962794 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963023 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963108 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963348 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963434 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963660 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.963752 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964005 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964149 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964319 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964412 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964641 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964727 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.964958 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965119 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965275 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965360 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965590 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965676 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.965904 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966001 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966221 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966313 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966534 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966625 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966846 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.966944 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.967155 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.967240 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.967467 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.967554 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968066 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968162 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968401 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968487 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968728 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.968825 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969038 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969125 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969389 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969486 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969710 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.969796 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970030 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970117 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970348 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970435 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970665 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970759 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.970978 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971064 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971298 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971390 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971611 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971715 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.971933 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972032 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972261 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972347 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972579 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972679 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972900 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.972987 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973217 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973309 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973545 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973631 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973871 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.973957 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974198 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974284 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974527 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974621 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974874 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.974968 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975190 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975276 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975511 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975597 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975828 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.975937 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.976162 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.976251 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.976409 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:38:34.976497 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.976776 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:38:34.977019 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:38:34.999835 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_db.sqlalchemy.engines [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.001486 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_db.sqlalchemy.engines [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.062071 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.context [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=125998) load_cells /opt/stack/nova/nova/context.py:464}} Mar 26 20:38:35.064163 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.context [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=125997) load_cells /opt/stack/nova/nova/context.py:464}} Mar 26 20:38:35.066932 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_concurrency.lockutils [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:38:35.068311 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:38:35.068539 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_concurrency.lockutils [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:38:35.069326 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_concurrency.lockutils [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:38:35.069922 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:38:35.070708 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:38:35.071250 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_concurrency.lockutils [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:38:35.072666 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:38:35.081821 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_db.sqlalchemy.engines [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.083030 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_db.sqlalchemy.engines [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.086264 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_db.sqlalchemy.engines [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.088325 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_db.sqlalchemy.engines [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.244908 ncdv-master-1 devstack@n-api.service[125998]: DEBUG oslo_db.sqlalchemy.engines [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.247587 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_db.sqlalchemy.engines [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:38:35.693559 ncdv-master-1 devstack@n-api.service[125998]: WARNING keystonemiddleware.auth_token [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:38:35.697201 ncdv-master-1 devstack@n-api.service[125997]: WARNING keystonemiddleware.auth_token [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:38:35.700139 ncdv-master-1 devstack@n-api.service[125998]: WARNING keystonemiddleware.auth_token [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:38:35.704294 ncdv-master-1 devstack@n-api.service[125997]: WARNING keystonemiddleware.auth_token [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:38:35.919194 ncdv-master-1 devstack@n-api.service[125998]: WARNING keystonemiddleware.auth_token [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:38:35.924482 ncdv-master-1 devstack@n-api.service[125998]: WARNING keystonemiddleware.auth_token [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:38:35.926190 ncdv-master-1 devstack@n-api.service[125997]: WARNING keystonemiddleware.auth_token [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:38:35.929525 ncdv-master-1 devstack@n-api.service[125998]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c823ff79c0 pid: 125998 (default app) Mar 26 20:38:35.931296 ncdv-master-1 devstack@n-api.service[125997]: WARNING keystonemiddleware.auth_token [None req-ac35cfce-20db-4cc5-b719-fe7255847479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:38:35.931561 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:38:35.932725 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Mar 26 20:38:35.933128 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sat Mar 26 20:38:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:38:35.936566 ncdv-master-1 devstack@n-api.service[125997]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c823ff79c0 pid: 125997 (default app) Mar 26 20:39:55.888913 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:39:55.890539 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Mar 26 20:39:55.891138 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:39:56.324033 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-f1ed8aa2-3ad6-4f40-8903-0154bd1ba216 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:39:56.353554 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-f1ed8aa2-3ad6-4f40-8903-0154bd1ba216 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.455630 Mar 26 20:39:56.354289 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 20:39:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:39:58.765667 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:39:58.766579 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-c034469b-0b1a-4b00-89fb-a951662dd894 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Mar 26 20:39:58.766988 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:39:58.824418 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-9a621133-942f-49b5-9d36-f106591e0a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:39:58.842263 ncdv-master-1 devstack@n-api.service[125997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:39:58.842263 ncdv-master-1 devstack@n-api.service[125997]: warnings.warn(msg) Mar 26 20:39:58.872641 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-9a621133-942f-49b5-9d36-f106591e0a6d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099781 Mar 26 20:39:58.873534 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:39:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:39:59.097518 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-c7b96177-a655-4457-9be3-c08352fbb1cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:39:59.099950 ncdv-master-1 devstack@n-api.service[125998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:39:59.099950 ncdv-master-1 devstack@n-api.service[125998]: warnings.warn(msg) Mar 26 20:39:59.146842 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-c7b96177-a655-4457-9be3-c08352fbb1cf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265307 Mar 26 20:39:59.147602 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Mar 26 20:39:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:01.526514 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-9a621133-942f-49b5-9d36-f106591e0a6d admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:01.527520 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-9a621133-942f-49b5-9d36-f106591e0a6d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Mar 26 20:40:01.527935 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:01.638812 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-28804e88-8680-4bcf-8700-76af32cfe250 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "id": "d1", "ram": 512}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:01.657235 ncdv-master-1 devstack@n-api.service[125998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:40:01.657235 ncdv-master-1 devstack@n-api.service[125998]: warnings.warn(msg) Mar 26 20:40:01.676278 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-28804e88-8680-4bcf-8700-76af32cfe250 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142376 Mar 26 20:40:01.676828 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:01.689052 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-f79da3a0-8ef3-463b-964f-87f5205fde55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:01.690703 ncdv-master-1 devstack@n-api.service[125997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:40:01.690703 ncdv-master-1 devstack@n-api.service[125997]: warnings.warn(msg) Mar 26 20:40:01.725409 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-f79da3a0-8ef3-463b-964f-87f5205fde55 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040582 Mar 26 20:40:01.726196 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Mar 26 20:40:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:04.213017 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-28804e88-8680-4bcf-8700-76af32cfe250 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:04.214739 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-28804e88-8680-4bcf-8700-76af32cfe250 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Mar 26 20:40:04.226312 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:04.328935 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-398039c4-b898-4e09-a49f-c9e2a87c3c50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:04.352312 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-398039c4-b898-4e09-a49f-c9e2a87c3c50 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.129895 Mar 26 20:40:04.360684 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:04.364864 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-b7cc150e-55c2-402f-ab5c-0398735ef299 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:04.390128 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-b7cc150e-55c2-402f-ab5c-0398735ef299 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028195 Mar 26 20:40:04.391559 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Mar 26 20:40:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:07.024779 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-398039c4-b898-4e09-a49f-c9e2a87c3c50 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:07.026313 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-398039c4-b898-4e09-a49f-c9e2a87c3c50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Mar 26 20:40:07.041030 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:07.086874 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-378e0683-a1ea-4fb8-84b5-a3f0e36e4221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "vcpus": 2, "ram": 2048, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:07.108777 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-378e0683-a1ea-4fb8-84b5-a3f0e36e4221 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074799 Mar 26 20:40:07.116437 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:07.121894 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-0e41f13b-d4aa-491d-9a71-cb09b8b3b77a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:07.148917 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-0e41f13b-d4aa-491d-9a71-cb09b8b3b77a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030739 Mar 26 20:40:07.157192 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Mar 26 20:40:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:09.724570 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-378e0683-a1ea-4fb8-84b5-a3f0e36e4221 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:09.725673 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-378e0683-a1ea-4fb8-84b5-a3f0e36e4221 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Mar 26 20:40:09.726855 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:09.798040 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "vcpus": 4, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:09.817448 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084333 Mar 26 20:40:09.818078 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:09.830181 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-193e7822-c1b4-4a8a-868f-0cb20c1ba625 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:09.854606 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-193e7822-c1b4-4a8a-868f-0cb20c1ba625 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028384 Mar 26 20:40:09.855749 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Sat Mar 26 20:40:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:12.654320 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:12.656349 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002487 Mar 26 20:40:12.657168 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:12.732430 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-aef726b2-e593-44f5-af55-641b2e8640b6 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:12.756721 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-aef726b2-e593-44f5-af55-641b2e8640b6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.093239 Mar 26 20:40:12.757482 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 20:40:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:15.194291 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:15.195311 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-ddcd621a-aa3e-4155-b76f-6fe6d4ccbdbe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Mar 26 20:40:15.195716 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:15.257276 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-f3e65f3d-88b2-4311-80fd-8352be98674e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "id": "1", "disk": 1}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:15.275402 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-f3e65f3d-88b2-4311-80fd-8352be98674e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073884 Mar 26 20:40:15.275885 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:15.287411 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-d4495377-da44-4fce-9c47-cedea07ec855 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:15.310455 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-d4495377-da44-4fce-9c47-cedea07ec855 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026022 Mar 26 20:40:15.310554 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Mar 26 20:40:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:17.876220 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-f3e65f3d-88b2-4311-80fd-8352be98674e admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:17.877267 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-f3e65f3d-88b2-4311-80fd-8352be98674e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Mar 26 20:40:17.877698 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:17.945727 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-05cbf03d-6e53-4932-8b8b-fdece7ae4262 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:17.968511 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-05cbf03d-6e53-4932-8b8b-fdece7ae4262 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084538 Mar 26 20:40:17.969230 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:17.983087 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-7f052f8e-0e6b-41bf-bf6c-2ad115a0e1f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:18.006780 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-7f052f8e-0e6b-41bf-bf6c-2ad115a0e1f8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027998 Mar 26 20:40:18.007652 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Mar 26 20:40:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:20.618351 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-05cbf03d-6e53-4932-8b8b-fdece7ae4262 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:20.619383 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-05cbf03d-6e53-4932-8b8b-fdece7ae4262 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Mar 26 20:40:20.619786 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:20.678953 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-21662714-d001-41b0-a68e-4bbb4da0e68e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "id": "3", "vcpus": 2}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:20.696731 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-21662714-d001-41b0-a68e-4bbb4da0e68e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070827 Mar 26 20:40:20.697300 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:20.709578 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-8552d1ce-3dd0-4c7a-b527-7002106dede2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:20.732570 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-8552d1ce-3dd0-4c7a-b527-7002106dede2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026567 Mar 26 20:40:20.733406 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Mar 26 20:40:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:40:23.417520 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-21662714-d001-41b0-a68e-4bbb4da0e68e admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:23.418517 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-21662714-d001-41b0-a68e-4bbb4da0e68e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Mar 26 20:40:23.418914 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:40:23.479053 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-b2beeeb2-a1be-4c22-b123-281a8e342126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:23.496639 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-b2beeeb2-a1be-4c22-b123-281a8e342126 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071858 Mar 26 20:40:23.497184 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:23.509405 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-63c60ae2-4780-4247-995d-48d208aa10b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:23.531317 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-63c60ae2-4780-4247-995d-48d208aa10b5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025671 Mar 26 20:40:23.532014 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Mar 26 20:40:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:25.964544 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-b2beeeb2-a1be-4c22-b123-281a8e342126 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:25.965553 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-b2beeeb2-a1be-4c22-b123-281a8e342126 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Mar 26 20:40:25.965949 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:26.030546 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "id": "5", "swap": 0}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:26.048939 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076785 Mar 26 20:40:26.049490 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Sat Mar 26 20:40:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:40:26.061790 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-a0feefec-d0db-49a5-9df6-e86fe3dec7c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:26.082297 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-a0feefec-d0db-49a5-9df6-e86fe3dec7c8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024755 Mar 26 20:40:26.083010 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Sat Mar 26 20:40:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:40:53.138682 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:53.139712 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Mar 26 20:40:53.140139 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:53.197203 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-8e6bdd2b-525a-459e-8452-96b274d68634 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:53.213507 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-8e6bdd2b-525a-459e-8452-96b274d68634 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067368 Mar 26 20:40:53.214029 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 20:40:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:54.689947 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:54.691107 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-6fa8ba20-1c7e-47f9-bdb9-dc7da5de4fb0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Mar 26 20:40:54.691531 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:54.932336 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-d9e49c9c-4f01-4331-b789-036508d32225 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:54.938364 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.wsgi [None req-d9e49c9c-4f01-4331-b789-036508d32225 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 26 20:40:54.938935 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-d9e49c9c-4f01-4331-b789-036508d32225 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:54.939735 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-d9e49c9c-4f01-4331-b789-036508d32225 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059345 Mar 26 20:40:54.940270 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:40:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:54.949400 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-d63860ea-a557-4666-8661-557f72639dcb admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:54.970751 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-d63860ea-a557-4666-8661-557f72639dcb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024864 Mar 26 20:40:54.971281 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:54.980764 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-ca0743ea-5b4b-4df7-a102-c9870b337a69 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:55.001704 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-ca0743ea-5b4b-4df7-a102-c9870b337a69 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024461 Mar 26 20:40:55.002533 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:40:55.012086 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-b636dde3-383c-45c0-90fe-b8982e8c190d admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:55.018372 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.wsgi [None req-b636dde3-383c-45c0-90fe-b8982e8c190d admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 26 20:40:55.018957 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-b636dde3-383c-45c0-90fe-b8982e8c190d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:55.019755 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-b636dde3-383c-45c0-90fe-b8982e8c190d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011472 Mar 26 20:40:55.020294 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:40:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:56.342976 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-ca0743ea-5b4b-4df7-a102-c9870b337a69 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:56.344000 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-ca0743ea-5b4b-4df7-a102-c9870b337a69 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Mar 26 20:40:56.344396 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:56.539308 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-3aec4c6b-3bbf-4908-87f0-58fe9216c5cc admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:56.544876 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.wsgi [None req-3aec4c6b-3bbf-4908-87f0-58fe9216c5cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 26 20:40:56.545591 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-3aec4c6b-3bbf-4908-87f0-58fe9216c5cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:56.546413 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-3aec4c6b-3bbf-4908-87f0-58fe9216c5cc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058728 Mar 26 20:40:56.547034 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:40:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:56.556846 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-051a4f1b-2cda-4324-886e-ac842240b43d admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:56.571474 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-051a4f1b-2cda-4324-886e-ac842240b43d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018193 Mar 26 20:40:56.572183 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:56.584298 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-2bf6738f-ee4e-4933-ad01-d67f3d880f78 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:56.598706 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-2bf6738f-ee4e-4933-ad01-d67f3d880f78 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018093 Mar 26 20:40:56.599236 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:56.609011 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-41230219-655c-4302-b24f-fa302d6ee60e admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:56.614731 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.wsgi [None req-41230219-655c-4302-b24f-fa302d6ee60e admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 26 20:40:56.615334 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-41230219-655c-4302-b24f-fa302d6ee60e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:56.616160 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-41230219-655c-4302-b24f-fa302d6ee60e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011034 Mar 26 20:40:56.616701 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:40:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:57.960801 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-2bf6738f-ee4e-4933-ad01-d67f3d880f78 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:57.961803 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-2bf6738f-ee4e-4933-ad01-d67f3d880f78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Mar 26 20:40:57.962197 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:58.159484 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-6afb4363-b3cd-4a1b-8595-eaadd08a3c6d admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:58.164677 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.wsgi [None req-6afb4363-b3cd-4a1b-8595-eaadd08a3c6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 26 20:40:58.165241 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-6afb4363-b3cd-4a1b-8595-eaadd08a3c6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:58.166024 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-6afb4363-b3cd-4a1b-8595-eaadd08a3c6d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057356 Mar 26 20:40:58.166520 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:40:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:58.176105 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-dacf5e9d-2027-42be-b52e-eeb715c2e786 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:58.190226 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-dacf5e9d-2027-42be-b52e-eeb715c2e786 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017694 Mar 26 20:40:58.190747 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:58.200211 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:58.212748 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016434 Mar 26 20:40:58.213272 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:40:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:40:58.222339 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-19c92384-962c-4eb1-9448-ed2e8e126753 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:58.227662 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.wsgi [None req-19c92384-962c-4eb1-9448-ed2e8e126753 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 26 20:40:58.228265 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-19c92384-962c-4eb1-9448-ed2e8e126753 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:40:58.229039 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-19c92384-962c-4eb1-9448-ed2e8e126753 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010227 Mar 26 20:40:58.229519 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:40:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:59.564513 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:40:59.565518 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 26 20:40:59.565919 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:40:59.761392 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-cd01562d-47e1-4de5-99df-2f21561a7382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:40:59.778115 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-cd01562d-47e1-4de5-99df-2f21561a7382 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067003 Mar 26 20:40:59.778577 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Mar 26 20:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:41:01.121131 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:01.122653 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Mar 26 20:41:01.123055 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:41:01.320379 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-5ee2424f-ade7-4913-8e4e-5025e35b3643 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:41:01.337292 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-5ee2424f-ade7-4913-8e4e-5025e35b3643 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067808 Mar 26 20:41:01.337832 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Mar 26 20:41:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:41:02.662414 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:02.663442 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Mar 26 20:41:02.663838 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:41:02.860515 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-3d367942-46b4-429d-a884-e7135f712d1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:41:02.877571 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-3d367942-46b4-429d-a884-e7135f712d1b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066982 Mar 26 20:41:02.878098 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Mar 26 20:41:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:41:04.212773 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:04.213773 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Mar 26 20:41:04.214161 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:41:04.410402 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-fa056926-b72b-4f94-821e-8536ef8e6b14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:41:04.428875 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-fa056926-b72b-4f94-821e-8536ef8e6b14 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069006 Mar 26 20:41:04.429431 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Mar 26 20:41:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:41:05.768138 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:05.769125 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Mar 26 20:41:05.769513 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:41:05.963697 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-eaee9c70-b4ae-4dc8-919f-4bd17b9389c8 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:05.982956 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-eaee9c70-b4ae-4dc8-919f-4bd17b9389c8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069945 Mar 26 20:41:05.983629 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Mar 26 20:41:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:41:57.958542 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:57.959541 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-cdc3a0f5-4868-4119-8543-a073ad3e8ca2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Mar 26 20:41:57.960096 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Sat Mar 26 20:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:41:58.015955 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-ecd25eee-6a1c-4fef-830e-c9ffdb67161c admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:58.035122 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-ecd25eee-6a1c-4fef-830e-c9ffdb67161c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068584 Mar 26 20:41:58.035650 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 20:41:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:41:58.057657 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-be9da37c-6335-4c60-8ef6-4dbf72d4b523 admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:58.065212 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-be9da37c-6335-4c60-8ef6-4dbf72d4b523 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011142 Mar 26 20:41:58.065720 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Sat Mar 26 20:41:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:41:58.081154 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-1f01cf26-8eb1-4934-8a7f-dda9dfcdbd87 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:58.089053 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-1f01cf26-8eb1-4934-8a7f-dda9dfcdbd87 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010890 Mar 26 20:41:58.089741 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Sat Mar 26 20:41:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:41:58.101105 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-23535486-a0db-48b7-a6c0-1dd1af5c780c admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:58.109462 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-23535486-a0db-48b7-a6c0-1dd1af5c780c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011946 Mar 26 20:41:58.109985 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Sat Mar 26 20:41:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:41:58.120876 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:41:58.128629 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010732 Mar 26 20:41:58.128854 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Sat Mar 26 20:41:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:43:35.378747 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-3fb0a422-3478-4e0b-b64a-9d992ca7a239 tempest-verify_tempest_config-1633795294 tempest-verify_tempest_config-1633795294-project] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:43:35.380746 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-3fb0a422-3478-4e0b-b64a-9d992ca7a239 tempest-verify_tempest_config-1633795294 tempest-verify_tempest_config-1633795294-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105111 Mar 26 20:43:35.381274 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 20:43:35 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:47:24.288796 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:47:24.289785 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Mar 26 20:47:24.290178 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:47:24.542572 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:47:24.543758 ncdv-master-1 devstack@n-api.service[125997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:47:24.543758 ncdv-master-1 devstack@n-api.service[125997]: warnings.warn(msg) Mar 26 20:47:24.544995 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:47:24.545454 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:47:24.546259 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:47:24.546692 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:47:24.587498 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-aa4193be-de74-4726-b720-b4d424c8852e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.155237 Mar 26 20:47:24.588160 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:47:24 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:47:25.912139 ncdv-master-1 devstack@n-api.service[125998]: DEBUG nova.api.openstack.wsgi [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] Calling method '>' {{(pid=125998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:47:25.913278 ncdv-master-1 devstack@n-api.service[125998]: INFO nova.api.openstack.requestlog [None req-09ab9334-2b2b-4b12-a7fe-155583443ab4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Mar 26 20:47:25.913687 ncdv-master-1 devstack@n-api.service[125998]: [pid: 125998|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Mar 26 20:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:47:26.108201 ncdv-master-1 devstack@n-api.service[125997]: DEBUG nova.api.openstack.wsgi [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] Calling method '>' {{(pid=125997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:47:26.109368 ncdv-master-1 devstack@n-api.service[125997]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:47:26.109368 ncdv-master-1 devstack@n-api.service[125997]: warnings.warn(msg) Mar 26 20:47:26.111128 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:47:26.111577 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:47:26.112401 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:47:26.112833 ncdv-master-1 devstack@n-api.service[125997]: DEBUG oslo_concurrency.lockutils [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:47:26.134665 ncdv-master-1 devstack@n-api.service[125997]: INFO nova.api.openstack.requestlog [None req-a3da1f37-53a8-46ef-b179-b2a010ffa9bb admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.077743 Mar 26 20:47:26.135827 ncdv-master-1 devstack@n-api.service[125997]: [pid: 125997|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:47:26 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:48:12.045595 ncdv-master-1 devstack@n-api.service[125996]: Sat Mar 26 20:48:12 2022 - graceful shutdown triggered... Mar 26 20:48:12.046142 ncdv-master-1 devstack@n-api.service[125997]: Gracefully killing worker 1 (pid: 125997)... Mar 26 20:48:12.045723 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Mar 26 20:48:12.047040 ncdv-master-1 devstack@n-api.service[125998]: Gracefully killing worker 2 (pid: 125998)... Mar 26 20:48:13.046703 ncdv-master-1 devstack@n-api.service[125996]: worker 1 buried after 1 seconds Mar 26 20:48:13.046703 ncdv-master-1 devstack@n-api.service[125996]: worker 2 buried after 1 seconds Mar 26 20:48:13.047273 ncdv-master-1 devstack@n-api.service[125996]: goodbye to uWSGI. Mar 26 20:48:13.048307 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Mar 26 20:48:13.048956 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Mar 26 20:48:13.051600 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 26 20:48:13.103147 ncdv-master-1 devstack@n-api.service[141568]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 26 20:48:13.119055 ncdv-master-1 devstack@n-api.service[141568]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 26 20:48:13 2022] *** Mar 26 20:48:13.119430 ncdv-master-1 devstack@n-api.service[141568]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 26 20:48:13.119606 ncdv-master-1 devstack@n-api.service[141568]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 26 20:48:13.119747 ncdv-master-1 devstack@n-api.service[141568]: nodename: ncdv-master-1 Mar 26 20:48:13.119897 ncdv-master-1 devstack@n-api.service[141568]: machine: x86_64 Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: clock source: unix Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: pcre jit disabled Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: detected number of CPU cores: 4 Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: current working directory: / Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: detected binary path: /usr/bin/uwsgi-core Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: your processes number limit is 47680 Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: your memory page size is 4096 bytes Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: detected max file descriptor number: 2048 Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: lock engine: pthread robust mutexes Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: thunder lock: enabled Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 26 20:48:13.122003 ncdv-master-1 devstack@n-api.service[141568]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 26 20:48:13.170222 ncdv-master-1 devstack@n-api.service[141568]: Python main interpreter initialized at 0x55db2b6309c0 Mar 26 20:48:13.170222 ncdv-master-1 devstack@n-api.service[141568]: python threads support enabled Mar 26 20:48:13.170222 ncdv-master-1 devstack@n-api.service[141568]: your server socket listen backlog is limited to 100 connections Mar 26 20:48:13.170222 ncdv-master-1 devstack@n-api.service[141568]: your mercy for graceful operations on workers is 90 seconds Mar 26 20:48:13.170642 ncdv-master-1 devstack@n-api.service[141568]: mapped 403077 bytes (393 KB) for 2 cores Mar 26 20:48:13.170642 ncdv-master-1 devstack@n-api.service[141568]: *** Operational MODE: preforking *** Mar 26 20:48:13.170907 ncdv-master-1 devstack@n-api.service[141568]: *** uWSGI is running in multiple interpreter mode *** Mar 26 20:48:13.170907 ncdv-master-1 devstack@n-api.service[141568]: spawned uWSGI master process (pid: 141568) Mar 26 20:48:13.171116 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 26 20:48:13.171907 ncdv-master-1 devstack@n-api.service[141568]: spawned uWSGI worker 1 (pid: 141580, cores: 1) Mar 26 20:48:13.172115 ncdv-master-1 devstack@n-api.service[141568]: spawned uWSGI worker 2 (pid: 141581, cores: 1) Mar 26 20:48:13.172423 ncdv-master-1 devstack@n-api.service[141568]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 26 20:48:14.428907 ncdv-master-1 devstack@n-api.service[141580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 26 20:48:14.440700 ncdv-master-1 devstack@n-api.service[141581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 26 20:48:15.358050 ncdv-master-1 devstack@n-api.service[141580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:48:15.358050 ncdv-master-1 devstack@n-api.service[141580]: from cryptography.utils import int_from_bytes Mar 26 20:48:15.358312 ncdv-master-1 devstack@n-api.service[141580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:48:15.358312 ncdv-master-1 devstack@n-api.service[141580]: from cryptography.utils import int_from_bytes Mar 26 20:48:15.371268 ncdv-master-1 devstack@n-api.service[141581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:48:15.371268 ncdv-master-1 devstack@n-api.service[141581]: from cryptography.utils import int_from_bytes Mar 26 20:48:15.371594 ncdv-master-1 devstack@n-api.service[141581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:48:15.371594 ncdv-master-1 devstack@n-api.service[141581]: from cryptography.utils import int_from_bytes Mar 26 20:48:17.743731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:48:17.744331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:48:17.744550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:48:17.744921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:48:17.745183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:48:17.745575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.745902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.746232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.746552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.746887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.747202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.747527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.747851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.748217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.748483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.748801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.749129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.749464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.749778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.750094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.750417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.750727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.751054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.751364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.751870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.752331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.752648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.753089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.753305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.753624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.753939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.754267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.754579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.754906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.755239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.755623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.755959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.756288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.756606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.757029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.757346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.757661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.757986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.758336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.758657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.758992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.759319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.759644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.759993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.760305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.760622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.760936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.761262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.761571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.761884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.762137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.762483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.762815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.763146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.763565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.763867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.764173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.764577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.765008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.765383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.765940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.766253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.766597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.766926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.767289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.767627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.768050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.768403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.768728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.769124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.769394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.769712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.770114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.771000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.771000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.771000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.771382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.771650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.772012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.772341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.772654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.772969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.773282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.773609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.774467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.774786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.775041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.775741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.775741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.776026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.776341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.776652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.776997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.777271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.777635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.777908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.778197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.778508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.778820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.779131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.779442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.779750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.780118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.780440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.780814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.781080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.781395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.781705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.782017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.782344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.782655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.782965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.783289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.783602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.783944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.784255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.784568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.784878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.785215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.785514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.785874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.786202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.786513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.786833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.787142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.787453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.787763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.788102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.788412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.788723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.789028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.789351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.790519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.790839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.791157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.791503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.791830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.792210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.792553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.792906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.793225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.793568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.793910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.794237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.794558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.794877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.795210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.795529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.795850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.796194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.796534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.796850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.797187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.797510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.797836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.798162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.798481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.798804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.799142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.799469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.799787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.800161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.800515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.800837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.801170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.801501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.801820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.802137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.802491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.802785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.803126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.803442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.803767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.804107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.804427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.804745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.805064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.805420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.805761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.806082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.806405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.806727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.807050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.807366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.807606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:48:17.808056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.808156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:48:17.808241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.808330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.808479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:48:17.808630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.808860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:48:17.808964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.809127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:48:17.809285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.809527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.809617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.809863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.809966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.810197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.810295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.810511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.810614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.810852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.810950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.811167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.811256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.811489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.811579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.811810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.811931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.812155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.812258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.812452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.812556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.812779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.812881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.813097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.813196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.813411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.813511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.813742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.813841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.814060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.814158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.814375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.814475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.814693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.814789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.815002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.815091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.815313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.815414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.815633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.815977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.816298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.816633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.816748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.816968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.817076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.817277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.817439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.817628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.817738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.817947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.818062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.818290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.818400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.818632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.818748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.818940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.819038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.819271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.819394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.819602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.819703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.821897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.821897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.822039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.822306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.822415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.822512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.822597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.822791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.822907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.823104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.823240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.823414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.823520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.823744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.823837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.824088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.824390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.824541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.824701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.824803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.825010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.825195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.825362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.825521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.825674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.825846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.826026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.826172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.826368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.826510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.826700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.826838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.827030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.827135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.827350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.827455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.827675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.827819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.828015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.828182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.828334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.828434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.828653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.828799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.828970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.829061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.829238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.829336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.829572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.829663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.829909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.830044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.830483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.830614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.830813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.830950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.831135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.831268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.831455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.831594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.831776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.831907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.832134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.832243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.832458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.832585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.832778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.832930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.833115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.833274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.833443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.833565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.833778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.833869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.834100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.834200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.834433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.834524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.834792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.834891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.835102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.835203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.835418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.835516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.835743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.835841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.836079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.836174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.836406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.836985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.837268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.837365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.837605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.837704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.837927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.838024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.838249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.838347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.838565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.838664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.838890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.839024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.839224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.839334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.839545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.839635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.839809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.839906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.840153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.840301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.840472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.840562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.840816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.840931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.841132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.841236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.841448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.841553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.841757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.841862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.842068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.842165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.842382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.842485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.842698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.842796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.843016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.843121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.843335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.843453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.843644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.843751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.843984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.844098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.844302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.844403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.844619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.844744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.844920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.845051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.845346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.845507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.845682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.845848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.846006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.846160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.846307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.846484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.846769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.846883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.847115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.847213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.847423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.847841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.848094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.848408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.848736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.848947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.849068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.849307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.849420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.849612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.849710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.849956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.850064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.850291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.850390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.850601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.850699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.850936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.851095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.851247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.851399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.851541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.851683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.856073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.856206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.856303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.856563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.856661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.856743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.856881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.856956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.857105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.857261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.857417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.857606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.857844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.857939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.858814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.858941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.859096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:48:17.859251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.859896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.860432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.860539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.860616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.860768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.860894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.861949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.862418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.862518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.862592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.862673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.862755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.863997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.864263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.864603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.864948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.868497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.869867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.869867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.870163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.870498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.870650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.870802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.870945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.871950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.872929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.873869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.874978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.875238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.875402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.875631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.875861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.876856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.877922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.878857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.879854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.880091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.880091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.880390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.880694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.880851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.881949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.882867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.883911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.884117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.884329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.884508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.884731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.884879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.885072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.885072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.885391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.885647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.885960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.886851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.887808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.888996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.889965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.890120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.890270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.890419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.890560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.890851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.891642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.891814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.891988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.892950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.893882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.894024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.894165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.894332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.894658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.894975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.895124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.895268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.895415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.895557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.895804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.896571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.897689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.897839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.898901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.899841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.900043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.900188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.900342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.900541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.900697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.901903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.902965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.903950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.904105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.904269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.904471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.904711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.904892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.905119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.905274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.905429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.905591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.906011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.906329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.906529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.906691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.906847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.907822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.908845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.909755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.910860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.911962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.912945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.913863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.914063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.914063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.914358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.914514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.915470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.915637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.915785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.915959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.916241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.916548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.916753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.916753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.917987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.918937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.919875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.920918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.921093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.921472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.921639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.921789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.921945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.922914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.923977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.924947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.925109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.925257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.925562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.925721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.925879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.926027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.926208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.926649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.926809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.926965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.927901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.928370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.928525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.928691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.928849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.929964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.930930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.931852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.932809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.933875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.934970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.935127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.935127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.935127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.935702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.935870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.936043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.936193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.936340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.936517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.936880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.937864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.938921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.939849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.940935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.941084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.941255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.941403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.941703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.941866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.942925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.943863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.944855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.945168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.945168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.945523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.945865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.946031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.946181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.946342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.946490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.946638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.947952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.948892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.949936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.950909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.951142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.951292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.951447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.951595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.951936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.952897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.953867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.954943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.955486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.955647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.956804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.957239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.957411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.957561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.957709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.957856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.958860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.959789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.960869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.961029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.961189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.961387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.961387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.962981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.963268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.963430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.963587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.963760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.963908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.964882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.965970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.966855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.967046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.967433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.967598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.967747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.967904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.968840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.969926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.970856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.971011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.971167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.971314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.971462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.972337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.972517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.972668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.972826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.972983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.973900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.974900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.975841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.976129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.976284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.976284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.976566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.976714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.977014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.978989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.979898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.980944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.981870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.982017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.982218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.982542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.982705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.982903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.983063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.983212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.983371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.983519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.983675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.984958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.985865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.986012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.986160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.986307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.986465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.986791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.987117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.987288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.987439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.987595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.987753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.988142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.988459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.988459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.988770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.988920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.989976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.990909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.991155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.991305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.991461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.991609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.991835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.992860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.993310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.993310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.993592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.993786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.993994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.994918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.995826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.996964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.997139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.997441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.997591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.997739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.997895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.998080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.998384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.998555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.998800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.998967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:17.999891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.000887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.001968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.002123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.002272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.002426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.002619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.002859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.003868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.004974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.005129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.005287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.005445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.006632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.006632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.006972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.007167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.007476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.007654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.007839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.008620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.008736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.008825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.008987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.009148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.009299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.009456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.009605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.009870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.010856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.011784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.012109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.012258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.012412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.012586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.012743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.013933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.014842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.015894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.016877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.017903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.019159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.020421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.020421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.020421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.020421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.021064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.023023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.024577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.024765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.024925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.025856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.026897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.027822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.028292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.029669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.029669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.029669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.030999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.031957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.032908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.033928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.034947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.035993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.036909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.037990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.038273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.038429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.038587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.038587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.038587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.039120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.039120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.039490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.040347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.040609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.040609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.040922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.041857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.042930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.043309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.044789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.046250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.047355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.048756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.050775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.051065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.051221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.051658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.052105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.052393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.052690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.053017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.054962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.055456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.056237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.056237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.056415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.056632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.057168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.057677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.058006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.058373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.058709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.059036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.059492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.060399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.060399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.060699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.061089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.061433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.061773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_db.sqlalchemy.engines [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.062338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.062338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.062903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.062903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.063214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.063582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.063799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.064170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.064488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.064811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.065140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.065598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.065774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.066103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.066411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.066728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.067056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.067626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.068090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.068371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.068791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.069060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.069381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.069652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.069939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.070258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.070577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.071409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.071740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.072085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.072502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.072853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.073177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.073497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.073857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.074325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.074594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.074980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.075311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.075655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.076005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.076348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.076690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.077031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.077581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.077941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.078271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.078602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.078932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.079265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.079597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.079934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.080555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.080898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.081220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.081565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.081902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.082239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.082573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.082909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.083256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.083583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.083951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.084264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.084644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.084912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.085243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.085575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.085918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.086261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.087152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.087628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.088025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.088356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.088722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.089066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.089392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.089721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.090042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:48:18.090330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:48:18.113646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_db.sqlalchemy.engines [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.128287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.context [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141580) load_cells /opt/stack/nova/nova/context.py:464}} Mar 26 20:48:18.132544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:48:18.134945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:48:18.135765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:48:18.137774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:48:18.148393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_db.sqlalchemy.engines [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.152405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_db.sqlalchemy.engines [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.180390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.context [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141581) load_cells /opt/stack/nova/nova/context.py:464}} Mar 26 20:48:18.184820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:48:18.186596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:48:18.187440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:48:18.189583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:48:18.201155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_db.sqlalchemy.engines [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.202018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_db.sqlalchemy.engines [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.312877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_db.sqlalchemy.engines [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.366328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_db.sqlalchemy.engines [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:48:18.750257 ncdv-master-1 devstack@n-api.service[141580]: WARNING keystonemiddleware.auth_token [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:48:18.756926 ncdv-master-1 devstack@n-api.service[141580]: WARNING keystonemiddleware.auth_token [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:48:18.808197 ncdv-master-1 devstack@n-api.service[141581]: WARNING keystonemiddleware.auth_token [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:48:18.814851 ncdv-master-1 devstack@n-api.service[141581]: WARNING keystonemiddleware.auth_token [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:48:18.983243 ncdv-master-1 devstack@n-api.service[141580]: WARNING keystonemiddleware.auth_token [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:48:18.988509 ncdv-master-1 devstack@n-api.service[141580]: WARNING keystonemiddleware.auth_token [None req-9847ea72-afc3-400f-be43-1be951bce692 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:48:18.994511 ncdv-master-1 devstack@n-api.service[141580]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db2b6309c0 pid: 141580 (default app) Mar 26 20:48:19.046036 ncdv-master-1 devstack@n-api.service[141581]: WARNING keystonemiddleware.auth_token [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 26 20:48:19.051278 ncdv-master-1 devstack@n-api.service[141581]: WARNING keystonemiddleware.auth_token [None req-76f9be23-5a87-4b73-b746-fb63131e2492 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 26 20:48:19.057298 ncdv-master-1 devstack@n-api.service[141581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db2b6309c0 pid: 141581 (default app) Mar 26 20:49:04.091820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3103faec-d784-40fd-85d7-264c2cc4acfb tempest-AZAdminNegativeTestJSON-2109487665 tempest-AZAdminNegativeTestJSON-2109487665-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:04.093969 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:04.093969 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:04.095404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3103faec-d784-40fd-85d7-264c2cc4acfb tempest-AZAdminNegativeTestJSON-2109487665 tempest-AZAdminNegativeTestJSON-2109487665-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2d54340f1ffa4a4d91edc495ad009807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330a9fb37786483a8c98e7864356025f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:04.096253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3103faec-d784-40fd-85d7-264c2cc4acfb tempest-AZAdminNegativeTestJSON-2109487665 tempest-AZAdminNegativeTestJSON-2109487665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:04.097318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3103faec-d784-40fd-85d7-264c2cc4acfb tempest-AZAdminNegativeTestJSON-2109487665 tempest-AZAdminNegativeTestJSON-2109487665-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.145699 Mar 26 20:49:04.097978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:49:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:04.227029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16ee04b3-ef8c-472a-84fa-791e521cb234 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-114255256", "id": 1454501605, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:04.240395 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:04.240395 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:04.272164 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16ee04b3-ef8c-472a-84fa-791e521cb234 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 1.272245 Mar 26 20:49:04.273133 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1/2] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:49:02 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:04.754223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9d4c551-c00e-4cec-8e31-720b469b161d tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:04.781047 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9d4c551-c00e-4cec-8e31-720b469b161d tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] 10.222.0.16 "GET /compute/v2.1/flavors/1454501605" status: 200 len: 467 microversion: 2.61 time: 0.500438 Mar 26 20:49:04.782028 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1198 bytes} [Sat Mar 26 20:49:04 2022] GET /compute/v2.1/flavors/1454501605 => generated 467 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:04.799528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b6eb363-0529-4da8-8902-7cfceaeecad2 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1960110884", "ram": 512, "vcpus": 1, "disk": 10, "id": 1165326200, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:04.817164 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b6eb363-0529-4da8-8902-7cfceaeecad2 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.474675 Mar 26 20:49:04.817968 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:04 2022] POST /compute/v2.1/flavors => generated 416 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:49:04.923115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f4538b1-e916-427e-ae98-4e6cb3ca2c8d tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2126728607", "id": 1785194574, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:04.937069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Calling method '.version_select at 0x7f6e5ba34160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:04.938718 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:04.938718 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:04.942896 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f4538b1-e916-427e-ae98-4e6cb3ca2c8d tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.123957 Mar 26 20:49:04.944951 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3/5] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:49:04 2022] POST /compute/v2.1/flavors => generated 471 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:04.946352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141580) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 26 20:49:04.947372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:04.948055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:04.976087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:04.976744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:04.989344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:04.989802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:04.996454 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca932a0a-b83f-47a0-b694-5ecf3f62dd9b tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.213147 Mar 26 20:49:04.997241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3/6] 10.222.0.16 () {60 vars in 1207 bytes} [Sat Mar 26 20:49:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:05.013294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9656cf15-e32b-46de-940b-4fe53a23559e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-245582511", "id": 1948878681, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.032688 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9656cf15-e32b-46de-940b-4fe53a23559e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.086319 Mar 26 20:49:05.033286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:05.039465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-23b85127-c977-45e0-9c9f-f845b997a002 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5bf2c430>, body: {"flavor": {"description": "new"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.049728 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.049728 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:05.096076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-23b85127-c977-45e0-9c9f-f845b997a002 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1454501605" status: 200 len: 468 microversion: 2.61 time: 0.061721 Mar 26 20:49:05.097285 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 5/8] 10.222.0.16 () {62 vars in 1218 bytes} [Sat Mar 26 20:49:05 2022] PUT /compute/v2.1/flavors/1454501605 => generated 468 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:05.103822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9eac2bd3-fb33-4dd3-86c7-b9033f992b49 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.106142 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.106142 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:05.116526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '.version_select at 0x7f6e5b9ee5e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.117480 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.117480 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.118677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:05.119129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:05.137080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:05.137594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:05.149316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:05.149768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:05.150844 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9eac2bd3-fb33-4dd3-86c7-b9033f992b49 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051859 Mar 26 20:49:05.155956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 6/9] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:05.159168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64239152-b1e2-471c-ad70-dd281c84bc39 tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.162299 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13284062-20fd-40a0-b4d1-bdfd70f6016b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.163643 Mar 26 20:49:05.163653 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 4/10] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:49:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:05.168598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8de9681-f26b-4aac-bfef-67cdc57bc499 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1347641857"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.187901 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.187901 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.189257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-b8de9681-f26b-4aac-bfef-67cdc57bc499 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Generated uuid 35f2a865-edfa-440e-8a03-b3393df285e1 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:05.266863 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8de9681-f26b-4aac-bfef-67cdc57bc499 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.101911 Mar 26 20:49:05.267534 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 5/11] 10.222.0.16 () {62 vars in 1204 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:05.277577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9251800-6234-45d7-bd24-6ba1becbf708 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.278839 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.278839 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.319704 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9251800-6234-45d7-bd24-6ba1becbf708 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1948878681" status: 202 len: 0 microversion: 2.1 time: 0.049884 Mar 26 20:49:05.321169 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:05 2022] DELETE /compute/v2.1/flavors/1948878681 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:05.326627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4382b5f-eb8d-40a8-a467-3cbdf73219c2 tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.360598 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64239152-b1e2-471c-ad70-dd281c84bc39 tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1785194574/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.207024 Mar 26 20:49:05.365758 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 7/13] 10.222.0.16 () {62 vars in 1264 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors/1785194574/os-extra_specs => generated 62 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:05.367524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4382b5f-eb8d-40a8-a467-3cbdf73219c2 tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 7204 microversion: 2.61 time: 0.044894 Mar 26 20:49:05.376060 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 7/14] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 7204 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:05.388499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db3a659f-bfc3-4525-a092-f2ef7acb8732 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1804781919"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.479995 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.479995 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.523665 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db3a659f-bfc3-4525-a092-f2ef7acb8732 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.145349 Mar 26 20:49:05.524652 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 8/15] 10.222.0.16 () {62 vars in 1209 bytes} [Sat Mar 26 20:49:05 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:05.529954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e495dce-94b9-4048-866c-27564d57147d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.559477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e495dce-94b9-4048-866c-27564d57147d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.033608 Mar 26 20:49:05.560112 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:05.564799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a3290d9-e7a7-457e-9701-9cd7e4ab65cd tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.565719 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.565719 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.585263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a3290d9-e7a7-457e-9701-9cd7e4ab65cd tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1785194574" status: 202 len: 0 microversion: 2.86 time: 0.023170 Mar 26 20:49:05.586242 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 10/17] 10.222.0.16 () {60 vars in 1201 bytes} [Sat Mar 26 20:49:05 2022] DELETE /compute/v2.1/flavors/1785194574 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:49:05.592415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85b5cbff-8c0c-416e-a58b-77fe2be490f1 tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.612923 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85b5cbff-8c0c-416e-a58b-77fe2be490f1 tempest-FlavorsV261TestJSON-777040993 tempest-FlavorsV261TestJSON-777040993-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3409 microversion: 2.61 time: 0.025089 Mar 26 20:49:05.613411 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 11/18] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors => generated 3409 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:05.617918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aba2b7f3-6560-4264-ab4a-4320f190dee1 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.618954 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.618954 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.628661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aba2b7f3-6560-4264-ab4a-4320f190dee1 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.013992 Mar 26 20:49:05.629234 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 12/19] 10.222.0.16 () {60 vars in 1189 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:05.634561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81c755f2-94ac-4d63-ae2f-0db494f017be tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1343384385", "id": 325708764, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.636299 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.636299 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.660420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b261275e-a3ea-4fae-86e5-e5b6523abdd7 tempest-FlavorsExtraSpecsTestJSON-1585952095 tempest-FlavorsExtraSpecsTestJSON-1585952095-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.666521 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81c755f2-94ac-4d63-ae2f-0db494f017be tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035907 Mar 26 20:49:05.667388 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 13/20] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:05.672283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef2c3e32-bb94-4568-8331-b0e91856d02d tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.681016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b261275e-a3ea-4fae-86e5-e5b6523abdd7 tempest-FlavorsExtraSpecsTestJSON-1585952095 tempest-FlavorsExtraSpecsTestJSON-1585952095-project] 10.222.0.16 "GET /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.315296 Mar 26 20:49:05.682132 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 8/21] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:05.688084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d346fa75-053b-4b96-8124-cc3024a24310 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.689240 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.689240 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:05.698444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef2c3e32-bb94-4568-8331-b0e91856d02d tempest-FlavorMetadataValidation-743059086 tempest-FlavorMetadataValidation-743059086-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 7171 microversion: 2.86 time: 0.029674 Mar 26 20:49:05.699579 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 14/22] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 7171 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:05.704428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d5a48fc7-cc0e-419c-ab77-5bfbff85698e tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.705893 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.705893 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:05.720334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5a48fc7-cc0e-419c-ab77-5bfbff85698e tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:05.721050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5a48fc7-cc0e-419c-ab77-5bfbff85698e tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:05.729345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d346fa75-053b-4b96-8124-cc3024a24310 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1454501605" status: 202 len: 0 microversion: 2.61 time: 0.044827 Mar 26 20:49:05.730511 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 9/23] 10.222.0.16 () {60 vars in 1201 bytes} [Sat Mar 26 20:49:05 2022] DELETE /compute/v2.1/flavors/1454501605 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:49:05.736660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-572e4333-63e7-4286-aa44-7319f2b55b46 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.777733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-572e4333-63e7-4286-aa44-7319f2b55b46 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5801 microversion: 2.1 time: 0.045825 Mar 26 20:49:05.778336 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 10/24] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 5801 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:05.783056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c42c7487-418c-4671-9b2f-694f1ee2cf50 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.804076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c42c7487-418c-4671-9b2f-694f1ee2cf50 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024585 Mar 26 20:49:05.807992 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 11/25] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:05.812765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4bab744d-88ac-438d-a105-edd1fe660dd9 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.836919 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4bab744d-88ac-438d-a105-edd1fe660dd9 tempest-FlavorsV261TestJSON-957449988 tempest-FlavorsV261TestJSON-957449988-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6728 microversion: 2.61 time: 0.031067 Mar 26 20:49:05.837755 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 12/26] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 6728 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:05.841847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16e8211a-f40c-4d2a-a36a-ccbfbd3f7534 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.867131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16e8211a-f40c-4d2a-a36a-ccbfbd3f7534 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/325708764" status: 202 len: 0 microversion: 2.1 time: 0.028539 Mar 26 20:49:05.867659 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:49:05 2022] DELETE /compute/v2.1/flavors/325708764 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:05.872613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a8c78d4-406b-4c44-8a8a-9c35c05ae54a tempest-FlavorsExtraSpecsTestJSON-1585952095 tempest-FlavorsExtraSpecsTestJSON-1585952095-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.882232 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a8c78d4-406b-4c44-8a8a-9c35c05ae54a tempest-FlavorsExtraSpecsTestJSON-1585952095 tempest-FlavorsExtraSpecsTestJSON-1585952095-project] 10.222.0.16 "GET /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013439 Mar 26 20:49:05.884055 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:05.890055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02e6c5aa-1054-477b-bf76-c071780dbb3b tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:05.911813 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-02e6c5aa-1054-477b-bf76-c071780dbb3b tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.026603 Mar 26 20:49:05.922580 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:05.922580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c5da3c1-fa92-49cd-b458-a6c0e56350b3 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.941543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c5da3c1-fa92-49cd-b458-a6c0e56350b3 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027613 Mar 26 20:49:05.942723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 16/30] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:05.952171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad6a6d69-ebaf-46c3-a75d-cb14101575ed tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-470236076", "id": 1290595344, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:05.994886 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad6a6d69-ebaf-46c3-a75d-cb14101575ed tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.050844 Mar 26 20:49:05.994886 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 17/31] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/flavors => generated 428 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:05.994886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58ba21d7-dae5-43b9-b7c3-721d97f943b8 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.013474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58ba21d7-dae5-43b9-b7c3-721d97f943b8 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016784 Mar 26 20:49:06.014485 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:49:05 2022] GET /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:06.021752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d381cd5e-c5ca-4a54-89d2-087e2b9acd46 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.044795 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d381cd5e-c5ca-4a54-89d2-087e2b9acd46 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1290595344" status: 202 len: 0 microversion: 2.1 time: 0.029150 Mar 26 20:49:06.045399 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 19/33] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/1290595344 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:06.053740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2efca043-030c-4ab2-a87a-81d33535c379 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:06.055002 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:06.055002 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:06.096565 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2efca043-030c-4ab2-a87a-81d33535c379 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.050071 Mar 26 20:49:06.098663 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 20/34] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Mar 26 20:49:06 2022] PUT /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:06.105651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1c7a1e3-8c53-40f6-b3fb-b7f56dbbb917 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.130631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1c7a1e3-8c53-40f6-b3fb-b7f56dbbb917 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.030601 Mar 26 20:49:06.132262 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 21/35] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:06.137264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a944f31-971d-4845-b676-6d82833a0f75 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.148953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a944f31-971d-4845-b676-6d82833a0f75 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015335 Mar 26 20:49:06.149840 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 22/36] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/1165326200/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:06.155668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae130848-40c8-4c0c-8cf2-88d279ce46e1 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1995260540", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:06.175290 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae130848-40c8-4c0c-8cf2-88d279ce46e1 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024193 Mar 26 20:49:06.176585 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 23/37] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:06 2022] POST /compute/v2.1/flavors => generated 507 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:06.181940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94dba395-6e27-4009-b50a-f3de7cd1fa56 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.182816 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:06.182816 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:06.212975 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94dba395-6e27-4009-b50a-f3de7cd1fa56 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.035160 Mar 26 20:49:06.213908 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 24/38] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/1165326200/os-extra_specs/hw:numa_nodes => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:06.220822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d901b685-a0b6-46fb-bb8b-d52c46f22e74 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.246407 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d901b685-a0b6-46fb-bb8b-d52c46f22e74 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/12c0cbb8-4f2e-4220-9913-867be8eecbd2" status: 202 len: 0 microversion: 2.1 time: 0.031055 Mar 26 20:49:06.251121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 25/39] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/12c0cbb8-4f2e-4220-9913-867be8eecbd2 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:06.256279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-360e4983-dd2a-48f6-8242-f7c3ea3c5c66 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.280728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-360e4983-dd2a-48f6-8242-f7c3ea3c5c66 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1165326200/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.028133 Mar 26 20:49:06.282613 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 26/40] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/1165326200/os-extra_specs/hw:cpu_policy => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:06.288588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-28444cd7-53d2-431c-b8f7-5ecabafa3f9d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.310538 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-28444cd7-53d2-431c-b8f7-5ecabafa3f9d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.026668 Mar 26 20:49:06.321333 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 27/41] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:06.327625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6432c06-6e24-49e2-8df1-61b3983b4130 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.337081 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d6432c06-6e24-49e2-8df1-61b3983b4130 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1165326200/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015292 Mar 26 20:49:06.337671 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 28/42] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/1165326200/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:06.344836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e35d97a2-d8d4-4e23-abe4-76186f937bf4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-271446066", "id": "01914337-3289-45ae-9399-9fd596b80806", "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:06.367319 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e35d97a2-d8d4-4e23-abe4-76186f937bf4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.028626 Mar 26 20:49:06.375070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 29/43] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:06 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:06.379961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7818e690-8cab-49c2-bde8-cafd5ab28c61 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.399602 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7818e690-8cab-49c2-bde8-cafd5ab28c61 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1165326200" status: 202 len: 0 microversion: 2.1 time: 0.023248 Mar 26 20:49:06.403432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 30/44] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/1165326200 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:06.408723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16b13484-d457-42a7-a48b-c7907683131e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.442801 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16b13484-d457-42a7-a48b-c7907683131e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/01914337-3289-45ae-9399-9fd596b80806" status: 202 len: 0 microversion: 2.1 time: 0.038166 Mar 26 20:49:06.447738 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 31/45] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:49:06 2022] DELETE /compute/v2.1/flavors/01914337-3289-45ae-9399-9fd596b80806 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:06.450839 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d5a48fc7-cc0e-419c-ab77-5bfbff85698e tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.749973 Mar 26 20:49:06.451447 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 15/46] 10.222.0.16 () {62 vars in 1231 bytes} [Sat Mar 26 20:49:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:06.458084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90a14b16-db64-426a-b77d-04fc95b42d72 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.462750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e59c3f02-370f-4016-bf42-6d58fea20b91 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.482352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e59c3f02-370f-4016-bf42-6d58fea20b91 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027787 Mar 26 20:49:06.492661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 32/47] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:06.498132 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90a14b16-db64-426a-b77d-04fc95b42d72 tempest-FlavorsExtraSpecsTestJSON-1279541876 tempest-FlavorsExtraSpecsTestJSON-1279541876-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043200 Mar 26 20:49:06.498263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-20211d59-5576-4a01-8ca5-2e2c012a8153 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:06.498742 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 16/48] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:06.505040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38845c44-4948-4999-b5b7-34a27ceca265 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1358792216", "id": 772581785, "os-flavor-access:is_public": "True"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:06.509197 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:06.509197 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:06.513510 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:06.513510 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:06.537782 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38845c44-4948-4999-b5b7-34a27ceca265 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036200 Mar 26 20:49:06.539761 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 17/49] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:06 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:06.549741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29eb3b2a-7b93-4487-9ded-343301270390 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:06.552426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20211d59-5576-4a01-8ca5-2e2c012a8153 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:06.553107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20211d59-5576-4a01-8ca5-2e2c012a8153 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:06.571202 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29eb3b2a-7b93-4487-9ded-343301270390 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/772581785" status: 200 len: 411 microversion: 2.1 time: 0.026190 Mar 26 20:49:06.579502 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 18/50] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/772581785 => generated 411 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.096246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c3e1ad1-44ba-4fa9-aa9d-ac148a667c9b tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.133093 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c3e1ad1-44ba-4fa9-aa9d-ac148a667c9b tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.552024 Mar 26 20:49:07.144227 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 19/51] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:06 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.149766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b51fda0d-2fb6-4e88-8bdc-ee62edd6883f tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.150620 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:07.150620 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:07.181170 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b51fda0d-2fb6-4e88-8bdc-ee62edd6883f tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/772581785" status: 202 len: 0 microversion: 2.1 time: 0.035501 Mar 26 20:49:07.186058 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 20/52] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:49:07 2022] DELETE /compute/v2.1/flavors/772581785 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:07.191146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bf0fc7c7-13a5-4657-8450-e70aa385a83d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.371403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bf0fc7c7-13a5-4657-8450-e70aa385a83d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.184057 Mar 26 20:49:07.372017 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 21/53] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.388567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-01a372ee-1d37-4462-83fe-17da469b6aac tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-566946063", "id": 1555715559, "os-flavor-access:is_public": "False"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:07.404694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-01a372ee-1d37-4462-83fe-17da469b6aac tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.019788 Mar 26 20:49:07.405324 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 22/54] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/flavors => generated 429 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:49:07.416066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35bf1137-d3fc-4e6e-908a-ee9201be02de tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "1555715559"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:07.425988 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-35bf1137-d3fc-4e6e-908a-ee9201be02de tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] HTTP exception thrown: Flavor 1555715559 could not be found. Mar 26 20:49:07.426577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35bf1137-d3fc-4e6e-908a-ee9201be02de tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] Returning 400 to user: Flavor 1555715559 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:07.427393 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-35bf1137-d3fc-4e6e-908a-ee9201be02de tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.015269 Mar 26 20:49:07.428674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 23/55] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/servers => generated 81 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:07.437725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-be104366-a055-4446-8c13-71f1f3273e9c tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.457285 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-be104366-a055-4446-8c13-71f1f3273e9c tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1555715559" status: 202 len: 0 microversion: 2.1 time: 0.024251 Mar 26 20:49:07.458035 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 24/56] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:07 2022] DELETE /compute/v2.1/flavors/1555715559 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:49:07.467106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52eddf7b-575f-45c3-8376-c87cb31f7e38 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.487662 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52eddf7b-575f-45c3-8376-c87cb31f7e38 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025011 Mar 26 20:49:07.488204 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 25/57] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:07.505938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a60b460-3a4a-49c6-b3e6-29ffbfed6be6 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-750601926", "id": 1748890529, "os-flavor-access:is_public": "False"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:07.528960 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a60b460-3a4a-49c6-b3e6-29ffbfed6be6 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026588 Mar 26 20:49:07.529633 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 26/58] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:49:07.541282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2540b7d7-9508-4d05-9bdb-e0677a25c03e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1614491776", "id": 837581232, "os-flavor-access:is_public": "True"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:07.560846 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2540b7d7-9508-4d05-9bdb-e0677a25c03e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.024523 Mar 26 20:49:07.562083 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 27/59] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.575006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4fed8c9-7053-4464-8c63-41efdb75b0ce tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.598383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4fed8c9-7053-4464-8c63-41efdb75b0ce tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.027774 Mar 26 20:49:07.599454 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 28/60] 10.222.0.16 () {58 vars in 1168 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.613063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82d8767e-8b6d-4e09-827d-766d150c3bbc tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.626330 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82d8767e-8b6d-4e09-827d-766d150c3bbc tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.019019 Mar 26 20:49:07.633752 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 29/61] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.640238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cdbaa256-702c-4e3e-897e-6ae67fff4805 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.652710 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cdbaa256-702c-4e3e-897e-6ae67fff4805 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.016875 Mar 26 20:49:07.660535 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 30/62] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.667175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e5302a1b-78a0-4a72-be0c-f08bac1d27ca tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.678941 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e5302a1b-78a0-4a72-be0c-f08bac1d27ca tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.016258 Mar 26 20:49:07.688492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1168 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.707625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb2bf87c-37a7-4ea8-8d72-d582d6b2980a tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.730827 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb2bf87c-37a7-4ea8-8d72-d582d6b2980a tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.041154 Mar 26 20:49:07.731611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1168 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.746754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80b42453-3339-441b-a768-9ffc4d5e966e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.767226 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80b42453-3339-441b-a768-9ffc4d5e966e tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.024243 Mar 26 20:49:07.767816 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1174 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.782559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-026092d8-bff1-4301-8685-069a5aee88cd tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.785243 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-20211d59-5576-4a01-8ca5-2e2c012a8153 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.291494 Mar 26 20:49:07.785878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 33/66] 10.222.0.16 () {62 vars in 1231 bytes} [Sat Mar 26 20:49:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:07.798235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22d7dcfd-1924-42d1-864f-425f3e752041 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.800564 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:07.800564 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:07.803582 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-026092d8-bff1-4301-8685-069a5aee88cd tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.024688 Mar 26 20:49:07.804283 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.818864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-259a357d-eb38-48c6-a94d-cc726c8ebdc1 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.840318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-259a357d-eb38-48c6-a94d-cc726c8ebdc1 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.025517 Mar 26 20:49:07.840925 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 35/68] 10.222.0.16 () {58 vars in 1168 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.847876 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22d7dcfd-1924-42d1-864f-425f3e752041 tempest-AggregatesAdminTestV241-801287223 tempest-AggregatesAdminTestV241-801287223-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.054849 Mar 26 20:49:07.849616 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 34/69] 10.222.0.16 () {60 vars in 1192 bytes} [Sat Mar 26 20:49:07 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:07.857667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f0134aa1-8fbd-4b8a-8cba-354e92928133 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.878213 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f0134aa1-8fbd-4b8a-8cba-354e92928133 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/837581232" status: 202 len: 0 microversion: 2.1 time: 0.025156 Mar 26 20:49:07.879123 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:49:07 2022] DELETE /compute/v2.1/flavors/837581232 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:07.887599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45402c7e-49d1-4499-a128-a5020ce35119 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.913144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45402c7e-49d1-4499-a128-a5020ce35119 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028033 Mar 26 20:49:07.914092 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 35/71] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:07.930568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9f3cdfe-a661-4837-8d05-0c9cd58eaaf4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:07.930568 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:07.930568 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:07.949436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9f3cdfe-a661-4837-8d05-0c9cd58eaaf4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1748890529" status: 202 len: 0 microversion: 2.1 time: 0.025105 Mar 26 20:49:07.956617 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:07 2022] DELETE /compute/v2.1/flavors/1748890529 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:49:07.969252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa11357b-560d-4778-97a4-3973b5166217 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1612479973", "name": "tempest-test_aggregate-643898908"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:07.988468 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:07.988468 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:07.989642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-fa11357b-560d-4778-97a4-3973b5166217 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 039a7a9d-30a5-4121-bdd5-ac786d016821 for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:08.048323 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa11357b-560d-4778-97a4-3973b5166217 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.088751 Mar 26 20:49:08.049318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 37/73] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:08.055517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-365ae239-8252-41cc-91eb-7b3fb2c8a8b7 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.077542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-365ae239-8252-41cc-91eb-7b3fb2c8a8b7 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026556 Mar 26 20:49:08.092150 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:08.097665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43aab257-9d6f-4bb3-aa7c-49e5dd828027 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.098780 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:08.098780 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:08.112119 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43aab257-9d6f-4bb3-aa7c-49e5dd828027 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.018234 Mar 26 20:49:08.112713 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 39/75] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:08.125578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd21e51e-b748-4916-8d51-f3fca8da98dd tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1598124023", "id": 520000223, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:08.127619 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:08.127619 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:08.152343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd21e51e-b748-4916-8d51-f3fca8da98dd tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.030772 Mar 26 20:49:08.157952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 40/76] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:08 2022] POST /compute/v2.1/flavors => generated 412 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:08.158736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b18de238-6e10-46b0-b5ef-a877087826cd tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:08.159968 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:08.159968 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:08.168720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b18de238-6e10-46b0-b5ef-a877087826cd tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:08.169207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b18de238-6e10-46b0-b5ef-a877087826cd tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:08.362471 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b18de238-6e10-46b0-b5ef-a877087826cd tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.207614 Mar 26 20:49:08.364694 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 41/77] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:08 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:08.372565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e40dbaa-c2d1-4521-a064-3134cb98d4d2 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.398106 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e40dbaa-c2d1-4521-a064-3134cb98d4d2 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030829 Mar 26 20:49:08.399574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:08.413875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8517e0e-1382-4d88-9dc0-abbce2d3d3c9 tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.444058 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8517e0e-1382-4d88-9dc0-abbce2d3d3c9 tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034425 Mar 26 20:49:08.444974 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 43/79] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:08.460152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19d743e4-de55-4533-baae-6e237831aeeb tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.462421 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:08.462421 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:08.482650 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19d743e4-de55-4533-baae-6e237831aeeb tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/520000223" status: 202 len: 0 microversion: 2.1 time: 0.026117 Mar 26 20:49:08.484584 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 44/80] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:49:08 2022] DELETE /compute/v2.1/flavors/520000223 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:49:08.493274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-89a4162a-627b-429f-b11a-4367bec1552d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.513988 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-89a4162a-627b-429f-b11a-4367bec1552d tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025187 Mar 26 20:49:08.514820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 45/81] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:08.530728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-451498fd-17bb-4339-ba1f-dd92749b25ea tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-750203707", "id": 1301704301, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:08.532328 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:08.532328 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:08.558823 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-451498fd-17bb-4339-ba1f-dd92749b25ea tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.032468 Mar 26 20:49:08.559491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 46/82] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:08 2022] POST /compute/v2.1/flavors => generated 413 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:49:08.575683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d5359e94-e323-45af-8fe4-70c8c987c861 tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.596332 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d5359e94-e323-45af-8fe4-70c8c987c861 tempest-FlavorsAdminTestJSON-67942509 tempest-FlavorsAdminTestJSON-67942509-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.029910 Mar 26 20:49:08.597463 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 47/83] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:08.612290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-105fe9e6-1f58-4c1f-8cc3-f977583596a4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.630529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-105fe9e6-1f58-4c1f-8cc3-f977583596a4 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1301704301" status: 202 len: 0 microversion: 2.1 time: 0.022752 Mar 26 20:49:08.631221 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 48/84] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:08 2022] DELETE /compute/v2.1/flavors/1301704301 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:49:08.639266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abe1a2c5-870c-45ef-851b-cbdd3264a790 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:08.657820 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abe1a2c5-870c-45ef-851b-cbdd3264a790 tempest-FlavorsAdminTestJSON-56027884 tempest-FlavorsAdminTestJSON-56027884-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022321 Mar 26 20:49:08.658416 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 49/85] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:08.672891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-378521367", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:09.403903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-782474895", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "availability_zone": "tempest-test_az-1612479973"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:09.426070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:09.426704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:09.428684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:09.429268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:09.753184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:10.090771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:10.091203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:10.091779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:10.092245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:10.092665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:10.107941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:10.108489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:10.109432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:10.109935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:10.143782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Getting quotas for project c2133fff60db4fe9bb0aa9bbb266e602. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:10.150897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Getting quotas for user a63e6f035306422cab01a0b1a2f5d635 and project c2133fff60db4fe9bb0aa9bbb266e602. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:10.175453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:10.179237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:10.239162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eea4f798-399a-4b24-86f1-1c576af3d331 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324275 Mar 26 20:49:10.240497 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 37/86] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:49:10.251631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c874c68d-260e-4edd-b03c-ca0a96f31092 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:10.255636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c874c68d-260e-4edd-b03c-ca0a96f31092 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:10.346103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c874c68d-260e-4edd-b03c-ca0a96f31092 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:10.363328 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c874c68d-260e-4edd-b03c-ca0a96f31092 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1219 microversion: 2.1 time: 0.114510 Mar 26 20:49:10.363328 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 38/87] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:10 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:10.712479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:10.964853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:10.965615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:10.966067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:10.966324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:10.966743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:10.993147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:10.994174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:10.995264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:10.995708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:11.181408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Getting quotas for project 33d7dead9bee45f288900c157201b337. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:11.189190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Getting quotas for user d1e20172563a4c68bec7874b43416e12 and project 33d7dead9bee45f288900c157201b337. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:11.208565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:11.212661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:11.290830 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69deaf19-40ed-4e14-a4fa-5297a121ad9f tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.512253 Mar 26 20:49:11.294148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 50/88] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:49:11.303711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-674e4b8a-1646-4700-a2cd-b3bc0f5915cf tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:11.304362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-674e4b8a-1646-4700-a2cd-b3bc0f5915cf tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:11.385737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3186af8-59e2-4028-b2fc-d3cbf7ab2ba3 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:11.386355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3186af8-59e2-4028-b2fc-d3cbf7ab2ba3 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:11.403253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-674e4b8a-1646-4700-a2cd-b3bc0f5915cf tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:11.411450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-674e4b8a-1646-4700-a2cd-b3bc0f5915cf tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1242 microversion: 2.1 time: 0.113630 Mar 26 20:49:11.412102 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 39/89] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:11 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:11.590953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3186af8-59e2-4028-b2fc-d3cbf7ab2ba3 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:11.609930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3186af8-59e2-4028-b2fc-d3cbf7ab2ba3 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1219 microversion: 2.1 time: 0.234187 Mar 26 20:49:11.623837 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 51/90] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:11 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1219 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:12.429745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:12.431003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:12.441197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:12.442263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:12.447182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:12.448513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:12.611871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:12.626195 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-57e86b9e-071b-4637-ba07-ae5af038592d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1290 microversion: 2.1 time: 0.201089 Mar 26 20:49:12.627885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:12.628865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:12.636053 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 40/91] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:12 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1290 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:12.638147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:12.638868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:12.639985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:12.640529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:12.772663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:12.784327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-efd5a0e4-a6a0-42cb-94f7-7c53ac66f8cb tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1271 microversion: 2.1 time: 0.160212 Mar 26 20:49:12.787743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 52/92] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:12 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:13.438285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Calling method '.version_select at 0x7f6e59f54f70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:13.439538 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:13.439538 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:13.440863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.441329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.469674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.470649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.482604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.484258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.491890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-215e097d-0ba0-4119-8f8c-42d2fef1ae68 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.489390 Mar 26 20:49:13.498575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 41/93] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:49:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:13.503293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Calling method '.version_select at 0x7f6e59f3d8b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:13.503672 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:13.503672 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:13.512567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141581) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 26 20:49:13.516682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.517468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.550129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.552414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.569252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b89d3d31-7729-4031-9c11-3819fdc55699 tempest-HypervisorAdminV228Test-680637509 tempest-HypervisorAdminV228Test-680637509-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.069138 Mar 26 20:49:13.578990 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 53/94] 10.222.0.16 () {60 vars in 1192 bytes} [Sat Mar 26 20:49:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 20:49:13.646038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:13.647302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:13.656129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.656782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.657695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.658156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.761593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:13.773228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b953158c-375e-4b8e-bf6a-e27bff876784 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1296 microversion: 2.1 time: 0.132522 Mar 26 20:49:13.775948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 42/95] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:13 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:13.803333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:13.803898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:13.818944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.819406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.824803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:13.826200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:13.953932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:13.962125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-313a1525-f4e1-4f7e-a394-4b79912a65ef tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1277 microversion: 2.1 time: 0.164208 Mar 26 20:49:13.963016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 54/96] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:13 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:14.794573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:14.795884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:14.805733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:14.808275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:14.810263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:14.812462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:14.979751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:14.981062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:14.996511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:14.998562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:15.000583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:15.002421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:15.124550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:15.134487 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b73145d7-8238-4a09-b8b5-93d9463b838a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1277 microversion: 2.1 time: 0.159688 Mar 26 20:49:15.137492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 55/97] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:14 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:15.276981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:15.286493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b99a88f9-4b34-411d-967a-291c95565484 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.498421 Mar 26 20:49:15.299625 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 43/98] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:14 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:16.025271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Calling method '.version_select at 0x7f6e59f444c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:16.026089 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:16.026089 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:16.031480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.031621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.075959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Calling method '.version_select at 0x7f6e5a06d790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:16.078773 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:16.078773 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:16.081401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.082150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.082847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.083324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.088749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.090877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.130113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.131509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.157277 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae5fab29-ac6f-4d4c-bb57-241f91603ac2 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.854682 Mar 26 20:49:16.160379 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 44/99] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:16.178247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:16.178878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:16.213586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.219678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.221898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.224992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.262517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb63902a-415e-4203-8fb2-bc0ce61811ed tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 1.120860 Mar 26 20:49:16.265669 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 56/100] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:49:15 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:16.295433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Calling method '.version_select at 0x7f6e59ecb430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:16.301008 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:16.301008 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:16.308674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.311586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.434068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.436224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.495990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:16.508212 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a5f37d3-5a01-4a17-9a91-a2c59854554a tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.341403 Mar 26 20:49:16.524437 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 45/101] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:16 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:16.576758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.577367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.596076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a7e82e9-c684-42b4-b57a-a3e7bf2f0fd7 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.323382 Mar 26 20:49:16.598749 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 57/102] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Mar 26 20:49:16 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:16.606878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:16.611261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:16.634414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.636445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:16.638390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:16.642151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.329672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3fdce27-2e30-419d-a365-0f5694e9d087 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Calling method '.version_select at 0x7f6e59f6c430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:17.331038 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:17.331038 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:17.332269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3fdce27-2e30-419d-a365-0f5694e9d087 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:17.333150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3fdce27-2e30-419d-a365-0f5694e9d087 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:17.335564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3fdce27-2e30-419d-a365-0f5694e9d087 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.810014 Mar 26 20:49:17.343310 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 46/103] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:49:16 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 818 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:17.354767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Calling method '.version_select at 0x7f6e59f449d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:17.367339 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:17.367339 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:17.369284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.369945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.415564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.420032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.465106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.465962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.486851 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c012d73-8b0e-4790-9ce6-d18dfea10e1d tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.141685 Mar 26 20:49:17.496472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 47/104] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:17.612541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:17.614110 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-be5ce001-cd62-4bae-8c90-1b8e00c8cf1a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 1.013531 Mar 26 20:49:17.616637 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 58/105] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:16 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:17.635632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-025864f0-ddd3-4a82-abc9-d5d09cc02d7e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Calling method '.version_select at 0x7f6e59ec3820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:17.655475 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:17.655475 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:17.657175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-025864f0-ddd3-4a82-abc9-d5d09cc02d7e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:17.662514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-025864f0-ddd3-4a82-abc9-d5d09cc02d7e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:17.668815 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-025864f0-ddd3-4a82-abc9-d5d09cc02d7e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.041625 Mar 26 20:49:17.685647 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 59/106] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 20:49:17 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:17.702535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Calling method '.version_select at 0x7f6e59e155e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:17.708140 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:17.708140 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:17.710377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.712777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.754088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.758911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.777471 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3f1e823-f81b-499a-b530-827ca11824f3 tempest-HypervisorAdminUnderV252Test-1938232940 tempest-HypervisorAdminUnderV252Test-1938232940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.089747 Mar 26 20:49:17.786239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 60/107] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 20:49:17 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:17.801173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:17.802168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:17.820114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.820913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:17.825749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:17.826408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:18.083524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a92e08c5-ec57-444b-a290-c521ff3578c5 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Calling method '.version_select at 0x7f6e59f1bf70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.084605 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:18.084605 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:18.086406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a92e08c5-ec57-444b-a290-c521ff3578c5 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '65fb1ca790104ee38cad504f86b54b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca6e8c53c4337b83f51f112c043d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:18.087333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a92e08c5-ec57-444b-a290-c521ff3578c5 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.109818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a92e08c5-ec57-444b-a290-c521ff3578c5 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.590806 Mar 26 20:49:18.116228 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 48/108] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:49:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 619 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:18.144140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a223dd99-d21f-4336-a179-78c9e7b12c2f tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Calling method '.version_select at 0x7f6e59f6c310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.153123 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:18.153123 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:18.228193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a223dd99-d21f-4336-a179-78c9e7b12c2f tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 26 20:49:18.233253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a223dd99-d21f-4336-a179-78c9e7b12c2f tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.244528 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a223dd99-d21f-4336-a179-78c9e7b12c2f tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.125394 Mar 26 20:49:18.245964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 49/109] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:49:18.269078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1bcb4148-9ece-4698-a8a9-9ff068e7c843 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Calling method '.version_select at 0x7f6e59f1ba60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.271523 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:18.271523 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:18.276543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1bcb4148-9ece-4698-a8a9-9ff068e7c843 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '65fb1ca790104ee38cad504f86b54b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca6e8c53c4337b83f51f112c043d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:18.277472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1bcb4148-9ece-4698-a8a9-9ff068e7c843 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.278464 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1bcb4148-9ece-4698-a8a9-9ff068e7c843 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027650 Mar 26 20:49:18.289400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 50/110] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:18.304130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-05b7d4ab-a18b-49fc-a503-a7c68ff8ea1e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Calling method '.version_select at 0x7f6e59f44430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.306392 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:18.306392 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:18.309521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-05b7d4ab-a18b-49fc-a503-a7c68ff8ea1e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:18.312140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-05b7d4ab-a18b-49fc-a503-a7c68ff8ea1e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.314989 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-05b7d4ab-a18b-49fc-a503-a7c68ff8ea1e tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023811 Mar 26 20:49:18.317752 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:18.342069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0204a6d4-585d-410c-bce5-c067c8bbc450 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Calling method '.version_select at 0x7f6e59f54af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.349019 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:18.349019 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:18.351584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0204a6d4-585d-410c-bce5-c067c8bbc450 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '65fb1ca790104ee38cad504f86b54b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca6e8c53c4337b83f51f112c043d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:18.352651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0204a6d4-585d-410c-bce5-c067c8bbc450 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.353654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0204a6d4-585d-410c-bce5-c067c8bbc450 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.031839 Mar 26 20:49:18.361464 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 52/112] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:18.373376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb74c980-cd2a-4f4f-99b4-acf0c21a835e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Calling method '.version_select at 0x7f6e59f44dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:18.389656 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fb74c980-cd2a-4f4f-99b4-acf0c21a835e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 26 20:49:18.395553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb74c980-cd2a-4f4f-99b4-acf0c21a835e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:18.396796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb74c980-cd2a-4f4f-99b4-acf0c21a835e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033671 Mar 26 20:49:18.408770 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 53/113] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:49:19.060917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Calling method '.version_select at 0x7f6e59f6c0d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:19.062992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.063543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.126743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.127315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.192009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.192717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.221474 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f867c1a8-7971-4f78-a188-b327f4e8cab0 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.811103 Mar 26 20:49:19.232239 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 54/114] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:19.238276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ede9d0e0-451d-46e9-be27-ebfc08300ed6 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Calling method '.version_select at 0x7f6e59f6c670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:19.239654 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:19.239654 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:19.241215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ede9d0e0-451d-46e9-be27-ebfc08300ed6 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:19.242039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ede9d0e0-451d-46e9-be27-ebfc08300ed6 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:19.243023 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ede9d0e0-451d-46e9-be27-ebfc08300ed6 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009534 Mar 26 20:49:19.252139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 55/115] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Mar 26 20:49:19 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:19.257541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:19.258381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:19.265979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.268493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.269488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.270564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.441959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:19.460359 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9cce9cb8-2a5a-401a-a429-1556edd0996c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 1.671548 Mar 26 20:49:19.460960 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 61/116] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:17 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:19.887760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:19.889677 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:19.889677 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:19.892329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.894891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:19.899994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:19.902834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.001555 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a04c17b2-7c37-4907-a276-93c1086a598e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.534694 Mar 26 20:49:20.004902 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 62/117] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:49:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:20.160674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-aa139a96-c218-4969-8d91-60fe9ad3c79e req-a61dc0a9-2778-4ac4-94ed-8d7b69990cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181859d8-0ddb-4c1f-9071-f4ededc7db7d", "tag": "13fd6291-82e1-4682-be21-fc0e69cbb0c3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:20.175543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aa139a96-c218-4969-8d91-60fe9ad3c79e req-a61dc0a9-2778-4ac4-94ed-8d7b69990cb5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.176318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aa139a96-c218-4969-8d91-60fe9ad3c79e req-a61dc0a9-2778-4ac4-94ed-8d7b69990cb5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.211783 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-aa139a96-c218-4969-8d91-60fe9ad3c79e req-a61dc0a9-2778-4ac4-94ed-8d7b69990cb5 service nova] Creating event network-changed:13fd6291-82e1-4682-be21-fc0e69cbb0c3 for instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d on nch1-master-1 Mar 26 20:49:20.216093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aa139a96-c218-4969-8d91-60fe9ad3c79e req-a61dc0a9-2778-4ac4-94ed-8d7b69990cb5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:49:20.216093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.216093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.216093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.216093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.224584 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.rpcapi [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 26 20:49:20.225528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] Releasing lock "compute-rpcapi-router" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:49:20.251709 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bdb8cefe-5b05-4aa6-8e26-c9f0dff5af7d None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245031 Mar 26 20:49:20.252744 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 63/118] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:20.259187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-98692914-fc3d-40b8-8845-d010164acb29 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Calling method '.version_select at 0x7f6e59e15b80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.260080 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.260080 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:20.261300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-98692914-fc3d-40b8-8845-d010164acb29 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '65fb1ca790104ee38cad504f86b54b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca6e8c53c4337b83f51f112c043d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:20.262084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-98692914-fc3d-40b8-8845-d010164acb29 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:20.263041 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-98692914-fc3d-40b8-8845-d010164acb29 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008964 Mar 26 20:49:20.268392 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 64/119] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:20.274083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf136919-0178-4a95-8eda-19bf3e324177 tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Calling method '.version_select at 0x7f6e59f3de50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.275312 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.275312 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:20.289885 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-bf136919-0178-4a95-8eda-19bf3e324177 tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 26 20:49:20.290890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf136919-0178-4a95-8eda-19bf3e324177 tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:20.292519 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bf136919-0178-4a95-8eda-19bf3e324177 tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023025 Mar 26 20:49:20.293947 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:49:20.338055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:20.366431 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00d08d08-011f-4e83-b117-52aff587ab07 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 1.107630 Mar 26 20:49:20.381870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 56/121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:19 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:20.457497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6ad7bb38-0c23-49d5-96cd-d7ab763ca226 req-85d0e064-ee7b-4eb9-bc22-3129f1b5d66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07bf7261-e75c-434d-a249-8aef91e0e3b4", "tag": "4a5a098d-6548-4f26-bb99-b79026bf7a83"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:20.518846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ad7bb38-0c23-49d5-96cd-d7ab763ca226 req-85d0e064-ee7b-4eb9-bc22-3129f1b5d66b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.519318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ad7bb38-0c23-49d5-96cd-d7ab763ca226 req-85d0e064-ee7b-4eb9-bc22-3129f1b5d66b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.531531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c598a6e1-7a8a-41b5-be0d-58669f440fff tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1734637206", "ram": 512, "vcpus": 1, "disk": 10, "id": 1455872208, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:20.534516 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.534516 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:20.557957 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6ad7bb38-0c23-49d5-96cd-d7ab763ca226 req-85d0e064-ee7b-4eb9-bc22-3129f1b5d66b service nova] Creating event network-changed:4a5a098d-6548-4f26-bb99-b79026bf7a83 for instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 on nch2-master-1 Mar 26 20:49:20.580068 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c598a6e1-7a8a-41b5-be0d-58669f440fff tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.189196 Mar 26 20:49:20.583763 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6ad7bb38-0c23-49d5-96cd-d7ab763ca226 req-85d0e064-ee7b-4eb9-bc22-3129f1b5d66b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288096 Mar 26 20:49:20.584049 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 57/122] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:20 2022] POST /compute/v2.1/flavors => generated 416 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:20.587996 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 66/123] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:20.601190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9102f2d-7e1d-4087-bb6e-14f51896eea6 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Calling method '.version_select at 0x7f6e59f6c160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.603175 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.603175 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:20.604259 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e9102f2d-7e1d-4087-bb6e-14f51896eea6 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] HTTP exception thrown: Hypervisor with ID 'bdc03e27-6c38-4f52-957d-8bf199c505c4' could not be found. Mar 26 20:49:20.606030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-95865cf9-b4f2-45c2-aec6-46d169bcc602 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Calling method '.version_select at 0x7f6e59ec3d30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.607003 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.607003 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:20.610916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9102f2d-7e1d-4087-bb6e-14f51896eea6 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Returning 404 to user: Hypervisor with ID 'bdc03e27-6c38-4f52-957d-8bf199c505c4' could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:20.613275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-95865cf9-b4f2-45c2-aec6-46d169bcc602 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:20.613991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-95865cf9-b4f2-45c2-aec6-46d169bcc602 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:20.615383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e9102f2d-7e1d-4087-bb6e-14f51896eea6 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/bdc03e27-6c38-4f52-957d-8bf199c505c4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.026747 Mar 26 20:49:20.620198 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 58/124] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hypervisors/bdc03e27-6c38-4f52-957d-8bf199c505c4/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:20.630224 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-95865cf9-b4f2-45c2-aec6-46d169bcc602 tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.025118 Mar 26 20:49:20.633153 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 67/125] 10.222.0.16 () {58 vars in 1193 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:20.644430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.650297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:20.667770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.668256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.690943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.695429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.912065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b1d2542-a955-4ddb-93e0-f14e48985a30 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.923364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7b1d2542-a955-4ddb-93e0-f14e48985a30 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] HTTP exception thrown: Flavor 1455872208 has no extra specs with key hw:cpu_thread_policy. Mar 26 20:49:20.924359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b1d2542-a955-4ddb-93e0-f14e48985a30 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Returning 404 to user: Flavor 1455872208 has no extra specs with key hw:cpu_thread_policy. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:20.925430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b1d2542-a955-4ddb-93e0-f14e48985a30 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] 10.222.0.16 "GET /compute/v2.1/flavors/1455872208/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.291053 Mar 26 20:49:20.926267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 68/126] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/flavors/1455872208/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:20.933373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Calling method '.version_select at 0x7f6e59ff8f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:20.935366 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:20.935366 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:20.936865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.937497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.962531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.963292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.981913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:20.982671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:20.991583 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d29966f-12c6-4710-8802-b41f85a7144c tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064040 Mar 26 20:49:20.997831 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 69/127] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:21.004016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cdd3d09-f072-401d-abb0-8a748af6a52b tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Calling method '.version_select at 0x7f6e59ec3670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.005876 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.005876 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.016689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9cdd3d09-f072-401d-abb0-8a748af6a52b tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 26 20:49:21.017870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cdd3d09-f072-401d-abb0-8a748af6a52b tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.019696 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9cdd3d09-f072-401d-abb0-8a748af6a52b tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019973 Mar 26 20:49:21.021836 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 70/128] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:49:21.027125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f7b8921-a4c4-4ebe-8d92-f3023ae0a558 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.028900 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.028900 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.029974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0f7b8921-a4c4-4ebe-8d92-f3023ae0a558 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '44b3ec8f2f3f4ac0a4c72a54adc76064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.030839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f7b8921-a4c4-4ebe-8d92-f3023ae0a558 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.032213 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f7b8921-a4c4-4ebe-8d92-f3023ae0a558 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] 10.222.0.16 "POST /compute/v2.1/flavors/1455872208/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.008991 Mar 26 20:49:21.044419 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 71/129] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:21 2022] POST /compute/v2.1/flavors/1455872208/os-extra_specs => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.070156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7492365-a5a7-4048-84c9-d934eda36523 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Calling method '.version_select at 0x7f6e59f3dee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.074632 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.074632 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.079322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7492365-a5a7-4048-84c9-d934eda36523 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '65fb1ca790104ee38cad504f86b54b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ca6e8c53c4337b83f51f112c043d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.082051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7492365-a5a7-4048-84c9-d934eda36523 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.085305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7492365-a5a7-4048-84c9-d934eda36523 tempest-HypervisorAdminNegativeTestJSON-2131469594 tempest-HypervisorAdminNegativeTestJSON-2131469594-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.038815 Mar 26 20:49:21.092375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 72/130] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.099561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36671d7f-61d6-4dbe-83b8-9e819632b98e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5a06df70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.104173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36671d7f-61d6-4dbe-83b8-9e819632b98e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.106524 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36671d7f-61d6-4dbe-83b8-9e819632b98e tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.012938 Mar 26 20:49:21.116328 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 73/131] 10.222.0.16 () {60 vars in 1189 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:49:21.132500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1b8647c-600a-4ae1-a90d-8b3f839414ab tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.217297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.218991 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1b8647c-600a-4ae1-a90d-8b3f839414ab tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1455872208/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097384 Mar 26 20:49:21.227155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 74/132] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:21 2022] POST /compute/v2.1/flavors/1455872208/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:21.230134 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-65b19bbf-8ff8-4afe-a917-f0a9d84e7b27 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.611257 Mar 26 20:49:21.240697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 59/133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:20 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:21.241309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4edc0a3c-44a3-4e81-a2b4-16a18139521d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59f87b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.244431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4edc0a3c-44a3-4e81-a2b4-16a18139521d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.246943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4edc0a3c-44a3-4e81-a2b4-16a18139521d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.013582 Mar 26 20:49:21.254001 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 60/134] 10.222.0.16 () {60 vars in 1189 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:49:21.254327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db8e5486-0f74-443a-ba19-114e17c020e4 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Calling method '.version_select at 0x7f6e59ec3940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.258989 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-db8e5486-0f74-443a-ba19-114e17c020e4 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] HTTP exception thrown: Hypervisor with ID 'af3c188d-3eca-4a97-a68c-3b91a6ea7d50' could not be found. Mar 26 20:49:21.259740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db8e5486-0f74-443a-ba19-114e17c020e4 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] Returning 404 to user: Hypervisor with ID 'af3c188d-3eca-4a97-a68c-3b91a6ea7d50' could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.261531 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db8e5486-0f74-443a-ba19-114e17c020e4 tempest-HypervisorAdminNegativeTestJSON-1711709876 tempest-HypervisorAdminNegativeTestJSON-1711709876-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/af3c188d-3eca-4a97-a68c-3b91a6ea7d50" status: 404 len: 123 microversion: 2.1 time: 0.032349 Mar 26 20:49:21.262005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98162a40-14fc-4e31-88cb-21c930eecaab tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.263164 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.263164 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:21.268086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98162a40-14fc-4e31-88cb-21c930eecaab tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '44b3ec8f2f3f4ac0a4c72a54adc76064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.269173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98162a40-14fc-4e31-88cb-21c930eecaab tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.271424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98162a40-14fc-4e31-88cb-21c930eecaab tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015250 Mar 26 20:49:21.273697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 61/135] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:49:21 2022] DELETE /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.284585 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 75/136] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 20:49:21 2022] GET /compute/v2.1/os-hypervisors/af3c188d-3eca-4a97-a68c-3b91a6ea7d50 => generated 123 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.295136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-45702c8e-6b08-4fda-813a-67e0865e20cb tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Action: 'update', calling method: .version_select at 0x7f6e5b9a9af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.296917 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.296917 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:21.298256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-45702c8e-6b08-4fda-813a-67e0865e20cb tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b3dca0dea5324c049251a4728b090e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82ec89b09b84613a8e28fecf28e9f47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.299251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-45702c8e-6b08-4fda-813a-67e0865e20cb tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.301001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1d1d75a-4c1b-40d6-9ec1-3692021e82b4 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.302341 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-45702c8e-6b08-4fda-813a-67e0865e20cb tempest-HostsAdminNegativeTestJSON-1060147056 tempest-HostsAdminNegativeTestJSON-1060147056-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.027234 Mar 26 20:49:21.303384 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 62/137] 10.222.0.16 () {60 vars in 1189 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.315779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b9f839a-8df0-40da-8158-d5fe0191ffff tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59f6c790>, body: {"status": null, "maintenance_mode": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.317193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b9f839a-8df0-40da-8158-d5fe0191ffff tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.319723 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7b9f839a-8df0-40da-8158-d5fe0191ffff tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.007775 Mar 26 20:49:21.323785 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 63/138] 10.222.0.16 () {60 vars in 1189 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 20:49:21.336836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36628b55-5d8c-4492-a95c-dd57fba4ec4d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59ed50d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.341578 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.hosts [None req-36628b55-5d8c-4492-a95c-dd57fba4ec4d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Enabling host nonexistent_hostname. Mar 26 20:49:21.360691 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-36628b55-5d8c-4492-a95c-dd57fba4ec4d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 26 20:49:21.364200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36628b55-5d8c-4492-a95c-dd57fba4ec4d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.366162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36628b55-5d8c-4492-a95c-dd57fba4ec4d tempest-HostsAdminNegativeTestJSON-402529922 tempest-HostsAdminNegativeTestJSON-402529922-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039842 Mar 26 20:49:21.375256 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 64/139] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:49:21.398588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.402415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:21.402746 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1d1d75a-4c1b-40d6-9ec1-3692021e82b4 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1455872208/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.116979 Mar 26 20:49:21.413162 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 76/140] 10.222.0.16 () {60 vars in 1223 bytes} [Sat Mar 26 20:49:21 2022] POST /compute/v2.1/flavors/1455872208/os-extra_specs => generated 66 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:49:21.419854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:21.420497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:21.421615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:21.425138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:21.433732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbe95fa1-4d4c-4e85-8274-bf6944d9e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.435002 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.435002 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.435863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fbe95fa1-4d4c-4e85-8274-bf6944d9e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '44b3ec8f2f3f4ac0a4c72a54adc76064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.436528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbe95fa1-4d4c-4e85-8274-bf6944d9e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.437343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbe95fa1-4d4c-4e85-8274-bf6944d9e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201 tempest-FlavorsExtraSpecsNegativeTestJSON-1529612201-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022479 Mar 26 20:49:21.459910 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 77/141] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.473750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6743035-663b-4305-a262-dc9aef04a9ad tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.479866 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.479866 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.499628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b6743035-663b-4305-a262-dc9aef04a9ad tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] HTTP exception thrown: Flavor 1455872208 has no extra specs with key hw:cpu_thread_policy. Mar 26 20:49:21.500293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6743035-663b-4305-a262-dc9aef04a9ad tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Returning 404 to user: Flavor 1455872208 has no extra specs with key hw:cpu_thread_policy. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.512055 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b6743035-663b-4305-a262-dc9aef04a9ad tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1455872208/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.044923 Mar 26 20:49:21.519090 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 78/142] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:49:21 2022] DELETE /compute/v2.1/flavors/1455872208/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:21.536194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb27a488-5c23-4cf1-af00-7ab50410a43a tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.546525 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cb27a488-5c23-4cf1-af00-7ab50410a43a tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] HTTP exception thrown: Request body and URI mismatch Mar 26 20:49:21.553701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb27a488-5c23-4cf1-af00-7ab50410a43a tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.554587 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb27a488-5c23-4cf1-af00-7ab50410a43a tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.034372 Mar 26 20:49:21.557566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 79/143] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:21.583148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5afc022c-2ebf-4884-8cec-39d251bc891f tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:21.588959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5afc022c-2ebf-4884-8cec-39d251bc891f tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:21.599655 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5afc022c-2ebf-4884-8cec-39d251bc891f tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026761 Mar 26 20:49:21.612581 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 80/144] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Mar 26 20:49:21 2022] PUT /compute/v2.1/flavors/1455872208/os-extra_specs/hw:numa_nodes => generated 117 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:49:21.629864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2a39370-b96d-4890-9c29-09c26cfd7bd9 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.630688 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:21.630688 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:21.673753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2a39370-b96d-4890-9c29-09c26cfd7bd9 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1455872208" status: 202 len: 0 microversion: 2.1 time: 0.058639 Mar 26 20:49:21.678681 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 81/145] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:49:21 2022] DELETE /compute/v2.1/flavors/1455872208 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:21.683781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eeb2684a-d65f-4f4b-a190-d77feefd0cdf tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:21.712346 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eeb2684a-d65f-4f4b-a190-d77feefd0cdf tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910 tempest-FlavorsExtraSpecsNegativeTestJSON-2085841910-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032030 Mar 26 20:49:21.723592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 82/146] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:49:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:21.820212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:21.832335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e08e3a6-a281-4bf7-a6e2-a6a43d375a57 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.437870 Mar 26 20:49:21.840164 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 65/147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:21 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:22.252497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:22.252909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:22.267531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:22.270519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:22.271414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:22.274989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:22.544431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:22.557532 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-02f7c529-1c68-4671-84ba-6ba779291f3f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.311005 Mar 26 20:49:22.559295 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 83/148] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:22 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:22.852955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:22.854676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:22.870561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:22.875631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:22.877073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:22.879365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:23.575681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:23.576791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:23.597239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:23.597703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:23.601627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:23.604565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:23.798474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:23.810148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-74bce29a-f956-4fa3-92b4-f587508a9186 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.963813 Mar 26 20:49:23.810742 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 66/149] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:22 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:24.126465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:24.135604 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-359a3183-7f94-45cd-99e4-154e0f1dcb5f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.564735 Mar 26 20:49:24.146540 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 84/150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:23 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:24.829733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:24.830375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:24.844931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:24.849058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:24.850139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:24.853740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:25.152965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:25.154251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:25.163884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:25.175795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:25.179585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:25.180481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:25.317606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:25.336204 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de20b4cd-edfd-46bc-b209-3c684111d88a tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.507528 Mar 26 20:49:25.337456 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 67/151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:24 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:25.512778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:25.526572 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0d2348a-c63d-414a-bdec-c8330334e587 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.377247 Mar 26 20:49:25.527165 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 85/152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:25 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:26.355359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:26.357354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:26.368577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.370557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.376083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.377557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.661827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Calling method '.version_select at 0x7f6e5b9a9af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:26.664043 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:26.664043 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:26.665476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.666489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.701530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.707502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.710274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:26.726903 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ceb5bb0-aac0-4d1d-ad73-0075878d403e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.375707 Mar 26 20:49:26.731194 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 86/153] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:26 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:26.750873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:26.753252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:26.776746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.779720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.781078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.781909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.782403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.783784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.806790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.808951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.862122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.862840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.874083 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-368d65a1-678e-42a4-921a-763105857724 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.931363 Mar 26 20:49:26.876062 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 68/154] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 20:49:25 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:26.902514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Calling method '.version_select at 0x7f6e59ed5ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:26.904017 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:26.904017 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:26.920649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.923729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:26.959128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:26.960254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.053715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.054625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.090437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.091269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.146534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.148881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.168565 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52a09568-69ab-4bc3-a753-5bc0d5f2a3e3 tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.282912 Mar 26 20:49:27.170134 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 69/155] 10.222.0.16 () {60 vars in 1221 bytes} [Sat Mar 26 20:49:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:27.184275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Calling method '.version_select at 0x7f6e59f1b3a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:27.186220 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:27.186220 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:27.190211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.190924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.242623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.248938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:27.258850 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8ed503a8-fa1d-4756-af1a-f6336a5082cc tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.525656 Mar 26 20:49:27.259800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.268281 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 87/156] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:26 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:27.276007 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eebc1b80-cfd5-4498-9448-0797d26b590e tempest-HypervisorAdminV253TestBase-2060980462 tempest-HypervisorAdminV253TestBase-2060980462-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/5ad9919e-eeac-4b43-b599-249e3035ae98" status: 200 len: 792 microversion: 2.53 time: 0.098770 Mar 26 20:49:27.278558 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 70/157] 10.222.0.16 () {60 vars in 1297 bytes} [Sat Mar 26 20:49:27 2022] GET /compute/v2.1/os-hypervisors/5ad9919e-eeac-4b43-b599-249e3035ae98 => generated 792 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 20:49:27.749421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:27.751004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:27.770289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.771178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:27.772171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:27.772899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:28.029958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:28.041907 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebf189f8-7ca6-4420-a440-95749daf73b6 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.297384 Mar 26 20:49:28.054748 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 88/158] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:27 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:28.294809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:28.297844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:28.307334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:28.308149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:28.309495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:28.310153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:28.503815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:28.511572 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ebfa136-99de-4346-b7dd-4d618fbfd0d8 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.227404 Mar 26 20:49:28.512635 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 71/159] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:28 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:29.060870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:29.064621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:29.071458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:29.072029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:29.072907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:29.073430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:29.216238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:29.224370 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-205bbacd-dc68-4e7e-8065-de422d01918d tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.167807 Mar 26 20:49:29.224942 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 89/160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:29 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:29.533264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:29.533940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:29.541530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:29.542300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:29.543372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:29.543879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:29.730313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:29.737806 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6188290c-2fb6-4cc1-ba72-5341bec5d970 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.210307 Mar 26 20:49:29.738768 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 90/161] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:29 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:29.812838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Action: 'create', calling method: .version_select at 0x7f6e5ba55b80>, body: {"keypair": {"name": "tempest-keypair-1698405298", "type": "ssh", "user_id": "d38ad252e8e3431ba77808785cc44224"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:29.834583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:29.838383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:30.126400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:30.130937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:30.147058 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cab72aff-2404-40ea-9427-324a02a41e78 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.719017 Mar 26 20:49:30.152406 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 72/162] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Mar 26 20:49:29 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 721 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:30.158076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Action: 'create', calling method: .version_select at 0x7f6e59e26820>, body: {"keypair": {"name": "tempest-keypair-226595177", "type": "ssh", "user_id": "d38ad252e8e3431ba77808785cc44224"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:30.177723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:30.182488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:30.241015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:30.241815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:30.248312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:30.248991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:30.250226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:30.250868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:30.380824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:30.385234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:30.405901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e59306e2-69dd-4c85-a803-18351bc269bf tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.252164 Mar 26 20:49:30.411263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 91/163] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Mar 26 20:49:30 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:30.416257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec4cbd36-357f-4cd6-9043-d45f152feab6 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Calling method '.version_select at 0x7f6e59e26af0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:30.432515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:30.439785 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84e65dec-d07a-4a2f-b7ba-c85de1264066 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.203190 Mar 26 20:49:30.440396 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 73/164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:30 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:30.449700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec4cbd36-357f-4cd6-9043-d45f152feab6 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1698405298?user_id=d38ad252e8e3431ba77808785cc44224" status: 200 len: 706 microversion: 2.10 time: 0.028954 Mar 26 20:49:30.449700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 92/165] 10.222.0.16 () {60 vars in 1339 bytes} [Sat Mar 26 20:49:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1698405298?user_id=d38ad252e8e3431ba77808785cc44224 => generated 706 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:30.452331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Action: 'create', calling method: .version_select at 0x7f6e59e26040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1176461607", "type": "ssh"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:30.474435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:30.478202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:30.779591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8259012-69aa-4e37-8c26-642d3430e197 tempest-InstanceUsageAuditLogTestJSON-1035916360 tempest-InstanceUsageAuditLogTestJSON-1035916360-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:30.780403 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:30.780403 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:30.800074 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8259012-69aa-4e37-8c26-642d3430e197 tempest-InstanceUsageAuditLogTestJSON-1035916360 tempest-InstanceUsageAuditLogTestJSON-1035916360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-26 20:49:30" status: 200 len: 318 microversion: 2.1 time: 0.356214 Mar 26 20:49:30.800821 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 74/166] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 20:49:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-26%2020%3A49%3A30 => generated 318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:30.860108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-133abc85-bda9-4ac4-94bf-b66f6cccae0d tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] Calling method '.version_select at 0x7f6e5ba559d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:30.861281 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:30.861281 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:30.875609 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-133abc85-bda9-4ac4-94bf-b66f6cccae0d tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.072984 Mar 26 20:49:30.876361 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 75/167] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:49:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:30.886631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:30.887516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:30.893645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:30.894097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:30.895052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:30.895675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:31.029228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:31.036888 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9e9c7257-ab5f-4c55-8302-70993d62fab4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.154167 Mar 26 20:49:31.037663 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 76/168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:30 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:31.060180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:31.064246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Getting quotas for user db5dd4b53b23432f8c8e1af6036be398 and project a4aa7937ec134dc0b36bb547b61843f7. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:31.083987 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3da3f254-3c7b-4447-bcfd-4375d2c17086 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2341 microversion: 2.10 time: 0.629093 Mar 26 20:49:31.084633 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 93/169] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 20:49:30 2022] POST /compute/v2.1/os-keypairs => generated 2341 bytes in 637 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:31.089184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-872910ab-4243-49da-a8b2-5cf346cf06bd tempest-InstanceUsageAuditLogTestJSON-1035916360 tempest-InstanceUsageAuditLogTestJSON-1035916360-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.089953 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:31.089953 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:31.108773 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-872910ab-4243-49da-a8b2-5cf346cf06bd tempest-InstanceUsageAuditLogTestJSON-1035916360 tempest-InstanceUsageAuditLogTestJSON-1035916360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023102 Mar 26 20:49:31.116109 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 94/170] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:49:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:31.116109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb987a6c-f906-4e6a-9d6a-31b301ef0cd5 tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59dee160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:31.117924 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:31.117924 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:31.228742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-542752186", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:31.297276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:31.440225 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb987a6c-f906-4e6a-9d6a-31b301ef0cd5 tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.329353 Mar 26 20:49:31.440863 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 95/171] 10.222.0.16 () {60 vars in 1205 bytes} [Sat Mar 26 20:49:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:31.445508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1bc5aa02-bacb-4259-a0eb-8c3a4aba7aa0 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Calling method '.version_select at 0x7f6e59dad9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.448106 ncdv-master-1 devstack@n-api.service[141581]: WARNING oslo_db.sqlalchemy.utils [None req-1bc5aa02-bacb-4259-a0eb-8c3a4aba7aa0 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:49:31.457471 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1bc5aa02-bacb-4259-a0eb-8c3a4aba7aa0 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=d38ad252e8e3431ba77808785cc44224" status: 200 len: 1113 microversion: 2.10 time: 0.015577 Mar 26 20:49:31.458872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 96/172] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Mar 26 20:49:31 2022] GET /compute/v2.1/os-keypairs?user_id=d38ad252e8e3431ba77808785cc44224 => generated 1113 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:31.463421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35d00a83-3101-4c62-a09a-61bfba97fb9f tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] Calling method '.version_select at 0x7f6e59e15ee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.464430 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:31.464430 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:31.477725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35d00a83-3101-4c62-a09a-61bfba97fb9f tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017706 Mar 26 20:49:31.483765 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 97/173] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:49:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:31.488518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.489329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:31.501677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:31.502039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:31.504156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:31.504657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:31.631252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:31.631752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:31.632332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:31.632813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:31.633442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:31.646730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:31.647694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:31.648737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:31.649255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:31.668923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:31.673817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for user 4ef943b3272c48aa884a7ff4a7e854d0 and project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:31.689190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:31.694036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:31.711230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:31.723483 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07f9180e-9d26-4db2-80b8-64bf63d4fcf7 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.243648 Mar 26 20:49:31.724316 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 98/174] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:31 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:31.730367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94c488d5-ac7a-4aaa-afd8-c4d9f919f5b4 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Calling method '.version_select at 0x7f6e59dc40d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.749264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6dfe867-edf0-4599-9bcc-c28c13965476 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710309 Mar 26 20:49:31.756555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 77/175] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:49:31.764337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cd37215f-a899-45dc-a2b9-4fe1d7dfe288 tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59e82550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:31.766795 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:31.766795 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:31.767195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94c488d5-ac7a-4aaa-afd8-c4d9f919f5b4 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1176461607" status: 204 len: 0 microversion: 2.10 time: 0.041447 Mar 26 20:49:31.768276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 99/176] 10.222.0.16 () {60 vars in 1324 bytes} [Sat Mar 26 20:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1176461607 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:31.784188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c43024d-cc94-45ed-ab32-bf3a2e22cfe3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.785348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6c43024d-cc94-45ed-ab32-bf3a2e22cfe3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:31.906187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6c43024d-cc94-45ed-ab32-bf3a2e22cfe3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:31.916085 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6c43024d-cc94-45ed-ab32-bf3a2e22cfe3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1212 microversion: 2.1 time: 0.145920 Mar 26 20:49:31.917994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 100/177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:31 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:31.921165 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cd37215f-a899-45dc-a2b9-4fe1d7dfe288 tempest-QuotaClassesAdminTestJSON-2105883102 tempest-QuotaClassesAdminTestJSON-2105883102-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.162353 Mar 26 20:49:31.925185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d551199-8682-4819-bd00-3ae12cca1b34 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Calling method '.version_select at 0x7f6e59db55e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:31.929368 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 78/178] 10.222.0.16 () {60 vars in 1205 bytes} [Sat Mar 26 20:49:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:31.968062 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d551199-8682-4819-bd00-3ae12cca1b34 tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226595177?user_id=d38ad252e8e3431ba77808785cc44224" status: 204 len: 0 microversion: 2.10 time: 0.048171 Mar 26 20:49:31.968973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 101/179] 10.222.0.16 () {60 vars in 1339 bytes} [Sat Mar 26 20:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226595177?user_id=d38ad252e8e3431ba77808785cc44224 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:31.980298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0df6ef32-b53c-4604-86da-554fae4c1b5b tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] Calling method '.version_select at 0x7f6e59eed940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:32.012359 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0df6ef32-b53c-4604-86da-554fae4c1b5b tempest-KeyPairsV210TestJSON-189456028 tempest-KeyPairsV210TestJSON-189456028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698405298?user_id=d38ad252e8e3431ba77808785cc44224" status: 204 len: 0 microversion: 2.10 time: 0.038232 Mar 26 20:49:32.013510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 79/180] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 20:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698405298?user_id=d38ad252e8e3431ba77808785cc44224 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:49:32.056246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:32.056967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:32.063975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.065007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:32.066421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.067870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:32.305155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:32.314102 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5ca5475f-7a53-4a90-b017-4a34901758bf tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.263415 Mar 26 20:49:32.321131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 102/181] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:32 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:32.744299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:32.745341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:32.753331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.754117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:32.755666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.756373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:32.935670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:32.936426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:32.944100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.951309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:32.952192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:32.953694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:33.035980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:33.045987 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-deb3c2e1-79fa-47ed-be08-f22a02746e45 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.308199 Mar 26 20:49:33.047455 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 80/182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:32 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:33.333082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:33.333717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:33.344915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:33.345497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:33.349669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:33.350599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:33.435899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:33.443769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-02567002-487f-4a47-804e-6c3b4bc29d4f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1264 microversion: 2.1 time: 0.513268 Mar 26 20:49:33.448549 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 103/183] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:32 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1264 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:33.778471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:33.813890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c57a6e81-dd2e-43ef-a55c-6f41ff0390a4 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.484401 Mar 26 20:49:33.820175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 81/184] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:33 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:34.064125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:34.064740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:34.071193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.072171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:34.073591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.074298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:34.390670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:34.401775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fce1a2c4-7164-4d20-8a2d-1bdaed7ce2fa tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.341706 Mar 26 20:49:34.406522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 104/185] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:34 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:34.465582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:34.474849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:34.492105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.493909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:34.495818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.499375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:34.741090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:34.749461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-45419e90-a03a-4fe6-b5be-2004e6b15b1f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1270 microversion: 2.1 time: 0.287905 Mar 26 20:49:34.750042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 82/186] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:34 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:34.837726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:34.838538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:34.851118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.851788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:34.853731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:34.857753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.168086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:35.175435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc8bc3cb-1c6e-49a6-b500-44743f1c14a1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.343326 Mar 26 20:49:35.176034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 105/187] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:34 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:35.368171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ace73705-e0b3-4142-9b0c-132058d7a9c9 req-66c53520-0737-4ad1-8006-00f68bc6ec7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181859d8-0ddb-4c1f-9071-f4ededc7db7d", "name": "network-vif-plugged", "status": "completed", "tag": "13fd6291-82e1-4682-be21-fc0e69cbb0c3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:35.392826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ace73705-e0b3-4142-9b0c-132058d7a9c9 req-66c53520-0737-4ad1-8006-00f68bc6ec7b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.393310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ace73705-e0b3-4142-9b0c-132058d7a9c9 req-66c53520-0737-4ad1-8006-00f68bc6ec7b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.422463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:35.422618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:35.432575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.433030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.441653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.444519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.465387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ace73705-e0b3-4142-9b0c-132058d7a9c9 req-66c53520-0737-4ad1-8006-00f68bc6ec7b service nova] Creating event network-vif-plugged:13fd6291-82e1-4682-be21-fc0e69cbb0c3 for instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d on nch1-master-1 Mar 26 20:49:35.466441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ace73705-e0b3-4142-9b0c-132058d7a9c9 req-66c53520-0737-4ad1-8006-00f68bc6ec7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:49:35.468748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.469204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.470018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.474868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.497156 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.rpcapi [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 26 20:49:35.501741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:49:35.538098 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88dc3860-5646-41c4-a5b2-29e71f13b9f8 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482013 Mar 26 20:49:35.539070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 83/188] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:35.767672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:35.768352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:35.792966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.793422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.796658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:35.796978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:35.840042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:35.848335 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a76ce66e-7115-46dc-96f8-2fb367e6b4b1 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.430007 Mar 26 20:49:35.859952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 106/189] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:35 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:36.137804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:36.145528 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-34c4c964-1fc7-47e9-b9e4-70d3e9b21471 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.382523 Mar 26 20:49:36.146011 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 84/190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:35 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:36.194838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:36.195698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:36.204503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:36.205418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:36.206305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:36.206866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:36.261089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-835822537", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b4f1069c-0aa3-4d88-b2ef-9a5c20f55049"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:36.341913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] validate_networks() for [('b4f1069c-0aa3-4d88-b2ef-9a5c20f55049', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:36.481879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:36.490867 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e049eb94-17ea-4791-9dff-8bae3d1c0d04 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.301213 Mar 26 20:49:36.500774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 85/191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:36 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:36.555540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b5bd0e43-ce4b-49cd-9845-41c43733a8b8 req-ec134618-7d4f-4454-aedd-b7bbab487bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:36.566206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b5bd0e43-ce4b-49cd-9845-41c43733a8b8 req-ec134618-7d4f-4454-aedd-b7bbab487bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:36.567664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b5bd0e43-ce4b-49cd-9845-41c43733a8b8 req-ec134618-7d4f-4454-aedd-b7bbab487bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:36.607890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b5bd0e43-ce4b-49cd-9845-41c43733a8b8 req-ec134618-7d4f-4454-aedd-b7bbab487bfc service nova] Creating event network-changed:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch1-master-1 Mar 26 20:49:36.617340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b5bd0e43-ce4b-49cd-9845-41c43733a8b8 req-ec134618-7d4f-4454-aedd-b7bbab487bfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063049 Mar 26 20:49:36.622976 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 86/192] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:36.867186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:36.867899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:36.877289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:36.877784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:36.880321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:36.881371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.240051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:37.249731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc16e821-27f7-4110-b04d-0e527f1fb014 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.386735 Mar 26 20:49:37.256175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 87/193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:36 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:37.262516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:37.265045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:37.278734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.279271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.280174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.280691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.561430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:37.570049 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8fb45c9-05fb-4788-8e34-ffdd0d903fad tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.312286 Mar 26 20:49:37.588021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 88/194] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:37 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:37.603653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:37.604823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:37.619543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.620041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.620839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.625237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.938481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:37.939510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:37.950362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:37.950362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:37.950362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:37.970065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:37.970627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.971142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.972048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:37.972504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:37.984144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-288aa732-848f-4f39-97ef-2a793fd061da tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1319 microversion: 2.1 time: 0.385050 Mar 26 20:49:37.984823 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 89/195] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:37 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:37.996551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9f99a679-af12-4d25-bfd1-c2f48b48ebef req-8a82caac-5c82-4972-9d92-74fd04495a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bf7261-e75c-434d-a249-8aef91e0e3b4", "name": "network-vif-plugged", "status": "completed", "tag": "4a5a098d-6548-4f26-bb99-b79026bf7a83"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:38.035296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f99a679-af12-4d25-bfd1-c2f48b48ebef req-8a82caac-5c82-4972-9d92-74fd04495a6f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.035809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f99a679-af12-4d25-bfd1-c2f48b48ebef req-8a82caac-5c82-4972-9d92-74fd04495a6f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.040048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:38.046456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for user 2bcd816c4f3a495cbe7ce636cf0e2f8a and project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:38.062876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9f99a679-af12-4d25-bfd1-c2f48b48ebef req-8a82caac-5c82-4972-9d92-74fd04495a6f service nova] Creating event network-vif-plugged:4a5a098d-6548-4f26-bb99-b79026bf7a83 for instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 on nch2-master-1 Mar 26 20:49:38.079316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:38.084107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:38.095329 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9f99a679-af12-4d25-bfd1-c2f48b48ebef req-8a82caac-5c82-4972-9d92-74fd04495a6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100516 Mar 26 20:49:38.096043 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 90/196] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:38.206293 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52776609-a5bc-4797-978b-66b6a84b510a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.310894 Mar 26 20:49:38.224042 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 107/197] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 26 20:49:38.235307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:38.255264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:38.442059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59e82310>, body: {"quota_set": {"ram": "5120"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:38.537099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:38.550505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:38.554743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:38.556432 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1c592cc8-845a-4270-9bb8-57b02a85e082 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1261 microversion: 2.25 time: 0.330885 Mar 26 20:49:38.558112 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 108/198] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:38 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1261 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:38.565721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:38.567345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:38.576787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.578885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.580235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.581837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.779133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.779866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.782662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.783613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.863105 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-be27bebb-578b-421d-939e-3693061b25e0 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc" status: 200 len: 240 microversion: 2.36 time: 0.671926 Mar 26 20:49:38.868104 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 91/199] 10.222.0.16 () {62 vars in 1302 bytes} [Sat Mar 26 20:49:38 2022] PUT /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc => generated 240 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:38.875499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:38.876983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:38.887102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.887780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.892565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:38.897393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:38.901174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:38.922094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-75dd2c89-c7d9-43ce-91b3-b2e8a03e824e tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.348972 Mar 26 20:49:38.937617 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 109/200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:38 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:38.950345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Calling method '.version_select at 0x7f6e59db5af0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:39.264728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.265244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.266171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.266683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.294947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a8594c6-8d1a-4a42-a240-3465701b7c9e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc/detail" status: 200 len: 672 microversion: 2.36 time: 0.353457 Mar 26 20:49:39.296241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 110/201] 10.222.0.16 () {60 vars in 1303 bytes} [Sat Mar 26 20:49:38 2022] GET /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc/detail => generated 672 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:39.300033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:39.310756 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1a6bd0e-6926-49d1-a8fa-bc51fbba8d33 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.445084 Mar 26 20:49:39.312569 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 92/202] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:38 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:39.315366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:39.316106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:39.329650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.331966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.333344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.333798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.505879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:39.515499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3786d593-225c-4b65-b74d-ddb2cdcf2ab7 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1469 microversion: 2.1 time: 0.206696 Mar 26 20:49:39.517159 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 111/203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:39 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:39.576069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:39.576949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:39.585711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.586401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.587489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:39.588134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:39.695013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:39.703382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:39.706113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:39.708678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a16f7e2-442d-488a-84c1-3f5da693b8b7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1335 microversion: 2.25 time: 0.136534 Mar 26 20:49:39.710932 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 112/204] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:39 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1335 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:39.723873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59db5550>, body: {"quota_set": {"ram": "2048"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:39.999443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.002789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.005252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.006392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.053435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.053943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.054850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.055400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.074238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:40.075239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:40.087981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.090013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.090992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.092350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.139878 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a58553e-5895-45cc-813d-e8baf02df274 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc?user_id=b967d3229ed84cc1acc06e4dd0457ba7" status: 200 len: 240 microversion: 2.36 time: 0.426184 Mar 26 20:49:40.141065 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 113/205] 10.222.0.16 () {62 vars in 1383 bytes} [Sat Mar 26 20:49:39 2022] PUT /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc?user_id=b967d3229ed84cc1acc06e4dd0457ba7 => generated 240 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:40.147074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:40.148119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:40.155173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.155788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.156975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.157576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.224351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:49:40.418833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d220834-195e-4544-b272-3b143f70fae7 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 204 len: 0 microversion: 2.1 time: 0.888765 Mar 26 20:49:40.420001 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 93/206] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:49:39 2022] DELETE /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 0 bytes in 892 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:49:40.428086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8627c60c-95bf-4816-b77e-f6f5b2901bd3 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Calling method '.version_select at 0x7f6e59e15ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:40.606042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8627c60c-95bf-4816-b77e-f6f5b2901bd3 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc?user_id=b967d3229ed84cc1acc06e4dd0457ba7" status: 200 len: 282 microversion: 2.36 time: 0.183038 Mar 26 20:49:40.615221 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 94/207] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Mar 26 20:49:40 2022] GET /compute/v2.1/os-quota-sets/ba5099223fbf49998bbc369cc032d8fc?user_id=b967d3229ed84cc1acc06e4dd0457ba7 => generated 282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:40.618485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:40.626163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:40.626908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:40.630031 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-47081690-cf43-4e34-8409-739849371944 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1338 microversion: 2.1 time: 0.487162 Mar 26 20:49:40.638463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.642264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.643285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.644620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.647489 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 114/208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:40 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:40.660107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:40.664517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:40.676521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.680642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:40.682340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:40.684519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:41.087198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:41.098408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7b6e84c-e1a0-4e54-9212-b9e52176311f tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1475 microversion: 2.1 time: 0.449090 Mar 26 20:49:41.098999 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 115/209] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:40 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1475 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:41.103693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:41.106274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:41.118924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:41.131699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:41.132909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:41.133577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:41.232483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:41.242697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9e2c6aa-b4d3-4ea1-9737-e53f5b948320 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.620489 Mar 26 20:49:41.252523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 95/210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:40 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:41.503288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:41.516887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:41.521063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:41.524069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f97d86d0-bd49-44fe-8c3a-6b290e791acc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1383 microversion: 2.25 time: 0.423942 Mar 26 20:49:41.526373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 116/211] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:41 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1383 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:41.650883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:41.651499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:41.659270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:41.659733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:41.661307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:41.671316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:42.070744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1638352125", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3719dfee-4a50-4ee6-a6eb-866a85cdf502"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:42.090551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:42.102735 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e86f5ea-0e36-4e2a-b8c5-0b551fe1a615 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1486 microversion: 2.1 time: 0.455718 Mar 26 20:49:42.104003 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 96/212] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:41 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1486 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:42.121200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:42.121997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:42.128657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:42.129020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] validate_networks() for [('3719dfee-4a50-4ee6-a6eb-866a85cdf502', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:42.130349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:42.131292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:42.131932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:42.742305 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90b133de-6b9f-4e5d-b5f8-025bf28b282e tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1637 microversion: 2.1 time: 0.624610 Mar 26 20:49:42.743477 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 97/213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:42 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1637 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:42.749810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:42.750851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:42.758140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:42.758833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:42.759818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:42.760633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.000922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.017222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8a6964e-0923-47fd-aa67-82ae175e4f35 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1475 microversion: 2.1 time: 0.271886 Mar 26 20:49:43.034950 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 98/214] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:42 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:43.035150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:43.035699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:43.036288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:43.036773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:43.037257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:43.041068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:43.041866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:43.050304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.051247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.052444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.052821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.053027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.053581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.055412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.055962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.099327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:43.104487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for user c9bd4f2793ec48a5b31d081c269a39c2 and project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:43.117294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:43.119630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:43.208246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f1538a2-0c39-4128-98eb-d7ea594dbf2b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285769 Mar 26 20:49:43.209901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 117/215] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:49:43.215098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7418e2b0-d8a4-4972-a4b9-be5716734a82 req-5b019414-76a5-40e8-a25f-e03954144b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "name": "network-vif-plugged", "status": "completed", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:43.235368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7418e2b0-d8a4-4972-a4b9-be5716734a82 req-5b019414-76a5-40e8-a25f-e03954144b02 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.236053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7418e2b0-d8a4-4972-a4b9-be5716734a82 req-5b019414-76a5-40e8-a25f-e03954144b02 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.268724 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7418e2b0-d8a4-4972-a4b9-be5716734a82 req-5b019414-76a5-40e8-a25f-e03954144b02 service nova] Creating event network-vif-plugged:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch1-master-1 Mar 26 20:49:43.281963 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7418e2b0-d8a4-4972-a4b9-be5716734a82 req-5b019414-76a5-40e8-a25f-e03954144b02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070606 Mar 26 20:49:43.282741 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 118/216] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:43.299644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:43.300576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:43.316051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.319496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.322107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.328400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.418615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.427504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7da7cc4e-4104-40ba-a857-3ed31e46896b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.390852 Mar 26 20:49:43.442288 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 99/217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:43 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:43.453995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a244df8a-645f-4115-a330-bcfde603a2ff req-3e800bd5-d170-459c-87d7-04df21c3fed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d38e4f-c583-4136-8c24-99e1f3d95bf7", "tag": "20d1d1b1-7ff8-4820-b9ce-973be1edd28e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:43.470180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a244df8a-645f-4115-a330-bcfde603a2ff req-3e800bd5-d170-459c-87d7-04df21c3fed9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.472600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a244df8a-645f-4115-a330-bcfde603a2ff req-3e800bd5-d170-459c-87d7-04df21c3fed9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.490917 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a244df8a-645f-4115-a330-bcfde603a2ff req-3e800bd5-d170-459c-87d7-04df21c3fed9 service nova] Creating event network-changed:20d1d1b1-7ff8-4820-b9ce-973be1edd28e for instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 on nch2-master-1 Mar 26 20:49:43.496241 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a244df8a-645f-4115-a330-bcfde603a2ff req-3e800bd5-d170-459c-87d7-04df21c3fed9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056021 Mar 26 20:49:43.497139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 100/218] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:43.502636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:43.503524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:43.511224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.512075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.513117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.513762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.567547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:49:43.736661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.756207 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3092848f-6c53-4f79-a058-4c71c4eccd05 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 204 len: 0 microversion: 2.1 time: 0.254898 Mar 26 20:49:43.760142 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 101/219] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:49:43 2022] DELETE /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:49:43.760342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.765777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.767891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ebeb520-e29f-43d8-9499-84229b9609a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1383 microversion: 2.25 time: 0.483883 Mar 26 20:49:43.771340 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 119/220] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:43 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1383 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:43.774063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-14ba527b-dacf-4edd-b3e6-1000ceffb9e9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:43.774915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-14ba527b-dacf-4edd-b3e6-1000ceffb9e9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:43.787835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cc2a70d1-c382-45c5-9df8-3aebcc098087 req-3c55d3cc-a289-4845-8c58-55946d09db22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181859d8-0ddb-4c1f-9071-f4ededc7db7d", "name": "network-vif-deleted", "tag": "13fd6291-82e1-4682-be21-fc0e69cbb0c3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:43.837649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cc2a70d1-c382-45c5-9df8-3aebcc098087 req-3c55d3cc-a289-4845-8c58-55946d09db22 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.842014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cc2a70d1-c382-45c5-9df8-3aebcc098087 req-3c55d3cc-a289-4845-8c58-55946d09db22 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.889409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cc2a70d1-c382-45c5-9df8-3aebcc098087 req-3c55d3cc-a289-4845-8c58-55946d09db22 service nova] Creating event network-vif-deleted:13fd6291-82e1-4682-be21-fc0e69cbb0c3 for instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d on nch1-master-1 Mar 26 20:49:43.903454 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cc2a70d1-c382-45c5-9df8-3aebcc098087 req-3c55d3cc-a289-4845-8c58-55946d09db22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129197 Mar 26 20:49:43.905552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 120/221] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:43.928704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-14ba527b-dacf-4edd-b3e6-1000ceffb9e9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:43.932141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:43.937411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:43.938665 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-14ba527b-dacf-4edd-b3e6-1000ceffb9e9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1211 microversion: 2.1 time: 0.177270 Mar 26 20:49:43.941088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 102/222] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:43 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:43.949620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.950073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:43.953891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:43.955025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.042625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:44.044436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:44.058781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.059270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.063842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.072147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.148229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.148651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.149118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lazy-loading 'fault' on Instance uuid 181859d8-0ddb-4c1f-9071-f4ededc7db7d {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:44.215376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:44.239293 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c02f74fe-2734-4240-8a78-eae4bc1425b2 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 200 len: 1309 microversion: 2.1 time: 0.196560 Mar 26 20:49:44.244568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 103/223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:44 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:49:44.334433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:44.347743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38526977-67ad-42f3-ad89-be1c181061d5 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1492 microversion: 2.1 time: 0.437437 Mar 26 20:49:44.348372 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 121/224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:43 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1492 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:44.446969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:44.448148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:44.458311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.458946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.460150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.460779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.653215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:44.660749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8e1795c-77c8-4e11-baec-c470bfc905c8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1312 microversion: 2.1 time: 0.218068 Mar 26 20:49:44.661312 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 104/225] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:44 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:44.789992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:44.790844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:44.798063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.798989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.799998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.800665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.960512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:44.961701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:44.970194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.976745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:44.978477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:44.986246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.065262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:45.075190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:45.076770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:45.078078 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8cf3338-3c9f-4143-b421-3c1081eaf851 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1383 microversion: 2.25 time: 0.292951 Mar 26 20:49:45.079615 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 122/226] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:44 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1383 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:45.170449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:45.179530 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c40c71cc-0f98-4774-9b8b-168352cc669c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1281 microversion: 2.1 time: 0.227101 Mar 26 20:49:45.180514 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 105/227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:44 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:45.261230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:45.261863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:45.269609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.270058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.276538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.277486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.302065 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. Mar 26 20:49:45.311684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:45.312587 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2fed9769-5011-4127-be20-00e5b2189794 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 404 len: 111 microversion: 2.1 time: 0.055439 Mar 26 20:49:45.313151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 123/228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:45 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:45.365714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:45.366482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:45.375012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.376194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.378671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.379955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.530589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1246388724", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:45.601323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:45.826571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e20172563a4c68bec7874b43416e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d7dead9bee45f288900c157201b337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:45.835010 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8c396a9-9be4-484f-9661-5b44695ff2e8 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 200 len: 1492 microversion: 2.1 time: 0.473956 Mar 26 20:49:45.835588 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 106/229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:45 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 1492 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:45.848290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:45.849364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:45.862381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.866606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:45.867578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:45.868211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.107245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:46.107245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:46.107245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:46.107245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:46.107245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:46.115657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.116227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.117229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.117892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.139935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Getting quotas for project c2133fff60db4fe9bb0aa9bbb266e602. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:46.145668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Getting quotas for user a63e6f035306422cab01a0b1a2f5d635 and project c2133fff60db4fe9bb0aa9bbb266e602. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:46.166081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:46.168852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:46.231985 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8df163a5-52cd-457a-8a5f-d46a49a6577b tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705404 Mar 26 20:49:46.233439 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 124/230] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:49:46.241670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:46.242607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:46.252236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.259095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.260631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.263068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.313920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.331288 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99dcd6ae-6414-452d-bbe6-c922bd17ea0e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1462 microversion: 2.1 time: 0.494585 Mar 26 20:49:46.332807 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 107/231] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:45 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1462 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:46.340249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:46.340862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:46.356861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.357323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.363661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:46.364231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:46.542725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.561860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.564614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.565755 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4c9230e-50ae-4914-befc-0aed372df8d9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1383 microversion: 2.25 time: 0.330945 Mar 26 20:49:46.566319 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 125/232] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:46 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1383 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:46.595297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ee5ccfdb-3acb-49d7-ac3e-ea0b67dbf682 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:46.596090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ee5ccfdb-3acb-49d7-ac3e-ea0b67dbf682 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:46.654601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ee5ccfdb-3acb-49d7-ac3e-ea0b67dbf682 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.661935 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ee5ccfdb-3acb-49d7-ac3e-ea0b67dbf682 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1220 microversion: 2.1 time: 0.072580 Mar 26 20:49:46.662720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 126/233] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:46 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:46.764993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:46.777130 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1763589-e8e0-4863-acc1-88d6f7b5677d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1311 microversion: 2.1 time: 0.440710 Mar 26 20:49:46.777862 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 108/234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:46 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:46.928191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfb750b2-b4b1-413f-bf03-69c5047b4df3 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] Action: 'create', calling method: .version_select at 0x7f6e59d66160>, body: {"security_group": {"name": "tempest-securitygroup-1313087577", "description": "tempest-description-986644363"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:47.003515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:47.016524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:47.033233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.035009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.036199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.036791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.494697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-68e2b557-7772-4e0c-95aa-5f331323d976 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1613 microversion: 2.1 time: 0.709301 Mar 26 20:49:47.495249 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 109/235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:46 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1613 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:47.500679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-54c93312-498a-41f5-a1c3-38d8d5828c51 req-d5254812-1194-47ad-91b5-261549df6d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bf7261-e75c-434d-a249-8aef91e0e3b4", "name": "network-vif-deleted", "tag": "4a5a098d-6548-4f26-bb99-b79026bf7a83"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:47.527179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-54c93312-498a-41f5-a1c3-38d8d5828c51 req-d5254812-1194-47ad-91b5-261549df6d60 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.527715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-54c93312-498a-41f5-a1c3-38d8d5828c51 req-d5254812-1194-47ad-91b5-261549df6d60 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.540406 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfb750b2-b4b1-413f-bf03-69c5047b4df3 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.874678 Mar 26 20:49:47.540406 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 127/236] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:49:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:47.550895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-54c93312-498a-41f5-a1c3-38d8d5828c51 req-d5254812-1194-47ad-91b5-261549df6d60 service nova] Creating event network-vif-deleted:4a5a098d-6548-4f26-bb99-b79026bf7a83 for instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 on nch2-master-1 Mar 26 20:49:47.558609 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-54c93312-498a-41f5-a1c3-38d8d5828c51 req-d5254812-1194-47ad-91b5-261549df6d60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061941 Mar 26 20:49:47.559290 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 110/237] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:47.565562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:47.566852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:47.573343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.573878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.574755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.575255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.591975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] HTTP exception thrown: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. Mar 26 20:49:47.592813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Returning 404 to user: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:49:47.594382 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e59bbbb0-c996-4ad9-882d-487d3bc9c0b4 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 404 len: 111 microversion: 2.1 time: 0.033571 Mar 26 20:49:47.595322 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 111/238] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:47 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:47.599057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1902079695", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:47.602149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c311ca6d-78d7-4d29-b4c5-575d56aa6bf5 req-4e3ac9f5-bf1c-4cee-b27d-d587c425a988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dea79e-7497-4064-8dbe-d3e455bf2830", "tag": "29aa9240-7fae-4127-aa8a-eca7df73d597"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:47.612131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c311ca6d-78d7-4d29-b4c5-575d56aa6bf5 req-4e3ac9f5-bf1c-4cee-b27d-d587c425a988 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.612790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c311ca6d-78d7-4d29-b4c5-575d56aa6bf5 req-4e3ac9f5-bf1c-4cee-b27d-d587c425a988 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.625129 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c311ca6d-78d7-4d29-b4c5-575d56aa6bf5 req-4e3ac9f5-bf1c-4cee-b27d-d587c425a988 service nova] Creating event network-changed:29aa9240-7fae-4127-aa8a-eca7df73d597 for instance 13dea79e-7497-4064-8dbe-d3e455bf2830 on nch1-master-1 Mar 26 20:49:47.631010 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c311ca6d-78d7-4d29-b4c5-575d56aa6bf5 req-4e3ac9f5-bf1c-4cee-b27d-d587c425a988 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034153 Mar 26 20:49:47.633139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 112/239] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:47.639264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:47.640901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:47.648674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.649125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.649962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:47.650398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:47.665254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:47.997877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9cb9502357fd45fd99a17d6df3061dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06bf78b652a0421f83c99b220ce334c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:47.998466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] flavor_id is None. Assuming migration. {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 26 20:49:47.998910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 20:49:48.016462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:48.024578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:48.025212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:48.025914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:48.026562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:48.057146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.057896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.058896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.059517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.078219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:48.085263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for user 35af62292f65400bb9626ea4e897fbd6 and project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:48.100875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:48.103281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:48.151770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-599de4c4-84be-4c16-b380-10290d5ea244 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610383 Mar 26 20:49:48.153010 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 128/240] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:49:48.157966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54a75e23-fb2c-429e-9e7d-8e3db366f2cf tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] Action: 'create', calling method: .version_select at 0x7f6e59db5af0>, body: {"security_group": {"name": "tempest-securitygroup-1676152804", "description": "tempest-description-927898652"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:48.528971 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54a75e23-fb2c-429e-9e7d-8e3db366f2cf tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.374651 Mar 26 20:49:48.530080 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 129/241] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:49:48 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:48.534845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:48.536045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:48.547503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.548193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.550916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.551520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.620550 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99801daf-b1c5-4b2a-9fb8-cf41f9ac0e41 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0/action" status: 202 len: 0 microversion: 2.1 time: 0.985797 Mar 26 20:49:48.622779 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 113/242] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:49:47 2022] POST /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0/action => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:48.628794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ac94bf6-6f67-400d-9d9d-d39a0271fab6 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:48.631227 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:48.631227 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:48.643453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac94bf6-6f67-400d-9d9d-d39a0271fab6 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.643957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac94bf6-6f67-400d-9d9d-d39a0271fab6 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.791242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ac94bf6-6f67-400d-9d9d-d39a0271fab6 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.166970 Mar 26 20:49:48.792077 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 114/243] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:48 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:48.797879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:48.798885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:48.807893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.808606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.809584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.810196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.835958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:48.846388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:48.849296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:48.852257 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4971086e-0c1a-494b-8ace-b06f08c7e38a tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1383 microversion: 2.25 time: 0.320937 Mar 26 20:49:48.853640 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 130/244] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:48 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1383 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:48.858572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:48.860057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:48.867955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.868629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:48.869733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:48.870320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:49.149493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:49.153843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:49.163256 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82f23c65-9ad8-4edd-a534-57e75d7e2de7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1311 microversion: 2.1 time: 0.308304 Mar 26 20:49:49.163870 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 131/245] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:48 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1311 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:49.164387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c139e5b5-c0f3-4be4-b74c-7d028d59e3ab tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1320 microversion: 2.1 time: 0.370482 Mar 26 20:49:49.178018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-163958199", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:49.181148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 115/246] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:48 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:49.278485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:49:49.303780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76dd68f5-8598-40fd-beec-6638e0bf1edc tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] Action: 'create', calling method: .version_select at 0x7f6e59c3af70>, body: {"security_group": {"name": "tempest-securitygroup-1808063949", "description": "tempest-description-1766369130"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:49.706760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76dd68f5-8598-40fd-beec-6638e0bf1edc tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.524189 Mar 26 20:49:49.707484 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 116/247] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:49:49 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:49.713912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:49.714953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:49.724938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:49.725395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:49.726187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:49.726773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:49.926736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:49.935146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c712b256-ae1e-41c6-98a4-5d4d5cbb63e7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1471 microversion: 2.1 time: 0.226214 Mar 26 20:49:49.935730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 117/248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:49 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:49.940431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37da062c-717f-4bc5-a777-7f1ab010d07a tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:49.941411 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:49.941411 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:49.960154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:49:49.960681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:49:49.961068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:49:49.961512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:49:49.961937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:49:49.973413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:49.976521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:49.981897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:49.982360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:49.984195 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-37da062c-717f-4bc5-a777-7f1ab010d07a tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.047137 Mar 26 20:49:49.988142 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 118/249] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:49 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:49.995164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b50aec26-1fd9-4e94-af31-981303aa9a59 req-4e862b8b-2bd4-4cfb-87fe-9d9a8a312c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d38e4f-c583-4136-8c24-99e1f3d95bf7", "name": "network-vif-plugged", "status": "completed", "tag": "20d1d1b1-7ff8-4820-b9ce-973be1edd28e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:50.027485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:49:50.029625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b50aec26-1fd9-4e94-af31-981303aa9a59 req-4e862b8b-2bd4-4cfb-87fe-9d9a8a312c81 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.030652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b50aec26-1fd9-4e94-af31-981303aa9a59 req-4e862b8b-2bd4-4cfb-87fe-9d9a8a312c81 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.033543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for user 35af62292f65400bb9626ea4e897fbd6 and project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:49:50.049325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:49:50.051823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:49:50.053205 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b50aec26-1fd9-4e94-af31-981303aa9a59 req-4e862b8b-2bd4-4cfb-87fe-9d9a8a312c81 service nova] Creating event network-vif-plugged:20d1d1b1-7ff8-4820-b9ce-973be1edd28e for instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 on nch2-master-1 Mar 26 20:49:50.061028 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b50aec26-1fd9-4e94-af31-981303aa9a59 req-4e862b8b-2bd4-4cfb-87fe-9d9a8a312c81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074620 Mar 26 20:49:50.062402 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 119/250] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:50.082448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90b5215a-7806-44f1-b0c9-0c8a29da128a tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] Action: 'create', calling method: .version_select at 0x7f6e5a04a1f0>, body: {"security_group": {"name": "tempest-securitygroup-299041739", "description": "tempest-description-440678758"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:50.142448 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f561fa42-80f8-4a4d-a993-31b0dabd5848 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976910 Mar 26 20:49:50.143472 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 132/251] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:49:50.172211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:50.176383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:50.189878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.190719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.193212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.193786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.537017 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90b5215a-7806-44f1-b0c9-0c8a29da128a tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.472163 Mar 26 20:49:50.538126 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 120/252] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:49:50 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:50.571251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e791cd0-39b5-441f-a0c4-10bc2a6c8f0c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-380551487"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:50.576694 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:50.576694 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:50.579633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-8e791cd0-39b5-441f-a0c4-10bc2a6c8f0c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 0bc74066-e469-43d2-800b-bfdcc7fbec78 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:50.635675 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e791cd0-39b5-441f-a0c4-10bc2a6c8f0c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085447 Mar 26 20:49:50.639810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 121/253] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:49:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:50.669057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b232081-3e45-409e-b1fe-3da216815eb2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:50.670564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b232081-3e45-409e-b1fe-3da216815eb2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:50.748559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6b232081-3e45-409e-b1fe-3da216815eb2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:50.758925 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b232081-3e45-409e-b1fe-3da216815eb2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1213 microversion: 2.1 time: 0.116197 Mar 26 20:49:50.759592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:50.768667 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 122/254] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:50 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:50.768863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:50.770411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:50.771705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f23d1c1c-fdfb-4c98-8486-6a22ff5dec1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1361 microversion: 2.25 time: 0.625753 Mar 26 20:49:50.772342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 133/255] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:50 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:50.779947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:50.780574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:50.787345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:50.788015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:50.794297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.794758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.795549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.796172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.808416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.809346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:50.810336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:50.810852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.001041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:51.026172 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-361f2cff-c7c5-433d-8ea2-9e11d7126799 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1311 microversion: 2.1 time: 0.265182 Mar 26 20:49:51.026777 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 123/256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:50 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1311 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:51.040622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ea96585e-06a2-4d22-a21f-396fa6b9e609 tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] Calling method '.version_select at 0x7f6e59b7cc10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:51.235701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:51.250851 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-086ee2c2-b55a-4c7e-ba56-4c55b7c4dab9 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1320 microversion: 2.1 time: 0.467747 Mar 26 20:49:51.262731 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 134/257] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:50 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:51.268582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca307d1f-635d-4278-8d95-8aa88eef92a9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:51.270441 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:51.270441 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:51.283569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca307d1f-635d-4278-8d95-8aa88eef92a9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.285918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca307d1f-635d-4278-8d95-8aa88eef92a9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.424168 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca307d1f-635d-4278-8d95-8aa88eef92a9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.160175 Mar 26 20:49:51.424752 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 135/258] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:51.430718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:51.432525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:51.440368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.441042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.441992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.442433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.833646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:51.846446 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15e7825b-25e5-44ac-96eb-9c7bbd4cb637 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1471 microversion: 2.1 time: 0.420384 Mar 26 20:49:51.847402 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 136/259] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:51 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:51.865905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cde07bb7-f5fb-47b6-be91-4ef90d7e4c09 req-ca75aea0-d227-4b0a-8a9b-47e17c6c75af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab40ed86-51b9-43e0-9212-b0e2abdbf719", "tag": "c66c8bf4-d08f-4509-bf2b-45e319b3aa79"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:51.885514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cde07bb7-f5fb-47b6-be91-4ef90d7e4c09 req-ca75aea0-d227-4b0a-8a9b-47e17c6c75af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.885962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cde07bb7-f5fb-47b6-be91-4ef90d7e4c09 req-ca75aea0-d227-4b0a-8a9b-47e17c6c75af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.901898 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cde07bb7-f5fb-47b6-be91-4ef90d7e4c09 req-ca75aea0-d227-4b0a-8a9b-47e17c6c75af service nova] Creating event network-changed:c66c8bf4-d08f-4509-bf2b-45e319b3aa79 for instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 on nch1-master-1 Mar 26 20:49:51.907542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cde07bb7-f5fb-47b6-be91-4ef90d7e4c09 req-ca75aea0-d227-4b0a-8a9b-47e17c6c75af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058487 Mar 26 20:49:51.909480 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 137/260] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:51.917245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f6f0dff-88db-4eeb-a2a4-917894156df9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:51.918304 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:51.918304 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:51.925805 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f6f0dff-88db-4eeb-a2a4-917894156df9 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.014806 Mar 26 20:49:51.928010 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 138/261] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:49:51 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:51.937798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:51.939558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:51.947694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.948644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:51.950051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:51.950704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:52.090778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:52.101026 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0735e603-bae4-4051-99a5-1c6aa8e40fc1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1271 microversion: 2.1 time: 0.171541 Mar 26 20:49:52.102514 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 139/262] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:51 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:52.108994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:52.109900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:52.118103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:52.118774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:52.119641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:52.120191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:52.462542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:52.479047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:52.482778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:52.484314 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c86610c-79e8-45e9-8540-dbd2de13a19f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1557 microversion: 2.25 time: 0.380255 Mar 26 20:49:52.498639 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 140/263] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:52 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1557 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:52.506386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-67d0c8e0-f0ed-4b1f-b036-f62d934d273c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:52.509490 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:52.509490 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:52.518615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67d0c8e0-f0ed-4b1f-b036-f62d934d273c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:52.519376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67d0c8e0-f0ed-4b1f-b036-f62d934d273c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:52.658816 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-67d0c8e0-f0ed-4b1f-b036-f62d934d273c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.158910 Mar 26 20:49:52.660805 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 141/264] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:52.665866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:52.666715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:52.674643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:52.676280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:52.677382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:52.678132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:53.118294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:53.126544 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0784d75a-6c62-4326-8a0d-aed98e5c5229 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1311 microversion: 2.1 time: 0.464309 Mar 26 20:49:53.127125 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 142/265] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:52 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1311 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:53.140956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:53.141586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:53.150682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:53.154186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:53.155033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:53.155613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:53.551370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:53.561514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6edbe2db-84c2-402f-9676-a53b5f53bc82 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1320 microversion: 2.1 time: 0.432864 Mar 26 20:49:53.573879 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 143/266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:53 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:53.580228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-50089e8d-e9cb-4c9d-ad2e-da63f0ca8426 req-87d0ec5e-823b-433d-88d6-38b6f7ee5df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dea79e-7497-4064-8dbe-d3e455bf2830", "name": "network-vif-plugged", "status": "completed", "tag": "29aa9240-7fae-4127-aa8a-eca7df73d597"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:53.589809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-50089e8d-e9cb-4c9d-ad2e-da63f0ca8426 req-87d0ec5e-823b-433d-88d6-38b6f7ee5df3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:53.590572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-50089e8d-e9cb-4c9d-ad2e-da63f0ca8426 req-87d0ec5e-823b-433d-88d6-38b6f7ee5df3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:53.606374 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-50089e8d-e9cb-4c9d-ad2e-da63f0ca8426 req-87d0ec5e-823b-433d-88d6-38b6f7ee5df3 service nova] Creating event network-vif-plugged:29aa9240-7fae-4127-aa8a-eca7df73d597 for instance 13dea79e-7497-4064-8dbe-d3e455bf2830 on nch1-master-1 Mar 26 20:49:53.615283 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-50089e8d-e9cb-4c9d-ad2e-da63f0ca8426 req-87d0ec5e-823b-433d-88d6-38b6f7ee5df3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039490 Mar 26 20:49:53.616719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 144/267] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:53.796298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:53.797399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:53.811117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:53.811805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:53.812829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:53.813251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.107385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e5d38e4f-c583-4136-8c24-99e1f3d95bf7 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:54.171015 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb760d4a-6969-4e13-90eb-f07ce64127ae tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 2049 microversion: 2.25 time: 0.552623 Mar 26 20:49:54.172174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 145/268] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:53 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 2049 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:54.176961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c16a361-b587-44bf-aef1-0019f18cd277 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:54.178066 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:54.178066 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:54.205144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c16a361-b587-44bf-aef1-0019f18cd277 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.031554 Mar 26 20:49:54.206118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 146/269] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:54 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:54.214414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:54.215275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:54.222791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.223249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.224099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.224540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.414712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:54.422087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-186816d2-f6df-4fdb-ae6c-2e9c33a35af0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.213888 Mar 26 20:49:54.432592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 147/270] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:54 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:54.437855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:54.438296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:54.445656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.446021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.446800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.447251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.601092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:54.611106 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a5f52a79-5ef4-4bf4-a03d-d2b7d2de83be tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.177181 Mar 26 20:49:54.612131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 148/271] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:54 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:54.626104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1be871ca-a321-45a8-8406-1325726d3d70 req-5545e5e4-3fc1-4ba2-8e0a-66fc397babcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:54.635958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1be871ca-a321-45a8-8406-1325726d3d70 req-5545e5e4-3fc1-4ba2-8e0a-66fc397babcd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.636491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1be871ca-a321-45a8-8406-1325726d3d70 req-5545e5e4-3fc1-4ba2-8e0a-66fc397babcd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.649475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1be871ca-a321-45a8-8406-1325726d3d70 req-5545e5e4-3fc1-4ba2-8e0a-66fc397babcd service nova] Creating event network-changed:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:49:54.655111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1be871ca-a321-45a8-8406-1325726d3d70 req-5545e5e4-3fc1-4ba2-8e0a-66fc397babcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032497 Mar 26 20:49:54.655911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 149/272] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:54.661487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:54.662441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:54.674148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.674840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.676259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.676796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.923554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:54.936782 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-099ba10e-1c10-480f-a84d-9b59792034e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1311 microversion: 2.1 time: 0.279060 Mar 26 20:49:54.937596 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 150/273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:54 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:54.947194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:54.948135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:54.959074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.960226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:54.961233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:54.962258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.225187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e5d38e4f-c583-4136-8c24-99e1f3d95bf7 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:55.240399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd02615c-07f7-46cd-8bde-05cd3017febf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 2049 microversion: 2.25 time: 0.297490 Mar 26 20:49:55.240994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 151/274] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:54 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 2049 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:55.246172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4e13057-83ca-4c4a-be64-87048d0d2e4d tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-366628744"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:55.247641 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:55.247641 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:55.248727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-e4e13057-83ca-4c4a-be64-87048d0d2e4d tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 721444b0-dd19-4330-bca6-e248eba0a017 for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:55.273400 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4e13057-83ca-4c4a-be64-87048d0d2e4d tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.030828 Mar 26 20:49:55.274639 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 152/275] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:49:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:55.280200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-48ef89da-8c37-4707-81b9-5c97ad87a562 req-9330e3f0-0f7a-4714-b4a7-429c5c181050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aba2d49-5b28-446f-b54b-63d414e692e6", "tag": "058e2995-dda2-4257-be40-cd89ed465350"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:55.289551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-48ef89da-8c37-4707-81b9-5c97ad87a562 req-9330e3f0-0f7a-4714-b4a7-429c5c181050 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.290000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-48ef89da-8c37-4707-81b9-5c97ad87a562 req-9330e3f0-0f7a-4714-b4a7-429c5c181050 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.300305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-48ef89da-8c37-4707-81b9-5c97ad87a562 req-9330e3f0-0f7a-4714-b4a7-429c5c181050 service nova] Creating event network-changed:058e2995-dda2-4257-be40-cd89ed465350 for instance 4aba2d49-5b28-446f-b54b-63d414e692e6 on nch2-master-1 Mar 26 20:49:55.305150 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-48ef89da-8c37-4707-81b9-5c97ad87a562 req-9330e3f0-0f7a-4714-b4a7-429c5c181050 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029170 Mar 26 20:49:55.306360 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 153/276] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:55.312206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.312939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:55.319766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.320268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.321047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.321648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.446171 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ea96585e-06a2-4d22-a21f-396fa6b9e609 tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11119 microversion: 2.1 time: 4.417854 Mar 26 20:49:55.446770 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 124/277] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 20:49:51 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11119 bytes in 4419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:55.464053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.465368 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:55.465368 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:55.466822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.467447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.468713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.469148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.469494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:55.478091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6833b7f-c903-4a64-b1a0-4c84b9a3e4ff tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1320 microversion: 2.1 time: 0.170374 Mar 26 20:49:55.479052 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 154/278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:55.485027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db86e002-2761-4ce9-89af-e3763c828aac tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:55.486468 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:55.486468 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:55.494514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db86e002-2761-4ce9-89af-e3763c828aac tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.494969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db86e002-2761-4ce9-89af-e3763c828aac tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.514686 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afcd4f9c-4e32-4cd7-9a24-01f871c29c6f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.065704 Mar 26 20:49:55.515290 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 125/279] 10.222.0.16 () {60 vars in 1216 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:49:55.520562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.521174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:55.530853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.531310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.532145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.532736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.610997 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db86e002-2761-4ce9-89af-e3763c828aac tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.130825 Mar 26 20:49:55.611780 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 155/280] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:55.616583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f66f1dde-1f78-491a-8e6a-52bb4aa5fdb9 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] Calling method '.version_select at 0x7f6e59cff5e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.771412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:55.779650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-75932af6-4232-4d0a-a16b-e5f4605f356a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.263152 Mar 26 20:49:55.781564 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 126/281] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:55.785913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:55.787169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:55.787725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f66f1dde-1f78-491a-8e6a-52bb4aa5fdb9 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.174902 Mar 26 20:49:55.793479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.794005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.794950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.795170 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 156/282] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:55.795567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.799721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3cecc50-8582-4d3b-b667-1921ae0a6887 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.800575 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:55.800575 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:55.807320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3cecc50-8582-4d3b-b667-1921ae0a6887 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.011103 Mar 26 20:49:55.808070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 157/283] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:55.812305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:55.813153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:55.819966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.820421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.821194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:55.821632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:55.870189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'flavor' on Instance uuid e5d38e4f-c583-4136-8c24-99e1f3d95bf7 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:55.918668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Going to try to live migrate instance to nch1-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:49:55.961073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:55.968396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8797bf12-1137-453b-9003-464da91bb90f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.159495 Mar 26 20:49:55.969173 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 158/284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:55 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:55.973425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9048d509-f53d-465a-a787-f6cfac379b2e tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] Calling method '.version_select at 0x7f6e59c36ca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:56.161802 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9048d509-f53d-465a-a787-f6cfac379b2e tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/bd78eac9-50de-4b67-bda6-6c1f760d9578" status: 202 len: 0 microversion: 2.1 time: 0.191639 Mar 26 20:49:56.162663 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 159/285] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:49:55 2022] DELETE /compute/v2.1/os-security-groups/bd78eac9-50de-4b67-bda6-6c1f760d9578 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:56.167326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f08da28c-69aa-4840-9b92-aea27608e6bb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:56.169026 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:56.169026 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:56.180256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08da28c-69aa-4840-9b92-aea27608e6bb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.180784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08da28c-69aa-4840-9b92-aea27608e6bb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:56.288257 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f08da28c-69aa-4840-9b92-aea27608e6bb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.124509 Mar 26 20:49:56.294769 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 160/286] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:56.299805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:56.300947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:56.309101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.309544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:56.310313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.310743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:56.456054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:56.464474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9aa62ca-c824-4aa4-bf00-62fd3d7b553c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1494 microversion: 2.1 time: 0.168549 Mar 26 20:49:56.476318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 161/287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:56 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1494 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:56.481791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dafb8d39-c23d-438a-8321-81105e8911f6 tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] Calling method '.version_select at 0x7f6e59dee160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:56.660371 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dafb8d39-c23d-438a-8321-81105e8911f6 tempest-SecurityGroupsTestAdminJSON-2049530855 tempest-SecurityGroupsTestAdminJSON-2049530855-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a454656-839b-420e-8b66-9dacf5ab667f" status: 202 len: 0 microversion: 2.1 time: 0.182121 Mar 26 20:49:56.664275 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 162/288] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:49:56 2022] DELETE /compute/v2.1/os-security-groups/8a454656-839b-420e-8b66-9dacf5ab667f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:56.668321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79397993-72e0-4221-90b7-1c08c46f8266 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:56.669220 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:56.669220 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:56.692529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79397993-72e0-4221-90b7-1c08c46f8266 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.030271 Mar 26 20:49:56.693497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 163/289] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:56 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:56.698541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3c35118b-860c-415e-bcd8-4bc304054c27 req-90e92a18-7b63-4cc8-8382-6b68868ec6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab40ed86-51b9-43e0-9212-b0e2abdbf719", "name": "network-vif-plugged", "status": "completed", "tag": "c66c8bf4-d08f-4509-bf2b-45e319b3aa79"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:56.708514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3c35118b-860c-415e-bcd8-4bc304054c27 req-90e92a18-7b63-4cc8-8382-6b68868ec6cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.708966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3c35118b-860c-415e-bcd8-4bc304054c27 req-90e92a18-7b63-4cc8-8382-6b68868ec6cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:56.721637 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3c35118b-860c-415e-bcd8-4bc304054c27 req-90e92a18-7b63-4cc8-8382-6b68868ec6cf service nova] Creating event network-vif-plugged:c66c8bf4-d08f-4509-bf2b-45e319b3aa79 for instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 on nch1-master-1 Mar 26 20:49:56.727348 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3c35118b-860c-415e-bcd8-4bc304054c27 req-90e92a18-7b63-4cc8-8382-6b68868ec6cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Mar 26 20:49:56.728159 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 164/290] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:56.882934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:56.884116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:56.892270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.893324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:56.895477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:56.896125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.044006 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8236585b-ff92-48a7-933d-bfe3b1462a7f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1645 microversion: 2.1 time: 0.314571 Mar 26 20:49:57.044579 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 165/291] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:56 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1645 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:57.049159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.049772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:57.056637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.057094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.057874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.058316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.194372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.203409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b972879f-305b-4d25-be02-83e6299c6bc1 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1320 microversion: 2.1 time: 0.157763 Mar 26 20:49:57.204332 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 166/292] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:57.209562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7ed8ba4-a243-4ec8-8ec5-059d77fa20aa tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] Calling method '.version_select at 0x7f6e59cffa60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.342573 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-acdd5850-f27e-499a-9029-0c9c4feccc6d tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7/action" status: 202 len: 0 microversion: 2.25 time: 1.560218 Mar 26 20:49:57.343803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 127/293] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:49:55 2022] POST /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7/action => generated 0 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:49:57.349922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8892896-96ad-420e-9e9d-87971d960125 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-453111203"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:57.351265 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:57.351265 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:57.352175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-c8892896-96ad-420e-9e9d-87971d960125 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 20eb4e81-d72a-442f-bcbe-3f733f270abc for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:57.373287 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8892896-96ad-420e-9e9d-87971d960125 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.027975 Mar 26 20:49:57.374270 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 128/294] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:49:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:57.380077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.380977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:57.388354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.388813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.389607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.390057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.424861 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7ed8ba4-a243-4ec8-8ec5-059d77fa20aa tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cb5b207d-64bf-4df6-a4b8-3bf3a8ffbecf" status: 202 len: 0 microversion: 2.1 time: 0.218990 Mar 26 20:49:57.426804 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 167/295] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:49:57 2022] DELETE /compute/v2.1/os-security-groups/cb5b207d-64bf-4df6-a4b8-3bf3a8ffbecf => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:57.434405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.439558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:57.449198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.449974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.450956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.451688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.542857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.551278 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e30a84e4-1cfa-438a-80db-08eaf20679a5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.174907 Mar 26 20:49:57.552004 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 129/296] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:57.556601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.557205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:57.563689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.564180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.564968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.565418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.694516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-35fa78f7-7970-4392-9eeb-0e41c20b5b36 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1645 microversion: 2.1 time: 0.141410 Mar 26 20:49:57.695114 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 130/297] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1645 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:57.699764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.700408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:57.707434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.707953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.708756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.709202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.849509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.850379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.858477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.860451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:57.861836 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e79e1e4d-9d2d-4004-a859-c0ce2c14c8df tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.165740 Mar 26 20:49:57.862358 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 131/298] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:57.870172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8624e7a-52d8-4113-85de-f9fb06a93d85 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:57.871607 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-063b184e-e7ec-4fb0-b51a-669b9ec42e97 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.443464 Mar 26 20:49:57.872326 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 168/299] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:57.874178 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:57.874178 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:57.883065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8624e7a-52d8-4113-85de-f9fb06a93d85 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:57.883540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8624e7a-52d8-4113-85de-f9fb06a93d85 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:57.886227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e59c3c7b-247d-4412-9d44-341081956983 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] Calling method '.version_select at 0x7f6e59ca73a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.992389 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8624e7a-52d8-4113-85de-f9fb06a93d85 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.128193 Mar 26 20:49:57.993419 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 132/300] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:57 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:57.998308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:57.999792 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:57.999792 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:58.001047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.001663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.002470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.003066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.030293 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-924a0454-64f3-486d-8d0f-8ffde0bdd29b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035682 Mar 26 20:49:58.031444 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 133/301] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:49:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:58.036625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4391ffa8-f766-49ae-805f-8bff4dd74dad tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:58.037916 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:58.037916 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:49:58.046786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4391ffa8-f766-49ae-805f-8bff4dd74dad tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.047249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4391ffa8-f766-49ae-805f-8bff4dd74dad tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.157125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4391ffa8-f766-49ae-805f-8bff4dd74dad tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.124465 Mar 26 20:49:58.157713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 134/302] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:58.167667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:58.170073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:58.177836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.177836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.178412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.178848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.203742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lazy-loading 'flavor' on Instance uuid 13dea79e-7497-4064-8dbe-d3e455bf2830 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:58.218532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Going to try to live migrate instance to nch2-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:49:58.269760 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e59c3c7b-247d-4412-9d44-341081956983 tempest-SecurityGroupsTestAdminJSON-539218426 tempest-SecurityGroupsTestAdminJSON-539218426-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e4812448-a87a-4f9a-9dc4-32fccbc939b5" status: 202 len: 0 microversion: 2.1 time: 0.386944 Mar 26 20:49:58.279995 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 169/303] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:49:57 2022] DELETE /compute/v2.1/os-security-groups/e4812448-a87a-4f9a-9dc4-32fccbc939b5 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:58.289039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ef3b786-248a-4c36-b8b9-0801c66ee7c3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:58.290357 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:58.290357 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:58.338852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ef3b786-248a-4c36-b8b9-0801c66ee7c3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.054770 Mar 26 20:49:58.339661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 170/304] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:58 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:58.351859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:58.352800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:58.360245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.361080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.361977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.362539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.521842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:58.532406 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc630124-f15e-45be-8577-5da88353ef55 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1470 microversion: 2.1 time: 0.191382 Mar 26 20:49:58.532988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 171/305] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:58 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:58.555279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b74c5b5a-2807-404d-b95d-7aafdadf067c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1185092377"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:58.556658 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:58.556658 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:58.557759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-b74c5b5a-2807-404d-b95d-7aafdadf067c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 471627fa-53fd-4ace-a9be-e00d07cc8c7b for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:58.582733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b74c5b5a-2807-404d-b95d-7aafdadf067c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030956 Mar 26 20:49:58.588081 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 172/306] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:49:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:58.588233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db994670-c71f-4d07-99c5-3c4a4ab94386 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1189090846"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:58.589813 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:58.589813 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:58.590753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-db994670-c71f-4d07-99c5-3c4a4ab94386 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 9681c801-f142-4434-ac38-d0549f525349 for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:49:58.622374 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db994670-c71f-4d07-99c5-3c4a4ab94386 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037882 Mar 26 20:49:58.627868 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 173/307] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:49:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:58.635568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:58.636477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:58.643673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.644772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.645559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.646137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.834228 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fe2cb36-aed0-4eb9-a6fe-8f89fca27a03 tempest-DeleteServersAdminTestJSON-902830425 tempest-DeleteServersAdminTestJSON-902830425-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719/action" status: 202 len: 0 microversion: 2.1 time: 0.209251 Mar 26 20:49:58.835234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 174/308] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:49:58 2022] POST /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:49:58.844349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:58.844969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:58.853965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.855197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:58.856170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:58.856783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.163754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:59.188221 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c06d03c3-8fa2-483f-9843-d29249636488 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.348934 Mar 26 20:49:59.199033 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 175/309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:58 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:59.205996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e93c5db-11b2-407b-8113-7b6e01afa3dc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:59.207015 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:59.207015 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:59.239964 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e93c5db-11b2-407b-8113-7b6e01afa3dc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.045357 Mar 26 20:49:59.245200 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 176/310] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:49:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:49:59.252088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-670246cb-f4c3-4335-8c0b-b19b46bae818 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:49:59.254315 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:59.254315 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:49:59.303873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-670246cb-f4c3-4335-8c0b-b19b46bae818 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.304536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-670246cb-f4c3-4335-8c0b-b19b46bae818 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.462632 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-670246cb-f4c3-4335-8c0b-b19b46bae818 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.216120 Mar 26 20:49:59.463531 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 177/311] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:49:59 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:49:59.468458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:59.470986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:59.475491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.475949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.477009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.477513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.521263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.522031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.522700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lazy-loading 'fault' on Instance uuid ab40ed86-51b9-43e0-9212-b0e2abdbf719 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:49:59.732167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:59.741558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-939e68b4-d607-40c4-ac37-ceb77cc5f688 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1453 microversion: 2.1 time: 0.276829 Mar 26 20:49:59.754551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 178/312] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:59 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1453 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:49:59.760353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:59.760985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:59.767220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.767894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.768717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.769185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.955573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:59.963797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:59.966574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:49:59.967840 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d2c962a-086d-40ea-b614-e4b071d53e49 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.211659 Mar 26 20:49:59.968712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 179/313] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:49:59 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:49:59.973288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:49:59.974076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:49:59.983547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.984029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:49:59.984806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:49:59.985425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.127444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:00.134734 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec89ec66-00c1-4b19-97e6-3eaa451b7388 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.164956 Mar 26 20:50:00.135305 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 180/314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:49:59 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:00.140798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2516a669-09f9-44b7-9cf6-fa5e0050c39c req-86c3e921-1b71-4e70-9d87-c1ac3bd8a26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d38e4f-c583-4136-8c24-99e1f3d95bf7", "name": "network-vif-unplugged", "status": "completed", "tag": "20d1d1b1-7ff8-4820-b9ce-973be1edd28e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.149382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2516a669-09f9-44b7-9cf6-fa5e0050c39c req-86c3e921-1b71-4e70-9d87-c1ac3bd8a26e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.149833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2516a669-09f9-44b7-9cf6-fa5e0050c39c req-86c3e921-1b71-4e70-9d87-c1ac3bd8a26e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.162824 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2516a669-09f9-44b7-9cf6-fa5e0050c39c req-86c3e921-1b71-4e70-9d87-c1ac3bd8a26e service nova] Creating event network-vif-unplugged:20d1d1b1-7ff8-4820-b9ce-973be1edd28e for instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 on nch2-master-1 Mar 26 20:50:00.168006 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2516a669-09f9-44b7-9cf6-fa5e0050c39c req-86c3e921-1b71-4e70-9d87-c1ac3bd8a26e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031344 Mar 26 20:50:00.168594 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 181/315] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:00.173606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39bf4a71-1020-40ee-848e-fdf580439fbb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.174445 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.174445 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.181375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-39bf4a71-1020-40ee-848e-fdf580439fbb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 26 20:50:00.181964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39bf4a71-1020-40ee-848e-fdf580439fbb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:00.182793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39bf4a71-1020-40ee-848e-fdf580439fbb tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.013006 Mar 26 20:50:00.186629 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 182/316] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:50:00 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:00.192250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-86f576e3-6e64-4c3a-91c9-1971ce5a6b02 req-011a9626-5511-4eae-9a36-f12f2dff1ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-plugged", "status": "completed", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.212133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86f576e3-6e64-4c3a-91c9-1971ce5a6b02 req-011a9626-5511-4eae-9a36-f12f2dff1ed5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.212564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86f576e3-6e64-4c3a-91c9-1971ce5a6b02 req-011a9626-5511-4eae-9a36-f12f2dff1ed5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.224594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-86f576e3-6e64-4c3a-91c9-1971ce5a6b02 req-011a9626-5511-4eae-9a36-f12f2dff1ed5 service nova] Creating event network-vif-plugged:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:50:00.229553 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-86f576e3-6e64-4c3a-91c9-1971ce5a6b02 req-011a9626-5511-4eae-9a36-f12f2dff1ed5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041512 Mar 26 20:50:00.230148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 183/317] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:00.235223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.236844 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.236844 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.246144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.246603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.273463 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Aggregate 7 already has host nch2-master-1. Mar 26 20:50:00.274160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 409 to user: Aggregate 7 already has host nch2-master-1. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:00.274978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a0b4d5e-b88c-425a-b227-43a1569f6d70 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.043643 Mar 26 20:50:00.276124 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 184/318] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Mar 26 20:50:00.281852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.282479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:00.289148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.289908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.290703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.291143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.316916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:50:00.339813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e00be221-8915-454c-bc6c-815580bb13d4 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830/action" status: 202 len: 0 microversion: 2.1 time: 2.180994 Mar 26 20:50:00.340491 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 135/319] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:49:58 2022] POST /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830/action => generated 0 bytes in 2182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:00.346773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d69c9eb-155c-49a6-b736-cd620b5de117 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.349154 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.349154 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:00.371092 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7d69c9eb-155c-49a6-b736-cd620b5de117 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 26 20:50:00.371692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d69c9eb-155c-49a6-b736-cd620b5de117 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:00.372860 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d69c9eb-155c-49a6-b736-cd620b5de117 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030620 Mar 26 20:50:00.373550 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 136/320] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:00 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:00.381167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.382580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:00.391525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.392428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.393511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.395144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.473002 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1149dd7-68a0-4450-ad79-cd3a813bbe96 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 204 len: 0 microversion: 2.1 time: 0.194083 Mar 26 20:50:00.473762 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 185/321] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:50:00 2022] DELETE /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:00.479511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32b8ccd3-8e19-42f6-bc7f-5aad7fee234e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.481274 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.481274 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.489850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32b8ccd3-8e19-42f6-bc7f-5aad7fee234e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.490435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32b8ccd3-8e19-42f6-bc7f-5aad7fee234e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.602680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32b8ccd3-8e19-42f6-bc7f-5aad7fee234e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.127092 Mar 26 20:50:00.603848 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 186/322] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:00.608621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.610027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:00.617064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:00.617211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.617550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.618689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.618815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.625430 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2bceaa7f-81ce-412c-bf8e-81a25a437626 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.250656 Mar 26 20:50:00.626177 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 137/323] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:00 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:00.631360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80b9a4a7-6f5e-4f65-8f1a-6b1e47df4f8b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-746166778", "name": "tempest-test_aggregate-770384322"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.652668 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.652668 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:00.654093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-80b9a4a7-6f5e-4f65-8f1a-6b1e47df4f8b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 17a57a5e-aad1-4634-b65a-1da194c72af2 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:00.697051 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80b9a4a7-6f5e-4f65-8f1a-6b1e47df4f8b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.069548 Mar 26 20:50:00.698923 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 138/324] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:00.704485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.706239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:00.716136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.716868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.717859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.718486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.791195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:00.791763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:00.792272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lazy-loading 'fault' on Instance uuid ab40ed86-51b9-43e0-9212-b0e2abdbf719 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:00.802805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:00.813077 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8bee528d-a5bc-47b3-81bd-08949ac6421d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.207978 Mar 26 20:50:00.814293 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 187/325] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:00 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:00.819295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-26f03159-1e30-48c0-94cb-e02776c468d7 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.820205 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.820205 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.851731 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-26f03159-1e30-48c0-94cb-e02776c468d7 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036304 Mar 26 20:50:00.856627 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 188/326] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:00 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:00.857454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d859e5e9-9ea4-47d0-947e-3a85da2126b0 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.858524 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.858524 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.895745 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d859e5e9-9ea4-47d0-947e-3a85da2126b0 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.042122 Mar 26 20:50:00.896637 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 189/327] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:00 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:00.905458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eee14ae7-5be0-4b2e-8fdd-86065b5a78d3 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-444906509"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:00.907063 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.907063 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.907691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-eee14ae7-5be0-4b2e-8fdd-86065b5a78d3 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 2ba1a09e-654a-4ae9-84e1-af49eacbb27d for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:00.935740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eee14ae7-5be0-4b2e-8fdd-86065b5a78d3 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037896 Mar 26 20:50:00.936351 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 190/328] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:00.953825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d63cc27-46a4-45df-a1c8-c30cf1978a48 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:00.954807 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:00.954807 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:00.961271 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6d63cc27-46a4-45df-a1c8-c30cf1978a48 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Mar 26 20:50:00.961890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d63cc27-46a4-45df-a1c8-c30cf1978a48 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:00.962693 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d63cc27-46a4-45df-a1c8-c30cf1978a48 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.013598 Mar 26 20:50:00.963536 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 191/329] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:50:00 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:01.067308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.075398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b0becda4-817e-4196-a510-dd8362b76182 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1459 microversion: 2.1 time: 0.375236 Mar 26 20:50:01.077179 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 139/330] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:00 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1459 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:01.084906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-164a50f5-fbc9-4a14-a662-098e8f167c45 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.086043 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.086043 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:01.101007 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-164a50f5-fbc9-4a14-a662-098e8f167c45 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Mar 26 20:50:01.101885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-164a50f5-fbc9-4a14-a662-098e8f167c45 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:01.103496 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-164a50f5-fbc9-4a14-a662-098e8f167c45 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.022352 Mar 26 20:50:01.108985 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 140/331] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:01 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:01.115338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.116153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:01.123810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.124611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.125582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.126177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.197934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75d6e051-7cc6-4669-aed8-7e9147084ad8 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.199172 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.199172 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.200070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-75d6e051-7cc6-4669-aed8-7e9147084ad8 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.200713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75d6e051-7cc6-4669-aed8-7e9147084ad8 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:01.201520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-75d6e051-7cc6-4669-aed8-7e9147084ad8 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.236996 Mar 26 20:50:01.202302 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 192/332] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Mar 26 20:50:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:01.212292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a3c4830-fe49-46d0-8271-9363c69b9bca tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-814982701"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.213569 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.213569 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.214425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-5a3c4830-fe49-46d0-8271-9363c69b9bca tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid f6b57871-3b1a-4539-bf60-1885537d8c3e for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:01.234420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a3c4830-fe49-46d0-8271-9363c69b9bca tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.026779 Mar 26 20:50:01.234911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 193/333] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.240025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.240889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:01.247532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.248027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.248864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.249244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.396674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.405122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c40e8eb0-f4b9-4c2b-91f3-0701fb6911f4 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.169032 Mar 26 20:50:01.407227 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 194/334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:01.408659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.412510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3343aaf4-373c-4162-82d5-9a110734f189 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.413267 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.413267 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.435498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.438226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.439487 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0efc87af-e766-4690-b339-d3d4773eef8b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.329207 Mar 26 20:50:01.440208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 141/335] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:01.440342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3343aaf4-373c-4162-82d5-9a110734f189 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.031695 Mar 26 20:50:01.441147 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 195/336] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:01 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:01.446134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5873c0f0-be76-41be-bee1-6713c6a5aff3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.447046 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.447046 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.457400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-caa3de2d-3e3d-4a75-96eb-8fb2e2429d0c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-719560724"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.458477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5873c0f0-be76-41be-bee1-6713c6a5aff3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.016302 Mar 26 20:50:01.458925 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.458925 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:01.460300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-caa3de2d-3e3d-4a75-96eb-8fb2e2429d0c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 3e4bdc6c-a0a3-466e-9dfe-6d577decc698 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:01.464349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 196/337] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.469525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d5a816d-aa69-47f3-8a88-cecf4efa7896 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.471118 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.471118 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.495625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d5a816d-aa69-47f3-8a88-cecf4efa7896 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.030145 Mar 26 20:50:01.499955 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 197/338] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.503460 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-caa3de2d-3e3d-4a75-96eb-8fb2e2429d0c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050206 Mar 26 20:50:01.504138 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 142/339] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.509352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3a1e360-584e-4ace-8cdc-ed977c2457e3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.509352 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.509352 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.515040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-508051462"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.516170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3a1e360-584e-4ace-8cdc-ed977c2457e3 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.013629 Mar 26 20:50:01.516430 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.516430 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:01.517088 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 198/340] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:50:01.527399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25e71b14-469a-44bb-8f71-4dd8cbc62f77 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.528194 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.528194 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.535494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.536481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.553375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.554378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.558430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25e71b14-469a-44bb-8f71-4dd8cbc62f77 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.033533 Mar 26 20:50:01.565287 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-508051462 could not be found. Mar 26 20:50:01.565484 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 199/341] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:01.566659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-508051462 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:01.567562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d116c39-ffef-414a-a2df-efada4a86db0 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.056620 Mar 26 20:50:01.568607 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 143/342] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:01.571482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58ab7b1b-ef78-43fa-b4e9-61df2df467b7 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764365103", "availability_zone": "tempest-test_az-1431410843"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.574056 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.574056 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.578411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7af78197-cbff-4b2a-8372-c40dca184d61 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.579379 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.579379 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:01.591338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-58ab7b1b-ef78-43fa-b4e9-61df2df467b7 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 8904737b-b29b-45bf-b57e-e6a885cfbfc4 for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:01.616555 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7af78197-cbff-4b2a-8372-c40dca184d61 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.043887 Mar 26 20:50:01.618340 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 144/343] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:01 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 26 20:50:01.639474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58ab7b1b-ef78-43fa-b4e9-61df2df467b7 tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.071934 Mar 26 20:50:01.640388 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 200/344] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.645162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7969eeec-8272-4ed5-97f9-c38793faaafd tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.646839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7969eeec-8272-4ed5-97f9-c38793faaafd tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:01.647836 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7969eeec-8272-4ed5-97f9-c38793faaafd tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.006335 Mar 26 20:50:01.652526 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 201/345] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:50:01.657312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.657948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:01.665284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.666023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.667014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.667604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.754973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1773004722", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.805622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:01.809842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:01.817416 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33ce31c8-d275-49e8-8dfb-f5b53ae62b2a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.164004 Mar 26 20:50:01.817991 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 202/346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:01.822363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc7a043e-7922-466d-aad7-841be63b2ddc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764365103_new", "availability_zone": "tempest-test_az-1431410843_new"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.895154 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:01.895154 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:01.927411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7a043e-7922-466d-aad7-841be63b2ddc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.927877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7a043e-7922-466d-aad7-841be63b2ddc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.957641 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc7a043e-7922-466d-aad7-841be63b2ddc tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.137681 Mar 26 20:50:01.962839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 203/347] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 20:50:01 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:01.967473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa6fcbc2-fdc6-4fe9-9709-0e3043333197 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:01.969094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa6fcbc2-fdc6-4fe9-9709-0e3043333197 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:01.969903 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa6fcbc2-fdc6-4fe9-9709-0e3043333197 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006067 Mar 26 20:50:01.970409 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 204/348] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:50:01.975201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:01.975857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:01.981726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.982178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:01.982954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:01.983394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.114113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:02.114666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:02.115223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:02.115718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:02.116252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:02.125716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.126282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.127254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.127767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.150033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Getting quotas for project 1c87bd15896c4325b42e8eff64041a63. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:02.155670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Getting quotas for user 37247839208e40e7984349f36749bb22 and project 1c87bd15896c4325b42e8eff64041a63. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:02.169374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:02.171689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:02.226694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7fae8d4-8ced-45c9-962e-0331968b9877 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606909 Mar 26 20:50:02.227801 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 145/349] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:02.235935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-97915e12-ef16-4c89-ab64-2566fec4799b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.236728 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:02.236728 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:02.240464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:02.249872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91fff003-5098-4096-b1ca-a2d0a085b21d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.278479 Mar 26 20:50:02.250459 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 205/350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:01 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:02.251955 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-97915e12-ef16-4c89-ab64-2566fec4799b tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.022029 Mar 26 20:50:02.256527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-640cc11a-ae94-422e-870f-d41ede787788 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-671215705"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:02.260139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 146/351] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:50:02 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:02.261121 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:02.261121 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:02.262178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-640cc11a-ae94-422e-870f-d41ede787788 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:02.262952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-640cc11a-ae94-422e-870f-d41ede787788 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:02.264012 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-640cc11a-ae94-422e-870f-d41ede787788 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012605 Mar 26 20:50:02.268393 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 206/352] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:02 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:02.271375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2574099a-d1c3-4167-a485-a09e777bf425 req-7708100f-7d5a-4285-8a34-7e5b661edd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dea79e-7497-4064-8dbe-d3e455bf2830", "name": "network-vif-unplugged", "status": "completed", "tag": "29aa9240-7fae-4127-aa8a-eca7df73d597"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:02.281794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2574099a-d1c3-4167-a485-a09e777bf425 req-7708100f-7d5a-4285-8a34-7e5b661edd49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.282351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2574099a-d1c3-4167-a485-a09e777bf425 req-7708100f-7d5a-4285-8a34-7e5b661edd49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.282555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.283182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:02.295783 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2574099a-d1c3-4167-a485-a09e777bf425 req-7708100f-7d5a-4285-8a34-7e5b661edd49 service nova] Creating event network-vif-unplugged:29aa9240-7fae-4127-aa8a-eca7df73d597 for instance 13dea79e-7497-4064-8dbe-d3e455bf2830 on nch1-master-1 Mar 26 20:50:02.304133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2574099a-d1c3-4167-a485-a09e777bf425 req-7708100f-7d5a-4285-8a34-7e5b661edd49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037190 Mar 26 20:50:02.305498 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 207/353] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:02.308894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.309355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.310142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.312272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fb72b010-8b63-4552-beb0-03c52099b38d req-7c9f664d-52fc-490e-9dd6-837bc49965c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d38e4f-c583-4136-8c24-99e1f3d95bf7", "tag": "20d1d1b1-7ff8-4820-b9ce-973be1edd28e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:02.314576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.323168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fb72b010-8b63-4552-beb0-03c52099b38d req-7c9f664d-52fc-490e-9dd6-837bc49965c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.324237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fb72b010-8b63-4552-beb0-03c52099b38d req-7c9f664d-52fc-490e-9dd6-837bc49965c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.337627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fb72b010-8b63-4552-beb0-03c52099b38d req-7c9f664d-52fc-490e-9dd6-837bc49965c0 service nova] Creating event network-changed:20d1d1b1-7ff8-4820-b9ce-973be1edd28e for instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 on nch2-master-1 Mar 26 20:50:02.344156 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fb72b010-8b63-4552-beb0-03c52099b38d req-7c9f664d-52fc-490e-9dd6-837bc49965c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036755 Mar 26 20:50:02.345322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 208/354] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:02.352610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83ff6c1e-ab19-445d-a25a-7ddf87fafdf3 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.353581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83ff6c1e-ab19-445d-a25a-7ddf87fafdf3 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:02.391712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.392192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.393038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lazy-loading 'fault' on Instance uuid ab40ed86-51b9-43e0-9212-b0e2abdbf719 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:02.514518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-83ff6c1e-ab19-445d-a25a-7ddf87fafdf3 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:02.522136 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83ff6c1e-ab19-445d-a25a-7ddf87fafdf3 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1223 microversion: 2.1 time: 0.175475 Mar 26 20:50:02.531578 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 209/355] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:02 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1223 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:02.531578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19f81d08-19c4-47ff-8b4b-f2c1b645c37f tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.531578 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:02.531578 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:02.557311 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19f81d08-19c4-47ff-8b4b-f2c1b645c37f tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.033075 Mar 26 20:50:02.559250 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 210/356] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:02 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:02.568528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6b0d627d-3fa1-4285-813b-a1cdcfc751bf req-7f92f202-54d9-45ee-baff-fa8b35c603bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aba2d49-5b28-446f-b54b-63d414e692e6", "name": "network-vif-plugged", "status": "completed", "tag": "058e2995-dda2-4257-be40-cd89ed465350"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:02.580759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6b0d627d-3fa1-4285-813b-a1cdcfc751bf req-7f92f202-54d9-45ee-baff-fa8b35c603bb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.582754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6b0d627d-3fa1-4285-813b-a1cdcfc751bf req-7f92f202-54d9-45ee-baff-fa8b35c603bb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.601735 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6b0d627d-3fa1-4285-813b-a1cdcfc751bf req-7f92f202-54d9-45ee-baff-fa8b35c603bb service nova] Creating event network-vif-plugged:058e2995-dda2-4257-be40-cd89ed465350 for instance 4aba2d49-5b28-446f-b54b-63d414e692e6 on nch2-master-1 Mar 26 20:50:02.608836 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6b0d627d-3fa1-4285-813b-a1cdcfc751bf req-7f92f202-54d9-45ee-baff-fa8b35c603bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047844 Mar 26 20:50:02.610456 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 211/357] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:02.616556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f6a88b6f-ab13-4d20-a914-0e52c68aee98 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422866887"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:02.618142 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:02.618142 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:02.631245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-f6a88b6f-ab13-4d20-a914-0e52c68aee98 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid fabfde30-6433-4282-bd43-e238d7acf43e for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:02.681263 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f6a88b6f-ab13-4d20-a914-0e52c68aee98 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069446 Mar 26 20:50:02.682439 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 212/358] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:02.688974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.689488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:02.697342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.697887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.698745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.699258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.784454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:02.792594 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48b5d9b7-58f7-4c90-937f-8192802dd4df tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1459 microversion: 2.1 time: 0.531351 Mar 26 20:50:02.793167 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 147/359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:02 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1459 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:02.815491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:02.819316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:02.832180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.832644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:02.833443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:02.833890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.034529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.036725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.044188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ccfe3e68-0b73-4cb2-983c-249cc046939b tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.360481 Mar 26 20:50:03.044559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.046171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.047549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5022430a-154b-4619-824c-773c376caff0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.253476 Mar 26 20:50:03.058431 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 213/360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:02 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:03.059170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 148/361] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:02 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:03.062863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d621140-f950-43bd-8b90-72e3990e5aed tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1031645093"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.064846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b55b3cf-07e5-4dcc-8982-baabe30b373a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422866887"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.066395 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.066395 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.067542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-3d621140-f950-43bd-8b90-72e3990e5aed tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Generated uuid 7ef99133-3db7-46fd-a556-8dca2995667a for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:03.079312 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.079312 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.081185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-6b55b3cf-07e5-4dcc-8982-baabe30b373a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 796e13ab-3497-4ce2-952b-224ee6529f97 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:03.096207 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-6b55b3cf-07e5-4dcc-8982-baabe30b373a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1422866887 already exists. Mar 26 20:50:03.097497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b55b3cf-07e5-4dcc-8982-baabe30b373a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1422866887 already exists. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.098539 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b55b3cf-07e5-4dcc-8982-baabe30b373a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.038251 Mar 26 20:50:03.099624 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 149/362] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:03.103488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d621140-f950-43bd-8b90-72e3990e5aed tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050001 Mar 26 20:50:03.109268 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 214/363] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:03.111404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.112234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.114080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9fdf4ade-a8e2-4f27-ab6e-c7d20d89543f tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.114953 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.114953 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.119598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.120305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.121237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.121862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.143266 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9fdf4ade-a8e2-4f27-ab6e-c7d20d89543f tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.034209 Mar 26 20:50:03.144238 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 215/364] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:03.154527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfa3f7f4-bb07-4ce8-a7fe-398b516c97be tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.155301 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.155301 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.162932 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dfa3f7f4-bb07-4ce8-a7fe-398b516c97be tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.012103 Mar 26 20:50:03.163480 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 216/365] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:03.168438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fb3ad36-6c99-4c0d-95b1-1e1cd7854272 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-247326070"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.170685 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.170685 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.172045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.aggregate [None req-1fb3ad36-6c99-4c0d-95b1-1e1cd7854272 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid d8e39987-1a43-4038-bd1a-8fbd2bcfa028 for aggregate {{(pid=141581) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:03.200100 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fb3ad36-6c99-4c0d-95b1-1e1cd7854272 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034132 Mar 26 20:50:03.206928 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 217/366] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:03.219573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d52890a-3dab-4ae3-83bc-79095d32de7c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.226243 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.226243 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.288664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d52890a-3dab-4ae3-83bc-79095d32de7c tempest-AggregatesAdminTestJSON-1202903181 tempest-AggregatesAdminTestJSON-1202903181-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.078876 Mar 26 20:50:03.294148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 218/367] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:03.301365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0029529-a9b4-4e51-ac31-2321487ec084 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.305331 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.305331 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:03.306372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0029529-a9b4-4e51-ac31-2321487ec084 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.307933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0029529-a9b4-4e51-ac31-2321487ec084 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.308795 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0029529-a9b4-4e51-ac31-2321487ec084 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016248 Mar 26 20:50:03.309537 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 219/368] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:03.329201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.329866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.333502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.342911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f06ad8a0-0d13-4ead-b1ea-eaa9b1600e49 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.242015 Mar 26 20:50:03.344412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.344640 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 150/369] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:03.344889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.345712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.346159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.357470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.358063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.374150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.374607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.375415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.375861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.401403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] HTTP exception thrown: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. Mar 26 20:50:03.402705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Returning 404 to user: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.403722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a23ead00-1951-4271-b5ad-fef17a33da10 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 404 len: 111 microversion: 2.1 time: 0.057773 Mar 26 20:50:03.404638 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 151/370] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:03.412187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-701ecfd3-9563-44d5-8299-961b390bba38 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.413661 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.413661 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.443575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-701ecfd3-9563-44d5-8299-961b390bba38 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.037499 Mar 26 20:50:03.444378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 152/371] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:03.449501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.450107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] [instance: 07bf7261-e75c-434d-a249-8aef91e0e3b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.457509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.457964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.458895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.460155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.478434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] HTTP exception thrown: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. Mar 26 20:50:03.478968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] Returning 404 to user: Instance 07bf7261-e75c-434d-a249-8aef91e0e3b4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.479801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7748fb89-b0e2-4094-b1e8-b13716a5b473 tempest-AggregatesAdminTestJSON-2129611848 tempest-AggregatesAdminTestJSON-2129611848-project] 10.222.0.16 "GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4" status: 404 len: 111 microversion: 2.1 time: 0.034513 Mar 26 20:50:03.483267 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 153/372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/servers/07bf7261-e75c-434d-a249-8aef91e0e3b4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:03.485620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3082e92c-f32e-4f47-966f-bf0908ac9e56 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.486297 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.486297 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.498139 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3082e92c-f32e-4f47-966f-bf0908ac9e56 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 26 20:50:03.499321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3082e92c-f32e-4f47-966f-bf0908ac9e56 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.500378 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3082e92c-f32e-4f47-966f-bf0908ac9e56 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018759 Mar 26 20:50:03.501036 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 154/373] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:03.510832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f20ae24a-c713-4d1c-94ee-39a9e696c506 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-760481710"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.514649 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.514649 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.516370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-f20ae24a-c713-4d1c-94ee-39a9e696c506 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 1f74e6fe-91a4-4571-9f8f-2347e5bd02d1 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:03.541252 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f20ae24a-c713-4d1c-94ee-39a9e696c506 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034886 Mar 26 20:50:03.541961 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 155/374] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:50:03.546618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.547223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.553424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.553880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.555300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.555739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.622054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.632477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-223bcafe-1e94-49b2-b732-f069b277d598 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1275 microversion: 2.1 time: 0.088936 Mar 26 20:50:03.633274 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 156/375] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:03.638577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-93dac4b2-6b42-45bd-bc3f-af02c5e3b4c3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.639375 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.639375 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.640234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-93dac4b2-6b42-45bd-bc3f-af02c5e3b4c3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.640936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-93dac4b2-6b42-45bd-bc3f-af02c5e3b4c3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.641726 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-93dac4b2-6b42-45bd-bc3f-af02c5e3b4c3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.007389 Mar 26 20:50:03.644173 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 157/376] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:03.650572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41131adf-363d-47fa-b271-6b71af123e6a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.651493 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.651493 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.677022 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41131adf-363d-47fa-b271-6b71af123e6a tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.029622 Mar 26 20:50:03.677819 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 158/377] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 26 20:50:03.687269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17d551c3-fed2-4581-8739-69dda9af977c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.688154 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.688154 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.694229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-17d551c3-fed2-4581-8739-69dda9af977c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 26 20:50:03.694834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17d551c3-fed2-4581-8739-69dda9af977c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.695678 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17d551c3-fed2-4581-8739-69dda9af977c tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.012876 Mar 26 20:50:03.700931 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 159/378] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 20:50:03.706026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42f6ec0b-c4a5-4f88-a9b2-182e1b1ea1bd tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.707335 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.707335 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.708205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42f6ec0b-c4a5-4f88-a9b2-182e1b1ea1bd tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.708843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42f6ec0b-c4a5-4f88-a9b2-182e1b1ea1bd tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:03.709668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-42f6ec0b-c4a5-4f88-a9b2-182e1b1ea1bd tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007718 Mar 26 20:50:03.714943 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 160/379] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:03.721197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f83ec8eb-6aea-4b21-ab43-08a6f961d2eb tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-667126201"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.723311 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.723311 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.724771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-f83ec8eb-6aea-4b21-ab43-08a6f961d2eb tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 0499a706-f3fa-4b27-9d87-c14b922695ef for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:03.746406 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f83ec8eb-6aea-4b21-ab43-08a6f961d2eb tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029759 Mar 26 20:50:03.752021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 161/380] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:50:03.767995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61059387-6233-4e06-bd80-3a7eb5cabcd2 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.770145 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.770145 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.792867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61059387-6233-4e06-bd80-3a7eb5cabcd2 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.793607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61059387-6233-4e06-bd80-3a7eb5cabcd2 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.821941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.830801 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e985c67-60c6-41fd-825e-74e9ca10fedc tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.513604 Mar 26 20:50:03.832034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 220/381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:03.844394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:03.845054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:03.858688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.859426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.860519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.861145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.897844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:03.898455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:03.899164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lazy-loading 'fault' on Instance uuid ab40ed86-51b9-43e0-9212-b0e2abdbf719 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:03.976033 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61059387-6233-4e06-bd80-3a7eb5cabcd2 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.212075 Mar 26 20:50:03.980001 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 162/382] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:03.989189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e6f035306422cab01a0b1a2f5d635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2133fff60db4fe9bb0aa9bbb266e602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.992979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8eae6368-e03d-4707-93e9-b0716f4c8ab3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:03.996381 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:03.996381 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:03.998562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8eae6368-e03d-4707-93e9-b0716f4c8ab3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'df091ca34fce47c7a5f9e3efa9c8f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37576cbe4f749f89162f328e4429aec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:03.999381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8eae6368-e03d-4707-93e9-b0716f4c8ab3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:04.001134 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8eae6368-e03d-4707-93e9-b0716f4c8ab3 tempest-AggregatesAdminNegativeTestJSON-86966595 tempest-AggregatesAdminNegativeTestJSON-86966595-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017714 Mar 26 20:50:04.002088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 163/383] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:03 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:04.003201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec07d233-eb8b-4af0-bc33-abfb61232934 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 200 len: 1310 microversion: 2.1 time: 0.169154 Mar 26 20:50:04.013743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 221/384] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:03 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:04.023542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbbd87d9-b97a-4652-9638-818c140178e8 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:04.059684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbbd87d9-b97a-4652-9638-818c140178e8 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.059684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbbd87d9-b97a-4652-9638-818c140178e8 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.061914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.062919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:04.069856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.070309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.071085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.071524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.211742 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbbd87d9-b97a-4652-9638-818c140178e8 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.196719 Mar 26 20:50:04.212570 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 164/385] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:04 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:04.218753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.219430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:04.227908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.228407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.229194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.229639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.358496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.372886 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a42d5b8b-07df-46c1-99c9-ddb91efe2302 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1313 microversion: 2.1 time: 0.315207 Mar 26 20:50:04.382231 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 222/386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:04 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:04.382231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-117709c8-6a0b-4007-863e-526391e7d940 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.382231 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:04.382231 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:04.406053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-117709c8-6a0b-4007-863e-526391e7d940 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.031653 Mar 26 20:50:04.406887 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 223/387] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:04 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:04.416558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.417761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:04.426961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.427430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.428309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.429141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.438742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.449451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.451476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.453312 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4e90fd42-2f0c-4c1d-9691-877043a0b021 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.239739 Mar 26 20:50:04.454228 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 165/388] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:04 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:04.468820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8c443fba-bee7-42a5-8f17-55f57381c330 req-d0afa693-0e8c-4c86-8cc6-4f289e426b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab40ed86-51b9-43e0-9212-b0e2abdbf719", "name": "network-vif-deleted", "tag": "c66c8bf4-d08f-4509-bf2b-45e319b3aa79"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:04.478517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8c443fba-bee7-42a5-8f17-55f57381c330 req-d0afa693-0e8c-4c86-8cc6-4f289e426b0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.479273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8c443fba-bee7-42a5-8f17-55f57381c330 req-d0afa693-0e8c-4c86-8cc6-4f289e426b0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.491010 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8c443fba-bee7-42a5-8f17-55f57381c330 req-d0afa693-0e8c-4c86-8cc6-4f289e426b0c service nova] Creating event network-vif-deleted:c66c8bf4-d08f-4509-bf2b-45e319b3aa79 for instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 on nch1-master-1 Mar 26 20:50:04.496951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8c443fba-bee7-42a5-8f17-55f57381c330 req-d0afa693-0e8c-4c86-8cc6-4f289e426b0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041101 Mar 26 20:50:04.497616 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 166/389] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:04.502802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73ea7415-65df-4a7b-9665-6bbc519ca34e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1949986824"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:04.504554 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:04.504554 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:04.505445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-73ea7415-65df-4a7b-9665-6bbc519ca34e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Generated uuid 479634a1-f0d6-4da3-9090-66287976b303 for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 20:50:04.531526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73ea7415-65df-4a7b-9665-6bbc519ca34e tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032278 Mar 26 20:50:04.532348 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 167/390] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 20:50:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:04.541446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7712eb71-a3c6-4b78-9187-32e0dabecfa3 req-65f90695-64d8-4767-bb29-39dfc6f5f292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dea79e-7497-4064-8dbe-d3e455bf2830", "tag": "29aa9240-7fae-4127-aa8a-eca7df73d597"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:04.551134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7712eb71-a3c6-4b78-9187-32e0dabecfa3 req-65f90695-64d8-4767-bb29-39dfc6f5f292 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.551805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7712eb71-a3c6-4b78-9187-32e0dabecfa3 req-65f90695-64d8-4767-bb29-39dfc6f5f292 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.563768 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7712eb71-a3c6-4b78-9187-32e0dabecfa3 req-65f90695-64d8-4767-bb29-39dfc6f5f292 service nova] Creating event network-changed:29aa9240-7fae-4127-aa8a-eca7df73d597 for instance 13dea79e-7497-4064-8dbe-d3e455bf2830 on nch1-master-1 Mar 26 20:50:04.569962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7712eb71-a3c6-4b78-9187-32e0dabecfa3 req-65f90695-64d8-4767-bb29-39dfc6f5f292 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032029 Mar 26 20:50:04.571261 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 168/391] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:04.577701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:04.579932 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:04.579932 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:04.589103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.589710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.599039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.599494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.621648 ncdv-master-1 devstack@n-api.service[141580]: ERROR nova.api.openstack.compute.aggregates [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Mar 26 20:50:04.622300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Mar 26 20:50:04.622963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:04.623863 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a79847b-769d-48d7-932d-90c6811b94ab tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.051108 Mar 26 20:50:04.627896 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 169/392] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 20:50:04 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:04.633692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe52a8eb-7936-465e-bbb4-d06f69e2a091 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.634512 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:04.634512 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:04.663986 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe52a8eb-7936-465e-bbb4-d06f69e2a091 tempest-AggregatesAdminNegativeTestJSON-1998177940 tempest-AggregatesAdminNegativeTestJSON-1998177940-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.033658 Mar 26 20:50:04.664784 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 170/393] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:04 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 20:50:04.671969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.672739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:04.680463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.680915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.682344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.682790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.757795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.766301 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1adf1cff-5da4-4d28-988b-092729f771db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.358242 Mar 26 20:50:04.767981 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 224/394] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:04 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:04.780867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:04.788798 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38aee32f-1e20-43ab-ba1c-75e4d3928695 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1281 microversion: 2.1 time: 0.122716 Mar 26 20:50:04.789598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 171/395] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:04 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:04.849110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:04.849938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:04.857797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.858464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:04.859401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:04.859844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.020519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.021112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.027391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.027573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.028394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.028840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.052127 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. Mar 26 20:50:05.052746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:05.053604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ed32422-723b-45e5-bbda-d13fe02a0b8d tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 404 len: 111 microversion: 2.1 time: 0.037226 Mar 26 20:50:05.063698 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 172/396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:05.069194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.072806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.083788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.084952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.086311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.087073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.104118 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. Mar 26 20:50:05.104894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:05.105723 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-beb71f64-2753-4eb7-b9c1-50983d0f594c tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 404 len: 111 microversion: 2.1 time: 0.041288 Mar 26 20:50:05.107259 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 173/397] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:50:05 2022] DELETE /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:05.115904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.116993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: ab40ed86-51b9-43e0-9212-b0e2abdbf719] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.124856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.127152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.129356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.130075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.146844 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. Mar 26 20:50:05.148057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance ab40ed86-51b9-43e0-9212-b0e2abdbf719 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:05.149003 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ebd6da6-8820-44e8-a965-13267ab2e952 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719" status: 404 len: 111 microversion: 2.1 time: 0.038208 Mar 26 20:50:05.149835 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 174/398] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/ab40ed86-51b9-43e0-9212-b0e2abdbf719 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:50:05.164214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.176747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.185464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.185996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.186855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.187307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.203603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. Mar 26 20:50:05.204436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:05.204923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:05.206686 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9679b0e-5a61-4e61-96e3-872670fadde5 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 404 len: 111 microversion: 2.1 time: 0.051282 Mar 26 20:50:05.210568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 175/399] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:50:05 2022] DELETE /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:50:05.216502 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a77f457-99ae-41b6-9fcb-1d5b6911a74b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.367335 Mar 26 20:50:05.217141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.217916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] [instance: 181859d8-0ddb-4c1f-9071-f4ededc7db7d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.218696 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 225/400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:04 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:05.225648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.226281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.227893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.228379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.247270 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] HTTP exception thrown: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. Mar 26 20:50:05.248197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] Returning 404 to user: Instance 181859d8-0ddb-4c1f-9071-f4ededc7db7d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:05.250002 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa6bb2f8-0c91-441f-a7a7-0492fd359e15 tempest-DeleteServersAdminTestJSON-1904996273 tempest-DeleteServersAdminTestJSON-1904996273-project] 10.222.0.16 "GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d" status: 404 len: 111 microversion: 2.1 time: 0.038464 Mar 26 20:50:05.250554 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 176/401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/181859d8-0ddb-4c1f-9071-f4ededc7db7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:05.393240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.395072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.410648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.411561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.416872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.417495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.484192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.486540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.518444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.519745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.524548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.526463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.898931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:05.920593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:05.922127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:05.923448 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9de94666-2b06-439c-ac93-5ef344218cb0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.454530 Mar 26 20:50:05.924188 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 177/402] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:05.929318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.929930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:05.951535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.952281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.953077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:05.953529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:05.963608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:05.971176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-67a4c228-05be-43c7-8601-548d1f0a7ca3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1463 microversion: 2.1 time: 0.585183 Mar 26 20:50:05.971808 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 226/403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1463 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:05.986159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:05.989781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:06.032554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.032999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.034354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.034816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.283655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:06.294956 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2989079a-2da2-41d6-a2a1-5a86468e8688 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.368789 Mar 26 20:50:06.308110 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 178/404] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:06.316897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:06.317510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:06.339767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.344651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.345684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.347423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.426509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:06.434616 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae1772d8-a2b3-4217-9466-3475d7a505f1 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.454025 Mar 26 20:50:06.440724 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 227/405] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:05 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:06.448561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:06.449388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:06.463452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.464214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.465237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.465839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.608121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:06.622542 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9108107a-819e-4ce4-870f-850bbfb25b92 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1464 microversion: 2.1 time: 0.313451 Mar 26 20:50:06.623132 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 179/406] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:06 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:06.882729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:06.904362 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7e57f42-f5d6-474e-a3af-1641439dd2af tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.461727 Mar 26 20:50:06.905685 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 228/407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:06 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:06.942665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:06.943648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:06.962340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.962950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:06.963881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:06.964645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.043616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1718093245", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7681c708-82a7-4715-8408-9ff49d5039af"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:07.136626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:07.407109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:07.420377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:07.421905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:07.434635 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9f19979-3127-41c3-9b35-bd29f4997121 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1567 microversion: 2.25 time: 0.496410 Mar 26 20:50:07.447034 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 180/408] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:06 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1567 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:07.452823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:07.453610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:07.463967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.464633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.465446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.468215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.833580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:07.839130 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b6307c1c-ccd0-45a7-98bc-9a48e60a020c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.390779 Mar 26 20:50:07.853412 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 181/409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:07 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:07.866077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e88696cd-003f-499d-b9dc-6c135a630648 req-829d1cc1-75f5-4d37-a025-3cecc035ba09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee86b10-db16-45cd-8e59-65bc9b8ea9d5", "tag": "d936e69d-c8c8-4caa-b90c-1a76ded54906"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:07.883149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e88696cd-003f-499d-b9dc-6c135a630648 req-829d1cc1-75f5-4d37-a025-3cecc035ba09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.883579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e88696cd-003f-499d-b9dc-6c135a630648 req-829d1cc1-75f5-4d37-a025-3cecc035ba09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.895938 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e88696cd-003f-499d-b9dc-6c135a630648 req-829d1cc1-75f5-4d37-a025-3cecc035ba09 service nova] Creating event network-changed:d936e69d-c8c8-4caa-b90c-1a76ded54906 for instance dee86b10-db16-45cd-8e59-65bc9b8ea9d5 on nch1-master-1 Mar 26 20:50:07.902220 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e88696cd-003f-499d-b9dc-6c135a630648 req-829d1cc1-75f5-4d37-a025-3cecc035ba09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047949 Mar 26 20:50:07.902983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 182/410] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:07.903942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:07.904417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:07.904855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:07.905256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:07.905746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:07.911037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:07.911991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:07.920603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.920773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.921213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.921771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.922016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.922462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.923218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:07.923813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:07.966913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:07.975281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Getting quotas for user 35af62292f65400bb9626ea4e897fbd6 and project 9695bc9bf47e4da7bd4c4636a4900f72. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:07.995487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:07.998083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:08.082560 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a79321c6-b4b7-44b9-a73c-9ff41f6ccbe2 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041712 Mar 26 20:50:08.086896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 229/411] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:08.420190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:08.435161 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a11c3d9a-50f0-4dfa-b4a7-43bd2bcb12b6 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.530071 Mar 26 20:50:08.449895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 183/412] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:07 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:08.458510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:08.460405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:08.480828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.481881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:08.482720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.483244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:08.579522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:08.582743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.583540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:08.585487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.587691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:08.649777 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d29dc7a-7ceb-4c98-9c86-ce42b7dc0bdf tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.561195 Mar 26 20:50:08.651080 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 230/413] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Mar 26 20:50:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:08.661954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ae4f9ee-d82e-4bed-83da-7202f12a59a0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:08.663251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ae4f9ee-d82e-4bed-83da-7202f12a59a0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:08.784326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ae4f9ee-d82e-4bed-83da-7202f12a59a0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:08.797649 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ae4f9ee-d82e-4bed-83da-7202f12a59a0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1214 microversion: 2.1 time: 0.143973 Mar 26 20:50:08.812938 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 231/414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:08 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:08.812938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:08.812938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:08.832761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.835658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:08.837869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:08.839043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.045401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.053823 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bef4d57-4bf6-4de3-9588-348801163143 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.602290 Mar 26 20:50:09.054598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 184/415] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:08 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:09.059188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.060394 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:09.060394 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:09.061772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.063234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.064444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.065021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.094553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9baeb3b-870f-495c-89e8-716735a6d925 tempest-AZAdminV2TestJSON-521920524 tempest-AZAdminV2TestJSON-521920524-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.038659 Mar 26 20:50:09.102955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 185/416] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:09.108483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.109319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:09.116119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.116796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.117725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.118308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.223546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.238409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.243331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.245176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5310a8cf-381d-4b24-bf7b-f4d16efd0391 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1557 microversion: 2.25 time: 0.439437 Mar 26 20:50:09.247949 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 232/417] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:08 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1557 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:09.272185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08a10e20-01c3-4087-9697-54910b378246 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '.version_select at 0x7f6e59afda60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.274963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a10e20-01c3-4087-9697-54910b378246 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.280167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a10e20-01c3-4087-9697-54910b378246 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.312156 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08a10e20-01c3-4087-9697-54910b378246 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1768 microversion: 2.25 time: 0.047528 Mar 26 20:50:09.313267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 233/418] 10.222.0.16 () {60 vars in 1183 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/os-migrations => generated 1768 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:09.337529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.339272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:09.356912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.359009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.360882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.362805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.426138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.439131 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f853af7d-433c-4a2f-811c-c8cd962ba8ef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1476 microversion: 2.1 time: 0.334496 Mar 26 20:50:09.441341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 186/419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:09.454927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.461004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:09.478448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.481723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.483512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.485572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.804360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e5d38e4f-c583-4136-8c24-99e1f3d95bf7 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:09.825481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3d2dbe7-a4f4-447c-beb1-0158f6362c59 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 2049 microversion: 2.25 time: 0.504220 Mar 26 20:50:09.826372 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 234/420] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 2049 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:09.832190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:09.833000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:09.839070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.839731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.840782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:09.841361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:09.943285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:09.959208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a24b8de1-1bbf-45ee-a5a0-d6ad46ff3d5c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1274 microversion: 2.1 time: 0.128365 Mar 26 20:50:09.962440 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 235/421] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:10.071771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:10.072814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:10.083052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:10.084229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:10.086022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:10.090464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:10.349182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:10.366146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ee84197-58dc-469f-a0c2-bcb9fefd419b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.910976 Mar 26 20:50:10.367346 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 187/422] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:09 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:10.376123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1241926250", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b4f1069c-0aa3-4d88-b2ef-9a5c20f55049"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:10.441213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] validate_networks() for [('b4f1069c-0aa3-4d88-b2ef-9a5c20f55049', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:10.529136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:10.539798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9e55b18-7970-44d7-b827-ea826c4ed999 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 0.472151 Mar 26 20:50:10.540691 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 236/423] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:10 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:10.548880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:10.550389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:10.571207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:10.571776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:10.572720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:10.573266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:11.232406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:11.251025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c20cb2a0-32c3-4d8b-b7d6-01ed74010339 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1475 microversion: 2.1 time: 0.708773 Mar 26 20:50:11.256538 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 237/424] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:10 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:11.650664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aad5d2c2-bf10-4d39-876a-a5cf752ce946 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-704440281", "id": 1163608968, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:11.652376 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:11.652376 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:11.672608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aad5d2c2-bf10-4d39-876a-a5cf752ce946 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.414693 Mar 26 20:50:11.673302 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 238/425] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:50:11 2022] POST /compute/v2.1/flavors => generated 448 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:50:11.681713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:11.682474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:11.694294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:11.694760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:11.695727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:11.696201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:11.896554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:11.905111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c32e900c-bf5a-416a-a92b-fb7a6547c084 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.230622 Mar 26 20:50:11.905700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 239/426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:11 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:11.920931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:11.921780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:11.928161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:11.928623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:11.929406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:11.930024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:12.120538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:12.121898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:12.123258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:12.124652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:12.127256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:12.151972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:12.163819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:12.165023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:12.166019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:12.192227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:12.199505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for user 2bcd816c4f3a495cbe7ce636cf0e2f8a and project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:12.240826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:12.244629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:12.330152 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-35d6634c-93ef-4107-a152-a62c0ee0a758 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.961455 Mar 26 20:50:12.348416 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 188/427] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 20:50:12.353825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:12.354497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:12.370182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:12.370818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:12.371779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:12.372473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:12.488302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:12.496896 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e7889e29-aacb-4e5e-9871-2e8dbe134cea tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.580068 Mar 26 20:50:12.497494 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 240/428] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:11 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:12.956662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41f34669-6cd3-4895-ba2f-3af3200a893e tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:12.976438 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41f34669-6cd3-4895-ba2f-3af3200a893e tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] 10.222.0.16 "GET /compute/v2.1/flavors/1163608968" status: 200 len: 448 microversion: 2.55 time: 0.470257 Mar 26 20:50:12.980385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 241/429] 10.222.0.16 () {60 vars in 1198 bytes} [Sat Mar 26 20:50:12 2022] GET /compute/v2.1/flavors/1163608968 => generated 448 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:50:12.997595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "name": "network-vif-unplugged", "status": "completed", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:13.041150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.041609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.070144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] Creating event network-vif-unplugged:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch2-master-1 Mar 26 20:50:13.085813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] Instance ba79c797-f232-452e-bc13-7ce33ac926f0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:50:13.118017 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-649fb226-5c5f-473e-96f2-1d79661ba2c2 req-410276ae-010d-411d-bc5d-2be8b46ca6ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134739 Mar 26 20:50:13.118625 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 242/430] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:13.124212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:13.129300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:13.152771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.153486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.154448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.155299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.518907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:13.539450 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9133163b-7473-48d2-bd2e-0887a47395e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1475 microversion: 2.1 time: 0.419401 Mar 26 20:50:13.541115 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 243/431] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:13 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:13.555099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:13.555725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:13.608268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.609923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.614493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.616490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.664415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:13.674077 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-865b2074-5a15-45eb-b04d-b98f5528f560 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1504 microversion: 2.1 time: 1.324391 Mar 26 20:50:13.675570 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 189/432] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:12 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1504 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:13.694000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6bb1ba78-a532-41d3-8487-493852cb88c2 req-c1843ff7-7122-4573-b532-f3ca7e35685c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94f9a33-26ef-489d-8d73-aa5808fe755f", "tag": "d757af78-d01b-4df4-85a2-26137d1db01e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:13.714871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bb1ba78-a532-41d3-8487-493852cb88c2 req-c1843ff7-7122-4573-b532-f3ca7e35685c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.715528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bb1ba78-a532-41d3-8487-493852cb88c2 req-c1843ff7-7122-4573-b532-f3ca7e35685c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.744998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6bb1ba78-a532-41d3-8487-493852cb88c2 req-c1843ff7-7122-4573-b532-f3ca7e35685c service nova] Creating event network-changed:d757af78-d01b-4df4-85a2-26137d1db01e for instance b94f9a33-26ef-489d-8d73-aa5808fe755f on nch2-master-1 Mar 26 20:50:13.752242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6bb1ba78-a532-41d3-8487-493852cb88c2 req-c1843ff7-7122-4573-b532-f3ca7e35685c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070172 Mar 26 20:50:13.753066 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 190/433] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:13.758390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:13.764907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:13.781045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.781503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.782316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.782769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.820679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:13.850328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:13.856734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:13.862753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6030fb86-b3f3-492c-8fe8-6b0452145d26 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1314 microversion: 2.25 time: 0.317662 Mar 26 20:50:13.865211 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 244/434] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:13 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:13.876399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d2db79c-77c5-41b0-957e-16c809621dd4 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:13.903664 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:13.903664 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:13.952889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d2db79c-77c5-41b0-957e-16c809621dd4 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1163608968" status: 200 len: 449 microversion: 2.55 time: 0.085501 Mar 26 20:50:13.963168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 245/435] 10.222.0.16 () {62 vars in 1218 bytes} [Sat Mar 26 20:50:13 2022] PUT /compute/v2.1/flavors/1163608968 => generated 449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:50:13.971066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:13.974317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:13.988591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.989080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:13.990163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:13.990601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:14.223643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:14.236893 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-178ef1cd-f323-45d3-95e1-0f35d2847ebd tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.271055 Mar 26 20:50:14.249140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 246/436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:13 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:14.252762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-224ff6f8-3d18-4530-a1ca-ac8f8034b82b tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.302456 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-224ff6f8-3d18-4530-a1ca-ac8f8034b82b tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.058294 Mar 26 20:50:14.303785 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 247/437] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:50:14 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:14.319631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-845b361a-e535-4382-ab95-d0be5a96920f tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.352470 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-845b361a-e535-4382-ab95-d0be5a96920f tempest-FlavorsV255TestJSON-452133096 tempest-FlavorsV255TestJSON-452133096-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.037027 Mar 26 20:50:14.354313 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 248/438] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Mar 26 20:50:14 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:50:14.379000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a9e64b0-1d05-44a2-99b0-95cfbce43103 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.380776 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:14.380776 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:14.437270 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a9e64b0-1d05-44a2-99b0-95cfbce43103 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1163608968" status: 202 len: 0 microversion: 2.55 time: 0.073346 Mar 26 20:50:14.439140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 249/439] 10.222.0.16 () {60 vars in 1201 bytes} [Sat Mar 26 20:50:14 2022] DELETE /compute/v2.1/flavors/1163608968 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:14.449839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00d4d0fe-bb29-412e-9dfd-07ffe3130665 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.519222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00d4d0fe-bb29-412e-9dfd-07ffe3130665 tempest-FlavorsV255TestJSON-1375887112 tempest-FlavorsV255TestJSON-1375887112-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.074247 Mar 26 20:50:14.522169 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 250/440] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 20:50:14 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:14.556284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.557416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:14.568269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:14.568781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:14.569612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:14.574686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:14.650832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:14.659499 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85c8f9f1-3b3e-4b1d-8ec0-d4ac38db278a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.905080 Mar 26 20:50:14.672356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 191/441] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:13 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:14.694490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:14.695559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:14.704934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:14.709591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:14.710632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:14.712492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.012511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.025873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-313d2f1e-99e1-461e-a94b-6d86d64ccd00 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1475 microversion: 2.1 time: 0.473312 Mar 26 20:50:15.035406 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 251/442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:14 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1475 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:15.040452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:15.041069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:15.055512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.057092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.057965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.058338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.227294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.242471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.244985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.246958 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-006d9fd7-1e1d-48bb-b240-e4b46f149411 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1320 microversion: 2.25 time: 0.210454 Mar 26 20:50:15.248385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 252/443] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:15 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:15.256453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:15.274476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.274928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.301476 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] Creating event network-changed:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch2-master-1 Mar 26 20:50:15.308967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] Instance ba79c797-f232-452e-bc13-7ce33ac926f0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:50:15.324445 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3e7d2754-769f-49e7-aa80-e380db1cbd96 req-84e85c2a-14e8-4375-8892-231b9b2b5f26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074644 Mar 26 20:50:15.325228 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 253/444] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:15.351100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:15.352918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:15.370241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.370694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.372364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.374898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.665537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.679419 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af093402-b45d-4db1-97e1-2da08708bc0b tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.353063 Mar 26 20:50:15.680564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 254/445] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:15 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:15.685961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:15.689266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:15.696688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.697396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.698661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.700077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.772298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.780349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b567cf3-8d12-4126-9738-5101e4190082 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1494 microversion: 2.1 time: 1.090671 Mar 26 20:50:15.781434 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 192/446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:14 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1494 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:15.798507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00f7b9d1-8bbd-4c10-b845-f25fc025fc73 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '.version_select at 0x7f6e598ed040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:15.801695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00f7b9d1-8bbd-4c10-b845-f25fc025fc73 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.803267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00f7b9d1-8bbd-4c10-b845-f25fc025fc73 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.827112 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00f7b9d1-8bbd-4c10-b845-f25fc025fc73 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.032467 Mar 26 20:50:15.827977 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 193/447] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:50:15 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:15.857627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:15.861375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:15.878291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.878872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.881864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:15.885157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:15.961796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:15.971165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edd6237f-55c2-419f-8825-ac9dcda5f8b6 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.289403 Mar 26 20:50:15.980238 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 255/448] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:15 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:16.044026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:16.045134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:16.054465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.062531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.063462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.063832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.249862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:16.263170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f2611ba-2d7e-471b-840a-8a52c97a4c40 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1475 microversion: 2.1 time: 0.223876 Mar 26 20:50:16.273765 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 256/449] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:16 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1475 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:16.529607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7e12cef-f7ef-4742-a099-7d2228bbe92d tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1404572680", "id": 1021775560, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:16.531911 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:16.531911 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:16.551889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7e12cef-f7ef-4742-a099-7d2228bbe92d tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.276603 Mar 26 20:50:16.552851 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 257/450] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:16 2022] POST /compute/v2.1/flavors => generated 439 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:16.558349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:16.559339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:16.566333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.566975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.567944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.568566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.710353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:16.719006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:16.723792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:16.725750 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c0219971-f98d-46a2-970e-865befc3bba5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1320 microversion: 2.25 time: 0.171770 Mar 26 20:50:16.739695 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 258/451] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:16 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:16.759176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-175211f0-4023-4d97-adb2-6b05f43d310a tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:16.769526 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:16.769526 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:16.773586 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-254a7f82-9ff1-4547-80d8-867f3391c87c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1645 microversion: 2.1 time: 0.936254 Mar 26 20:50:16.776430 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 194/452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:15 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1645 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:16.787515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ecb1c0b3-8252-4583-ab04-925f17525dd1 req-e58ee566-e679-4926-b3f1-c5ed83293c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee86b10-db16-45cd-8e59-65bc9b8ea9d5", "name": "network-vif-plugged", "status": "completed", "tag": "d936e69d-c8c8-4caa-b90c-1a76ded54906"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:16.811830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ecb1c0b3-8252-4583-ab04-925f17525dd1 req-e58ee566-e679-4926-b3f1-c5ed83293c14 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.812350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ecb1c0b3-8252-4583-ab04-925f17525dd1 req-e58ee566-e679-4926-b3f1-c5ed83293c14 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.863947 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ecb1c0b3-8252-4583-ab04-925f17525dd1 req-e58ee566-e679-4926-b3f1-c5ed83293c14 service nova] Creating event network-vif-plugged:d936e69d-c8c8-4caa-b90c-1a76ded54906 for instance dee86b10-db16-45cd-8e59-65bc9b8ea9d5 on nch1-master-1 Mar 26 20:50:16.876077 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ecb1c0b3-8252-4583-ab04-925f17525dd1 req-e58ee566-e679-4926-b3f1-c5ed83293c14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098197 Mar 26 20:50:16.879450 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 195/453] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:16.893174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:16.895909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:16.913109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.916155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:16.917185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:16.918381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:17.160738 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-175211f0-4023-4d97-adb2-6b05f43d310a tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1021775560/action" status: 200 len: 97 microversion: 2.1 time: 0.419640 Mar 26 20:50:17.167643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 259/454] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:16 2022] POST /compute/v2.1/flavors/1021775560/action => generated 97 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:17.173207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:17.174033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:17.180914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:17.181688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:17.182616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:17.183259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:17.387528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:17.397474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3bd6e051-c447-4176-a7a3-7d3974470e0e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.228428 Mar 26 20:50:17.398382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 260/455] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:17 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:17.403471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1727010988", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3719dfee-4a50-4ee6-a6eb-866a85cdf502"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:17.469597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] validate_networks() for [('3719dfee-4a50-4ee6-a6eb-866a85cdf502', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:17.850335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:17.862297 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27e4c34c-c6fa-45ef-9e6b-cb8f750af88e tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1323 microversion: 2.1 time: 0.981263 Mar 26 20:50:17.863842 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 196/456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:16 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1323 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:17.871026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80536ee7-a4ab-4c95-9955-06972c51e791 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:17.873861 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:17.873861 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:17.961532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:17.961963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:17.962719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:17.963286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:17.963871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:17.977004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:17.977460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:17.978835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:17.979430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.001441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:18.010913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for user c9bd4f2793ec48a5b31d081c269a39c2 and project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:18.038124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:18.041192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:18.095181 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15c3d0d9-50fd-4c6a-8964-4edd251c0fa8 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695419 Mar 26 20:50:18.096627 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 261/457] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:18.101860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:18.102671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:18.109291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.109956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.110951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.111584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.173264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-80536ee7-a4ab-4c95-9955-06972c51e791 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project db166ab07bf64518be4f231ca4c864a8 combination. Mar 26 20:50:18.174646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80536ee7-a4ab-4c95-9955-06972c51e791 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project db166ab07bf64518be4f231ca4c864a8 combination. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:18.175654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80536ee7-a4ab-4c95-9955-06972c51e791 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1021775560/action" status: 409 len: 152 microversion: 2.1 time: 0.310452 Mar 26 20:50:18.176320 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 197/458] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:17 2022] POST /compute/v2.1/flavors/1021775560/action => generated 152 bytes in 312 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:18.186908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:18.187670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:18.195589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.196556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.197619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.198297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.288461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:18.298103 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33315bdd-76a1-4e1a-838c-4bd143811630 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1473 microversion: 2.1 time: 0.200264 Mar 26 20:50:18.298746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 262/459] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:18 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:18.315412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f180abf4-1b45-42ff-a5c2-916ade31e7ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:18.316651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f180abf4-1b45-42ff-a5c2-916ade31e7ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:18.381050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f180abf4-1b45-42ff-a5c2-916ade31e7ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:18.391216 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f180abf4-1b45-42ff-a5c2-916ade31e7ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1211 microversion: 2.1 time: 0.091066 Mar 26 20:50:18.391995 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 263/460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:18 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:18.406633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41012ad0-31cc-4698-9209-129eebcaf95c tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:18.408047 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:18.408047 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:18.776590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41012ad0-31cc-4698-9209-129eebcaf95c tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1021775560/action" status: 200 len: 21 microversion: 2.1 time: 0.383012 Mar 26 20:50:18.777320 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 264/461] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:18 2022] POST /compute/v2.1/flavors/1021775560/action => generated 21 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:18.787631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:18.789498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:18.804155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.805323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.807363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:18.808064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:18.851468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:18.867868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:18.875506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:18.876947 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-272545d0-90cd-4430-82e0-09a21bfffd74 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.698081 Mar 26 20:50:18.878410 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 198/462] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:18 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:18.906360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9585cbe-e6f3-4a73-829b-f01e1d3d3a4b tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:18.916190 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:18.916190 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:18.953966 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9585cbe-e6f3-4a73-829b-f01e1d3d3a4b tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1021775560" status: 202 len: 0 microversion: 2.1 time: 0.073328 Mar 26 20:50:18.956938 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 199/463] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:50:18 2022] DELETE /compute/v2.1/flavors/1021775560 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:19.144536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:19.152521 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88385e64-2f1d-4b13-8f66-e37458c88791 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.374058 Mar 26 20:50:19.156322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 265/464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:18 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.161611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.164885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.172772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.173438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.175283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.175908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.265552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59904dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.266661 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.266661 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:19.268723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.269997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.285272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.285859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.298180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.298982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.310703 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0ea207c-e123-4a53-bf85-9551aa3bd779 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.351580 Mar 26 20:50:19.314591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:19.318080 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 200/465] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:19.323845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0238d863-e8cb-43a3-b620-a58feb756833 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.324872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8833f21-ab6c-4526-96a5-03daccefd74d tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1473 microversion: 2.1 time: 0.167368 Mar 26 20:50:19.325666 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 266/466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.331544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-56bb37b5-8fc6-4f41-931a-ffd0544f9558 req-3d0f5a69-6855-4ee0-acd1-e4a6a7207598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f9a33-26ef-489d-8d73-aa5808fe755f", "name": "network-vif-plugged", "status": "completed", "tag": "d757af78-d01b-4df4-85a2-26137d1db01e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:19.340489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56bb37b5-8fc6-4f41-931a-ffd0544f9558 req-3d0f5a69-6855-4ee0-acd1-e4a6a7207598 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.341202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56bb37b5-8fc6-4f41-931a-ffd0544f9558 req-3d0f5a69-6855-4ee0-acd1-e4a6a7207598 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.349372 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0238d863-e8cb-43a3-b620-a58feb756833 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029972 Mar 26 20:50:19.350079 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 201/467] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.355029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.356371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.357666 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-56bb37b5-8fc6-4f41-931a-ffd0544f9558 req-3d0f5a69-6855-4ee0-acd1-e4a6a7207598 service nova] Creating event network-vif-plugged:d757af78-d01b-4df4-85a2-26137d1db01e for instance b94f9a33-26ef-489d-8d73-aa5808fe755f on nch2-master-1 Mar 26 20:50:19.365825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.366548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.367393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.368061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.377949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-56bb37b5-8fc6-4f41-931a-ffd0544f9558 req-3d0f5a69-6855-4ee0-acd1-e4a6a7207598 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050496 Mar 26 20:50:19.381576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 267/468] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:19.399272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59a7bee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.400287 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.400287 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:19.401615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.402070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.421519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.422079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.442763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.443222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.449889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71a6cd60-b659-479f-bdf4-74652c8b3b19 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.067109 Mar 26 20:50:19.459907 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 268/469] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.466038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.466868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.473933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.474645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.475448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.475890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.498707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:19.499437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:19.500314 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94da394c-7aca-431c-bfa6-f77663e7987f tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.039086 Mar 26 20:50:19.501021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 269/470] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5/diagnostics => generated 117 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:19.505913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-322e6bb7-2cce-4111-b080-41e41e108997 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1352852720", "id": 99431441, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:19.507608 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.507608 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:19.523521 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-322e6bb7-2cce-4111-b080-41e41e108997 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.021214 Mar 26 20:50:19.524057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 270/471] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:19 2022] POST /compute/v2.1/flavors => generated 432 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:19.528899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.529814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.536661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.537144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.537993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.538375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.615496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:19.622933 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36534fa5-740a-449f-bb77-d4f7d41dd99b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1281 microversion: 2.1 time: 0.097691 Mar 26 20:50:19.623505 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 271/472] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.627818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59ac7dc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.628639 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.628639 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:19.629782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.630233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.643257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.643715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.653946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.654397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.661146 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a888055a-ad84-432f-ab16-0e7d56263c6e tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.036650 Mar 26 20:50:19.661897 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 272/473] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:19.666225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.666722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.672696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.673155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.673932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.674965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.698831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:50:19.781559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4aac20c0-fe0d-446a-8bc0-1123c4daed71 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 204 len: 0 microversion: 2.1 time: 0.118206 Mar 26 20:50:19.782362 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 273/474] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:50:19 2022] DELETE /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:19.788046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35055581-4306-4065-a2dc-5aeeb32f3ea3 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.788896 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.788896 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:19.795682 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-35055581-4306-4065-a2dc-5aeeb32f3ea3 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] HTTP exception thrown: Access list not available for public flavors. Mar 26 20:50:19.796282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35055581-4306-4065-a2dc-5aeeb32f3ea3 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:19.797278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35055581-4306-4065-a2dc-5aeeb32f3ea3 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/99431441/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.014086 Mar 26 20:50:19.798249 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 274/475] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/flavors/99431441/os-flavor-access => generated 91 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:50:19.802787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59bef700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.803567 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.803567 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:19.804777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.805218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.819666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.820151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.829151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-193e5831-9850-41c3-a66d-9986b933cf5b tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.030332 Mar 26 20:50:19.829756 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 275/476] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:19.834393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.835225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:19.842639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.843095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.843879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:19.844348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:19.985925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:19.993974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db267a9c-8f12-4146-9dc4-28422d4fd6ce tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1479 microversion: 2.1 time: 0.163030 Mar 26 20:50:19.994560 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 276/477] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1479 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:19.998932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76197e7b-f45c-480f-865e-e3e269e9d13b tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:19.999744 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:19.999744 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:20.026986 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76197e7b-f45c-480f-865e-e3e269e9d13b tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/99431441" status: 202 len: 0 microversion: 2.1 time: 0.031348 Mar 26 20:50:20.027578 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 277/478] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:19 2022] DELETE /compute/v2.1/flavors/99431441 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:20.032299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-254e02cf-c02a-4d2a-b80f-2487f4faeb42 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59a7ba60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.033044 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.033044 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:20.034799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254e02cf-c02a-4d2a-b80f-2487f4faeb42 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.035258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254e02cf-c02a-4d2a-b80f-2487f4faeb42 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.052925 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-254e02cf-c02a-4d2a-b80f-2487f4faeb42 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 266 microversion: 2.1 time: 0.024261 Mar 26 20:50:20.053531 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 278/479] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 266 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:20.059103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.059103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:20.067391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.067848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.068672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.069119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.109318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.119138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7f3b32a1-f63e-42d4-a9df-45a37d0c6934 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1470 microversion: 2.1 time: 0.767986 Mar 26 20:50:20.119901 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 202/480] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:19 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1470 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:20.126254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-463f6172-d736-4d2d-9097-92923507fed7 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.145921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-463f6172-d736-4d2d-9097-92923507fed7 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024672 Mar 26 20:50:20.146516 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 203/481] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:20.153161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59c3a940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.153161 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.153161 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:20.153161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.153476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.170755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.171208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.181505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.181961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.187722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a9997b9-4042-4d6e-9ff2-9c7717e46e91 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040193 Mar 26 20:50:20.188343 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 204/482] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:20.199083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:20.199862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:20.208300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.209059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.210022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.210639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.230340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.239509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.241061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.242175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9de01fb9-fc08-4bc0-98ed-21e69c065bd3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.187717 Mar 26 20:50:20.242995 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 279/483] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:20.257791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4807b46-d941-4731-8101-be4ed5b3d5c4 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1498058162", "id": 1364533363, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:20.259328 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.259328 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:20.276190 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4807b46-d941-4731-8101-be4ed5b3d5c4 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.022559 Mar 26 20:50:20.276958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 280/484] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:20 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:20.285020 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85dfe23c-daf9-41b2-bda0-a90882c59c10 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0/action" status: 204 len: 0 microversion: 2.1 time: 0.093918 Mar 26 20:50:20.285814 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 205/485] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:20 2022] POST /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0/action => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:20.286368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.286987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:20.293032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.293637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.293834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59c3a3a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.294463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.294905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.295024 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.295024 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:20.296892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.297409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.318421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.319340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.326897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cff40f1e-5229-4b4a-9235-ce669615605f tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.036812 Mar 26 20:50:20.327512 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 206/486] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:20.514787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9847281a-1ff1-4ee0-8acb-791308126630 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:20.517014 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.517014 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:20.518939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9847281a-1ff1-4ee0-8acb-791308126630 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bf78f0ee921c46d48d8f7c436f29ed1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db166ab07bf64518be4f231ca4c864a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.520305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9847281a-1ff1-4ee0-8acb-791308126630 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:20.521435 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9847281a-1ff1-4ee0-8acb-791308126630 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] 10.222.0.16 "POST /compute/v2.1/flavors/1364533363/action" status: 403 len: 130 microversion: 2.1 time: 0.185059 Mar 26 20:50:20.522751 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 207/487] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:20 2022] POST /compute/v2.1/flavors/1364533363/action => generated 130 bytes in 195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:20.530748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.531558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:20.540037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.540577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.542543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.543018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.879886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:20.899427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a48120b2-8c04-4e94-b3c3-a63ebd295431 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1314 microversion: 2.1 time: 0.621514 Mar 26 20:50:20.900479 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 281/488] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:20.911667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59a47d30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.912732 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.912732 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:20.914200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.915189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.938975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:20.940459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:20.948343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e4c2e00-7396-4d1c-85e7-817fa32f1132 tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.046799 Mar 26 20:50:20.949570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 282/489] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:20.960659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae349582-65e2-4c87-a802-8eb031bb64d8 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.962906 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:20.962906 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:20.984865 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae349582-65e2-4c87-a802-8eb031bb64d8 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1364533363" status: 202 len: 0 microversion: 2.1 time: 0.033402 Mar 26 20:50:20.986015 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 283/490] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:50:20 2022] DELETE /compute/v2.1/flavors/1364533363 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:20.992258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:20.993453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:21.001239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.001935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.003532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.004206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.043883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:21.052347 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dad83e68-bfbd-44e9-bd30-742ca985e713 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1470 microversion: 2.1 time: 0.528412 Mar 26 20:50:21.056392 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 208/491] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1470 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:21.067403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1bd8ed5d-8cb6-416d-8be5-b63ebc23266f req-8a92ff59-dc15-47f6-853f-aa86841b3718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84a2e73-0c4f-4855-a4b0-1dfe9af6db24", "tag": "ae943f51-447b-434d-a20b-ea825ed34c1a"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:21.084893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1bd8ed5d-8cb6-416d-8be5-b63ebc23266f req-8a92ff59-dc15-47f6-853f-aa86841b3718 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.085321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1bd8ed5d-8cb6-416d-8be5-b63ebc23266f req-8a92ff59-dc15-47f6-853f-aa86841b3718 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.109883 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1bd8ed5d-8cb6-416d-8be5-b63ebc23266f req-8a92ff59-dc15-47f6-853f-aa86841b3718 service nova] Creating event network-changed:ae943f51-447b-434d-a20b-ea825ed34c1a for instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 on nch2-master-1 Mar 26 20:50:21.125170 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1bd8ed5d-8cb6-416d-8be5-b63ebc23266f req-8a92ff59-dc15-47f6-853f-aa86841b3718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067433 Mar 26 20:50:21.125784 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 209/492] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:21.130972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Calling method '.version_select at 0x7f6e59904f70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:21.145157 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:21.145157 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:21.146904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.147521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.158253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:21.162312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.162768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.171744 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71da8527-bd88-419d-8fe2-5e9ece16c2ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1269 microversion: 2.1 time: 0.181063 Mar 26 20:50:21.174768 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 284/493] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:20 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:21.185123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4adeb796-e7e4-4707-9c9c-cab402e8ebde tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:21.199317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.199774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.225208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4adeb796-e7e4-4707-9c9c-cab402e8ebde tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048059 Mar 26 20:50:21.227312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 285/494] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:21.233209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:21.234300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:21.235090 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b17d9c0a-34ed-4895-bfbf-ed343193024d tempest-HypervisorAdminTestJSON-1572130917 tempest-HypervisorAdminTestJSON-1572130917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.107715 Mar 26 20:50:21.235699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 210/495] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Mar 26 20:50:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:21.245857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f174b2d-ef61-4678-94cd-5502d71180e0 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1075746950", "id": 1065093921, "os-flavor-access:is_public": "False"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:21.247933 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:21.247933 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:21.248419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.249093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.251134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.251751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.278016 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f174b2d-ef61-4678-94cd-5502d71180e0 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036762 Mar 26 20:50:21.279158 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 211/496] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:21 2022] POST /compute/v2.1/flavors => generated 439 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:21.288156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:21.301134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:21.308577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.309084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.310123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:21.310775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:21.754709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:21.773909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2debd0e5-f893-4938-9544-59eb6b65e1d8 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1479 microversion: 2.1 time: 0.544775 Mar 26 20:50:21.774384 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 286/497] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:21 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1479 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:21.778981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-776b3c82-a7d2-4de1-9719-08d4a2c2c73d tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:21.781044 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:21.781044 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:22.112898 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-776b3c82-a7d2-4de1-9719-08d4a2c2c73d tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1065093921/action" status: 200 len: 97 microversion: 2.1 time: 0.335949 Mar 26 20:50:22.114815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 287/498] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:21 2022] POST /compute/v2.1/flavors/1065093921/action => generated 97 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:22.125419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:22.126285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:22.133788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.134551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:22.135706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.136329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:22.246407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:22.260667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:22.262452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:22.264698 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa082bef-3b77-4823-91f8-dec2aeee0ccc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.983753 Mar 26 20:50:22.265750 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 212/499] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:21 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:22.272026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:22.272835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:22.280257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.280946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:22.281988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.284127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:22.561563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:22.587181 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4b175bed-540e-46b0-be30-1d3fa4e703c7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1464 microversion: 2.1 time: 0.466002 Mar 26 20:50:22.587777 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 288/500] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:22 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1464 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:22.604655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-354305b7-0143-4d04-96b6-cd10f5822662 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:22.608154 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:22.608154 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:22.611772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-354305b7-0143-4d04-96b6-cd10f5822662 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bf78f0ee921c46d48d8f7c436f29ed1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db166ab07bf64518be4f231ca4c864a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:22.612822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-354305b7-0143-4d04-96b6-cd10f5822662 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:22.613689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-354305b7-0143-4d04-96b6-cd10f5822662 tempest-FlavorsAccessNegativeTestJSON-2135447584 tempest-FlavorsAccessNegativeTestJSON-2135447584-project] 10.222.0.16 "POST /compute/v2.1/flavors/1065093921/action" status: 403 len: 133 microversion: 2.1 time: 0.017837 Mar 26 20:50:22.614235 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 289/501] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:22 2022] POST /compute/v2.1/flavors/1065093921/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:22.633647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:22.634372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:22.650107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.650749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:22.651661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:22.652243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.363776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:23.378180 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-562f87a7-75d4-46f0-98af-b26e3dae7ccd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.754185 Mar 26 20:50:23.379318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 290/502] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:22 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:23.443976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:23.459541 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf12f988-3d40-49e6-84ee-427f9771206b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1470 microversion: 2.1 time: 1.192454 Mar 26 20:50:23.460173 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 213/503] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:22 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1470 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:23.487461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da200985-46ff-41a6-b518-b4dd03e41aed tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "db166ab07bf64518be4f231ca4c864a8"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:23.488866 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:23.488866 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:23.641144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da200985-46ff-41a6-b518-b4dd03e41aed tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1065093921/action" status: 200 len: 21 microversion: 2.1 time: 0.177011 Mar 26 20:50:23.642966 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 214/504] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:50:23 2022] POST /compute/v2.1/flavors/1065093921/action => generated 21 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:23.648454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:23.649495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:23.657709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.658912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.660271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.660724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.665734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:23.670078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'deleted': False, 'project_id': '6e8b97f48c9c407ca0d3bbed488586cb'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:23.682250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.683226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.684224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.684748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.697449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.698156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.698797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lazy-loading 'fault' on Instance uuid dee86b10-db16-45cd-8e59-65bc9b8ea9d5 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:23.768929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37247839208e40e7984349f36749bb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87bd15896c4325b42e8eff64041a63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:23.788661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dff5fd3e-443c-4e23-b38f-c5af38384a73 tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 200 len: 1313 microversion: 2.1 time: 0.144406 Mar 26 20:50:23.791726 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 215/505] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:23 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:23.808879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8f63cdb9-4a1a-42f0-89fa-0bc25697b26d req-3f4c532e-8c6a-4fc1-a2d5-20ddc169daaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee86b10-db16-45cd-8e59-65bc9b8ea9d5", "name": "network-vif-deleted", "tag": "d936e69d-c8c8-4caa-b90c-1a76ded54906"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:23.830583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f63cdb9-4a1a-42f0-89fa-0bc25697b26d req-3f4c532e-8c6a-4fc1-a2d5-20ddc169daaf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.841834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f63cdb9-4a1a-42f0-89fa-0bc25697b26d req-3f4c532e-8c6a-4fc1-a2d5-20ddc169daaf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.877786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8f63cdb9-4a1a-42f0-89fa-0bc25697b26d req-3f4c532e-8c6a-4fc1-a2d5-20ddc169daaf service nova] Creating event network-vif-deleted:d936e69d-c8c8-4caa-b90c-1a76ded54906 for instance dee86b10-db16-45cd-8e59-65bc9b8ea9d5 on nch1-master-1 Mar 26 20:50:23.886403 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc0587cc-f2a2-459d-a485-5ff214b78294 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.505191 Mar 26 20:50:23.887375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 291/506] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:23 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:23.902029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8f63cdb9-4a1a-42f0-89fa-0bc25697b26d req-3f4c532e-8c6a-4fc1-a2d5-20ddc169daaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107796 Mar 26 20:50:23.902770 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 216/507] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:23.912777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-166aa91b-2769-4363-918b-cecee2cccefc tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:23.916364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:23.917164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:23.917844 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:23.917844 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:23.928574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.930678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.931792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:23.932496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:23.970236 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-166aa91b-2769-4363-918b-cecee2cccefc tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1065093921" status: 202 len: 0 microversion: 2.1 time: 0.065814 Mar 26 20:50:23.971630 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 217/508] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:50:23 2022] DELETE /compute/v2.1/flavors/1065093921 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:23.982754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "name": "network-vif-plugged", "status": "completed", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:24.005185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.016025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.042334 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] Creating event network-vif-plugged:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch2-master-1 Mar 26 20:50:24.048980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] Instance ba79c797-f232-452e-bc13-7ce33ac926f0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:50:24.061076 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4f8ab3e0-3a24-450a-93fa-9f8d79cac07f req-8719ee2d-b093-474f-81ee-c332283b0257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087191 Mar 26 20:50:24.061684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 218/509] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:24.070370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:24.075276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'deleted': False} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:24.082957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.083405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.084232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.084666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.202690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:50:24.409996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:24.419647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:24.421210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:24.422384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d137cbaa-4895-4a6a-84d8-9b58339a04e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.525213 Mar 26 20:50:24.422971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 292/510] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:23 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:24.436484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6703be71-9dfd-420d-939e-da69c2953295 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:24.478322 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6703be71-9dfd-420d-939e-da69c2953295 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046341 Mar 26 20:50:24.490324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 293/511] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:24.492140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1fe1994f-151e-4161-8162-b72fa3981399 req-7b415eeb-2085-4734-9443-c0d23c65ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff44aab-d15a-47cd-a2d7-217166bc5e87", "tag": "3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:24.508464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1fe1994f-151e-4161-8162-b72fa3981399 req-7b415eeb-2085-4734-9443-c0d23c65ef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.512444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1fe1994f-151e-4161-8162-b72fa3981399 req-7b415eeb-2085-4734-9443-c0d23c65ef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.533137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1fe1994f-151e-4161-8162-b72fa3981399 req-7b415eeb-2085-4734-9443-c0d23c65ef12 service nova] Creating event network-changed:3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54 for instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 on nch1-master-1 Mar 26 20:50:24.548404 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1fe1994f-151e-4161-8162-b72fa3981399 req-7b415eeb-2085-4734-9443-c0d23c65ef12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062270 Mar 26 20:50:24.549566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 294/512] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:24.554560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:24.559001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:24.573910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.574371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.575161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.575606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.592455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:24.592931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:24.981266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:24.992090 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-712b5e97-2934-4e27-a801-7c9083ba4016 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.441284 Mar 26 20:50:25.013828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 295/513] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:24 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:25.019047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:25.023664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:25.052224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.054970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.056017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.059537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.399782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:25.409497 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d7fafa2-c768-4c61-9120-eda1c0b392d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1462 microversion: 2.1 time: 0.394472 Mar 26 20:50:25.410366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 296/514] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:25 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1462 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:25.415647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8a35e38-c594-4fd5-ad81-596c65e24d52 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1054519767", "id": 320239937, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:25.417624 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:25.417624 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:25.437682 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8a35e38-c594-4fd5-ad81-596c65e24d52 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025504 Mar 26 20:50:25.438570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 297/515] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:25.444209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:25.445499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] [instance: dee86b10-db16-45cd-8e59-65bc9b8ea9d5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:25.453420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.455817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.457271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.458294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.476099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] HTTP exception thrown: Instance dee86b10-db16-45cd-8e59-65bc9b8ea9d5 could not be found. Mar 26 20:50:25.477300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] Returning 404 to user: Instance dee86b10-db16-45cd-8e59-65bc9b8ea9d5 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:25.479349 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76ba928d-a6b7-404f-9118-ae1ad347e6aa tempest-ServerDiagnosticsNegativeTest-2071547026 tempest-ServerDiagnosticsNegativeTest-2071547026-project] 10.222.0.16 "GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5" status: 404 len: 111 microversion: 2.1 time: 0.039199 Mar 26 20:50:25.483736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 298/516] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:25 2022] GET /compute/v2.1/servers/dee86b10-db16-45cd-8e59-65bc9b8ea9d5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:25.490352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:25.491155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:25.498757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.500255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.501201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.502119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.606448 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1e2ed77d-413d-4414-af27-c35f74cdb5a3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12650 microversion: 2.1 time: 1.543059 Mar 26 20:50:25.607140 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 219/517] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Mar 26 20:50:24 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12650 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:50:25.613067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:25.615014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:25.645189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.652010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.655512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:25.656262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:25.727107 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d117ed3a-2d56-48d9-9e21-1de93465d768 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1613 microversion: 2.1 time: 0.241527 Mar 26 20:50:25.728717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 299/518] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:25 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1613 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:25.736882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c8aede3-0834-4e96-9b80-4d038927c914 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d299c856afa14e2eb152a3670d6533d0"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:25.742923 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:25.742923 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:26.096964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:26.108513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:26.110130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:26.112573 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2cb59723-5350-482e-9d47-512cf90f5745 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.503834 Mar 26 20:50:26.123469 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 220/519] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:25 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:26.129204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.133079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'deleted': False, 'project_id': '6e8b97f48c9c407ca0d3bbed488586cb'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:26.139723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.144741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.145946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.146580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.273742 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e4e552f-016c-4fdb-b406-a59a7b6031a2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=9695bc9bf47e4da7bd4c4636a4900f72" status: 200 len: 15 microversion: 2.1 time: 0.148649 Mar 26 20:50:26.284889 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 221/520] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/servers/detail?tenant_id=9695bc9bf47e4da7bd4c4636a4900f72 => generated 15 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:26.290587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27f7439d-3df5-49d8-8391-b959a03f41d4 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '.version_select at 0x7f6e59d020d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.295645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f7439d-3df5-49d8-8391-b959a03f41d4 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.296475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f7439d-3df5-49d8-8391-b959a03f41d4 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.311069 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27f7439d-3df5-49d8-8391-b959a03f41d4 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.025327 Mar 26 20:50:26.311675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 222/521] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:26.318779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.319555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:26.325795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.326713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.328039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.328636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.418260 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6c8aede3-0834-4e96-9b80-4d038927c914 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] HTTP exception thrown: Flavor access not found for 35 / d299c856afa14e2eb152a3670d6533d0 combination. Mar 26 20:50:26.418812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c8aede3-0834-4e96-9b80-4d038927c914 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Returning 404 to user: Flavor access not found for 35 / d299c856afa14e2eb152a3670d6533d0 combination. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:26.428649 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6c8aede3-0834-4e96-9b80-4d038927c914 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/320239937/action" status: 404 len: 124 microversion: 2.1 time: 0.694298 Mar 26 20:50:26.429245 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 300/522] 10.222.0.16 () {60 vars in 1196 bytes} [Sat Mar 26 20:50:25 2022] POST /compute/v2.1/flavors/320239937/action => generated 124 bytes in 700 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:26.436311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.447272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'tenant_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'deleted': False} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:26.459080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.460140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.461134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.461809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.500065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:50:26.556459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:26.563838 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6886b544-bc2a-4289-9fed-12f0d26a5dd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.250607 Mar 26 20:50:26.575503 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 223/523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:26.583285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-927311c2-9408-430b-98f5-c810233f7193 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.584613 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:26.584613 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:26.622245 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-927311c2-9408-430b-98f5-c810233f7193 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/320239937" status: 202 len: 0 microversion: 2.1 time: 0.044219 Mar 26 20:50:26.623582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 224/524] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:50:26 2022] DELETE /compute/v2.1/flavors/320239937 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:26.632272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1791147084", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:26.670957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:26.671407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:26.700037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:26.921324 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f86a910a-12a0-4edc-acd0-c8dc240d41ce tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9695bc9bf47e4da7bd4c4636a4900f72" status: 200 len: 4827 microversion: 2.1 time: 0.490566 Mar 26 20:50:26.922649 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 301/525] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9695bc9bf47e4da7bd4c4636a4900f72 => generated 4827 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:26.927539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6434c97f-9959-486d-82df-bf66ef7a5632 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:26.975990 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6434c97f-9959-486d-82df-bf66ef7a5632 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052047 Mar 26 20:50:26.987632 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 302/526] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:26.994208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.007828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'tenant_id': '6e8b97f48c9c407ca0d3bbed488586cb', 'deleted': False} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:27.015807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.017334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.017334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.018304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.309376 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-692086ae-4491-425e-8c9f-356df716064d tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e8b97f48c9c407ca0d3bbed488586cb" status: 200 len: 15 microversion: 2.1 time: 0.328130 Mar 26 20:50:27.310500 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 303/527] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 20:50:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e8b97f48c9c407ca0d3bbed488586cb => generated 15 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:27.316032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.316647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:27.326200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.326666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.327455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.327894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.500141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:27.515680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:27.518356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:27.521385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bb8ff181-796a-4aa6-aef8-cea033cce35c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.209047 Mar 26 20:50:27.522149 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 304/528] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:27 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:27.530143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c95fcf3e-9ac4-4b90-942c-4ebb22363c4f tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.532898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:27.533385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:27.533857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:27.534469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:27.535046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:27.535853 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c95fcf3e-9ac4-4b90-942c-4ebb22363c4f tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011386 Mar 26 20:50:27.537360 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 305/529] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Mar 26 20:50:27 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:27.546891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.547348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.550370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.552621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.557129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:27.559784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:27.578209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.580793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.583107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.584076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.600307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:27.609141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for user 4ef943b3272c48aa884a7ff4a7e854d0 and project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:27.639566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:27.647185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:27.741797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc39f729-be0d-4e22-9de4-d77b56dd21e1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116788 Mar 26 20:50:27.744804 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 225/530] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:27.750034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.751451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:27.760413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.761383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.762413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:27.763499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:27.775442 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08055c40-2355-4188-a8d5-ee585b836bb7 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 0 microversion: 2.1 time: 0.224951 Mar 26 20:50:27.776618 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 306/531] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:27 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:27.783668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f8c751d-7ede-47e1-9e30-5853060e8e72 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.786529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f8c751d-7ede-47e1-9e30-5853060e8e72 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:27.958728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f8c751d-7ede-47e1-9e30-5853060e8e72 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:27.966366 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f8c751d-7ede-47e1-9e30-5853060e8e72 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1213 microversion: 2.1 time: 0.188624 Mar 26 20:50:27.967154 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 307/532] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:27 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:27.988906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:27.991727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:28.001024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:28.022657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.023104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.028933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.029779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.226329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:50:28.360841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:28.369923 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcf1f8c6-1568-46dd-bab6-068d57a5ff1d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.623824 Mar 26 20:50:28.385948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2aeb08eb-a31d-48e8-ab11-1ba00bc600e0 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.417936 Mar 26 20:50:28.396411 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 226/533] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:27 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:28.397734 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 308/534] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Mar 26 20:50:27 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:28.418304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:28.424293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:28.443332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.444186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.445204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.445878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.541561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:28.543047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:28.555615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.557577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.560384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.561996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.593487 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84c296f9-8b6c-4d28-a286-33ddc52d45c1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 0 microversion: 2.1 time: 0.180453 Mar 26 20:50:28.594948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 227/535] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:28 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:28.615737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:28.618150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:28.629504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.630264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:28.631492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:28.632220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.047557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:29.058854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-679a83b1-697d-4de3-9747-b8e47b8e46f3 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1615 microversion: 2.1 time: 0.459749 Mar 26 20:50:29.060469 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 228/536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:28 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1615 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:29.066319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:29.067709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:29.073055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:29.074713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:29.076286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ba82d92-307f-40dc-b78e-ca35e1d3500e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.539160 Mar 26 20:50:29.092276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 309/537] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:28 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:29.103595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:29.105144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:29.120182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.120706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.121397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.122203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.123707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.124707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.128184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.128798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.375039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:29.387947 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bffd264b-ce8e-49d6-b3f3-a3a0bbeb7277 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1265 microversion: 2.1 time: 0.326070 Mar 26 20:50:29.399227 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 229/538] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:29 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:29.421133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:29.422032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:29.434360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.438579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.441628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.443825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.468693 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e169251-af86-4932-8f53-312250f28190 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1615 microversion: 2.1 time: 0.370484 Mar 26 20:50:29.483318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 310/539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:29 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1615 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:29.495204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:29.505280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:29.516818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.517602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.518740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.519439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.709275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:50:29.799144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-905b5ea9-c9c1-43f7-a15e-d6bca565e82e tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1973 microversion: 2.1 time: 0.312579 Mar 26 20:50:29.808737 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 311/540] 10.222.0.16 () {58 vars in 1189 bytes} [Sat Mar 26 20:50:29 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1973 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:29.830840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:29.840706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:50:29.857750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.858790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.865052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.865525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.918789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d02eed40-af8b-4b75-b871-845d96ea53b1 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.104222 Mar 26 20:50:29.919706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 312/541] 10.222.0.16 () {58 vars in 1195 bytes} [Sat Mar 26 20:50:29 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:29.938498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:29.946180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:29.964608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.967466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:29.970939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:29.973065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.013897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:30.029582 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b98f48d6-6e65-4e56-a98b-a6404aae3ef7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.618192 Mar 26 20:50:30.031284 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 230/542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:29 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:30.101137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:30.107006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:30.114842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.115620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.116687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.117279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.148354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07b34f1a-a3f1-48e5-aa38-620610d361ef tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 0 microversion: 2.1 time: 0.218238 Mar 26 20:50:30.153577 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 313/543] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:29 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:30.168718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:30.173010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:30.188295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.188914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.191602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.192214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.306883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:30.307559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:30.308489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:30.309103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:30.309742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:30.425793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:30.438309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.438788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.440196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.440621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.485046 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1bba2d8-de72-425b-8f81-5854e6c96c13 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 1068 microversion: 2.1 time: 0.328091 Mar 26 20:50:30.495259 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 314/544] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:30 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 1068 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 26 20:50:30.500324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:30.500916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:30.508554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.508945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.510555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.511018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.684126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:30.699694 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ee7b908e-e97b-41b0-816c-8c49da8fd2e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1271 microversion: 2.1 time: 0.210757 Mar 26 20:50:30.700773 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 315/545] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:30 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:30.716620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:30.718676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:30.738198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.739173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.740471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:30.741695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:30.772548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:30.786223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:30.789120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:30.790697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0725e02e-f3d9-4402-a823-5badd0b886e2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.697676 Mar 26 20:50:30.796580 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 231/546] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:30 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:50:31.046781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:31.047407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:31.060886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.061233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:31.066865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.068791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:31.194579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:31.212170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba4a1855-e7b5-4ffe-84a8-4ffdc4eb8f29 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.509625 Mar 26 20:50:31.219989 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 316/547] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:30 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:31.463122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:31.478051 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4842a729-e517-4050-be35-c42f3e7b7d9d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.435070 Mar 26 20:50:31.482215 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 232/548] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:31 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:31.717555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:31.718169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:31.728380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.728836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:31.730791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.731242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:31.819307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:31.820814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:31.835707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.836202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:31.839292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:31.844636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:32.941662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:32.947316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:32.961117 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46715d95-f6ce-43a6-870f-0a4416f86944 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 1.247328 Mar 26 20:50:32.961754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:32.966914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:32.969036 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b46464d2-18e8-4443-93de-6ec67e7d464c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 1.158148 Mar 26 20:50:32.971568 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 317/549] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:31 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:32.977421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:32.977645 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 233/550] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:31 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:50:32.979769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:32.987262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-acc87f72-a22e-4031-9e61-19c2cb29bb30 req-df9b6dcd-079e-4f6d-b360-222d7c6d1d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84a2e73-0c4f-4855-a4b0-1dfe9af6db24", "name": "network-vif-plugged", "status": "completed", "tag": "ae943f51-447b-434d-a20b-ea825ed34c1a"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:32.999892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.000469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.002149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.003727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.004941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-acc87f72-a22e-4031-9e61-19c2cb29bb30 req-df9b6dcd-079e-4f6d-b360-222d7c6d1d7f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.007632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-acc87f72-a22e-4031-9e61-19c2cb29bb30 req-df9b6dcd-079e-4f6d-b360-222d7c6d1d7f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.035036 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-acc87f72-a22e-4031-9e61-19c2cb29bb30 req-df9b6dcd-079e-4f6d-b360-222d7c6d1d7f service nova] Creating event network-vif-plugged:ae943f51-447b-434d-a20b-ea825ed34c1a for instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 on nch2-master-1 Mar 26 20:50:33.040744 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-acc87f72-a22e-4031-9e61-19c2cb29bb30 req-df9b6dcd-079e-4f6d-b360-222d7c6d1d7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061677 Mar 26 20:50:33.041780 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 234/551] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:33.049337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:33.050320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:33.060846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.062383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.063595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.067722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.374361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:33.383620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-340aadc0-fb07-4a3d-90b2-99fa8724e879 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.410687 Mar 26 20:50:33.384662 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 318/552] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:32 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:33.978799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:33.979429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:33.989911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.990340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:33.991133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:33.991577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:34.087518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.095108 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12b437cc-d94a-4199-ab7f-e75f6a63a119 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 1.051950 Mar 26 20:50:34.102924 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 235/553] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:33 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:34.116939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:34.117552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:34.127253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:34.127706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:34.128973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:34.129475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:34.294781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.304177 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a92c5b5b-feb8-45cf-9077-02ca8a428920 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.327569 Mar 26 20:50:34.307507 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 319/554] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:33 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:34.402150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:34.402850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:34.410052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:34.413635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:34.417452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:34.418036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:34.620091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.637313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.640783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.644696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9aa50b2-4891-48c7-9639-c4e172c19857 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1362 microversion: 2.25 time: 0.540586 Mar 26 20:50:34.648006 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 236/555] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:34 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:34.854332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:34.865703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55bdbd3d-eefe-4b3f-abac-08e1a1e56510 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.467258 Mar 26 20:50:34.866864 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 320/556] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:34 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:34.937652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6d1a6aca-7a36-4829-97a0-2db1c1e0dd8f req-2c7bd04a-0c97-407d-9b29-2c18e2f6347a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946921b2-6fe2-4057-9572-adb926bd277d", "tag": "45b38ca2-4fe0-430a-bebd-437115db1ae6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:34.958793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6d1a6aca-7a36-4829-97a0-2db1c1e0dd8f req-2c7bd04a-0c97-407d-9b29-2c18e2f6347a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:34.961054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6d1a6aca-7a36-4829-97a0-2db1c1e0dd8f req-2c7bd04a-0c97-407d-9b29-2c18e2f6347a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.011322 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6d1a6aca-7a36-4829-97a0-2db1c1e0dd8f req-2c7bd04a-0c97-407d-9b29-2c18e2f6347a service nova] Creating event network-changed:45b38ca2-4fe0-430a-bebd-437115db1ae6 for instance 946921b2-6fe2-4057-9572-adb926bd277d on nch1-master-1 Mar 26 20:50:35.032112 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6d1a6aca-7a36-4829-97a0-2db1c1e0dd8f req-2c7bd04a-0c97-407d-9b29-2c18e2f6347a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098320 Mar 26 20:50:35.034274 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 237/557] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:35.119217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:35.120401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:35.144494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:35.144707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a3774235-ef9d-4883-8c0d-2b39738f4d25 req-44425b70-0764-4e98-9e17-51cec41e80be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff44aab-d15a-47cd-a2d7-217166bc5e87", "name": "network-vif-plugged", "status": "completed", "tag": "3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:35.145824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.147144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:35.151025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.174360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a3774235-ef9d-4883-8c0d-2b39738f4d25 req-44425b70-0764-4e98-9e17-51cec41e80be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:35.174823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a3774235-ef9d-4883-8c0d-2b39738f4d25 req-44425b70-0764-4e98-9e17-51cec41e80be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.224531 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a3774235-ef9d-4883-8c0d-2b39738f4d25 req-44425b70-0764-4e98-9e17-51cec41e80be service nova] Creating event network-vif-plugged:3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54 for instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 on nch1-master-1 Mar 26 20:50:35.236829 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a3774235-ef9d-4883-8c0d-2b39738f4d25 req-44425b70-0764-4e98-9e17-51cec41e80be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096219 Mar 26 20:50:35.239203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 238/558] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:35.323442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:35.324362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:35.346428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:35.346555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.347299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:35.347748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:35.962270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:35.979708 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6a4be0e9-1452-46bc-83c0-8e956798a0ea tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.862496 Mar 26 20:50:35.982323 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 321/559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:35 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:36.016452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:36.017646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:36.050136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.052682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.056555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.057075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.447292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:36.457508 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7ddd1b18-9021-4945-8200-f817898db826 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 1.138978 Mar 26 20:50:36.462018 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 239/560] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:35 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:50:36.474773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:36.475412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:36.490649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.493064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.494116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.494578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.575447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:36.590500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:36.592516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:36.601003 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1558 microversion: 2.25 time: 0.616379 Mar 26 20:50:36.602638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 322/561] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:35 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1558 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:36.603951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:36.614701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f907570-22ce-4db7-9f1e-08d68d26a5f8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010657 Mar 26 20:50:36.615562 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 323/562] 10.222.0.16 () {56 vars in 885 bytes} [Sat Mar 26 20:50:36 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 26 20:50:36.620561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:36.621442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:36.637275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.637737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.638540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:36.638981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:36.917218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:36.927221 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26ccd9a5-89f8-4a4f-a54d-5e73ed96b378 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.461907 Mar 26 20:50:36.929312 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 240/563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:36 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:37.026751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:37.063199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9426c931-b556-4c06-8b60-9d3f7f4c2ad6 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 2051 microversion: 2.25 time: 0.444662 Mar 26 20:50:37.063717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 324/564] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:36 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 2051 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:37.090887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:37.093619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:37.111821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.112506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.114455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.117396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.437835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29253ce4-f90c-4faa-865a-4d977534ac00 tempest-TenantUsagesNegativeTestJSON-1558023056 tempest-TenantUsagesNegativeTestJSON-1558023056-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-25T20%3A50%3A36.916943&end=2022-03-27T20%3A50%3A36.916943" status: 404 len: 112 microversion: - time: 0.506917 Mar 26 20:50:37.439748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 241/565] 10.222.0.16 () {58 vars in 1315 bytes} [Sat Mar 26 20:50:36 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-25T20%3A50%3A36.916943&end=2022-03-27T20%3A50%3A36.916943 => generated 112 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 26 20:50:37.450574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:37.452346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:37.459872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.460788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.465555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.466233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.726218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:37.735228 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04e43f03-9c1b-4a86-a8c7-9881d70cb59b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1311 microversion: 2.1 time: 0.663672 Mar 26 20:50:37.750237 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 325/566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:37 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1311 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:37.755846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c226980-3c95-4acf-bc0f-72bb288401b1 tempest-TenantUsagesNegativeTestJSON-1558023056 tempest-TenantUsagesNegativeTestJSON-1558023056-project-admin] Calling method '.version_select at 0x7f6e59b62ee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:37.763583 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0c226980-3c95-4acf-bc0f-72bb288401b1 tempest-TenantUsagesNegativeTestJSON-1558023056 tempest-TenantUsagesNegativeTestJSON-1558023056-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Mar 26 20:50:37.764949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c226980-3c95-4acf-bc0f-72bb288401b1 tempest-TenantUsagesNegativeTestJSON-1558023056 tempest-TenantUsagesNegativeTestJSON-1558023056-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:37.767954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c226980-3c95-4acf-bc0f-72bb288401b1 tempest-TenantUsagesNegativeTestJSON-1558023056 tempest-TenantUsagesNegativeTestJSON-1558023056-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/e30490816db249b9af0ffbe3b0feb51d?start=2022-03-27T20%3A50%3A36.916943&end=2022-03-25T20%3A50%3A36.916943" status: 400 len: 111 microversion: 2.1 time: 0.014980 Mar 26 20:50:37.770175 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 326/567] 10.222.0.16 () {58 vars in 1411 bytes} [Sat Mar 26 20:50:37 2022] GET /compute/v2.1/os-simple-tenant-usage/e30490816db249b9af0ffbe3b0feb51d?start=2022-03-27T20%3A50%3A36.916943&end=2022-03-25T20%3A50%3A36.916943 => generated 111 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:50:37.776497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:37.778335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:37.787274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.788426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.789469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:37.790181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:37.877605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:37.937566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61ee4229-b992-4568-a16a-e42270960f18 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 2051 microversion: 2.25 time: 0.496400 Mar 26 20:50:37.948372 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 242/568] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:37 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 2051 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:38.018138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2084151851", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "fed2fb0c-813c-401b-8a62-3a80e32e650c"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:38.077598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] validate_networks() for [('fed2fb0c-813c-401b-8a62-3a80e32e650c', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:38.278003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:38.302720 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-194b0c97-46b6-4fb2-9a28-1719e1c0ba3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.531106 Mar 26 20:50:38.303548 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 327/569] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:37 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:38.641664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af52ce78-3f42-4b4c-b60b-709cc7be4b2e tempest-TenantUsagesNegativeTestJSON-1115817995 tempest-TenantUsagesNegativeTestJSON-1115817995-project] Calling method '.version_select at 0x7f6e59b62700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:38.646018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af52ce78-3f42-4b4c-b60b-709cc7be4b2e tempest-TenantUsagesNegativeTestJSON-1115817995 tempest-TenantUsagesNegativeTestJSON-1115817995-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '9d4b5ce51a69447d9e623d33360d726b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30490816db249b9af0ffbe3b0feb51d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:38.646715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af52ce78-3f42-4b4c-b60b-709cc7be4b2e tempest-TenantUsagesNegativeTestJSON-1115817995 tempest-TenantUsagesNegativeTestJSON-1115817995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:38.647559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af52ce78-3f42-4b4c-b60b-709cc7be4b2e tempest-TenantUsagesNegativeTestJSON-1115817995 tempest-TenantUsagesNegativeTestJSON-1115817995-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-25T20%3A50%3A36.916943&end=2022-03-27T20%3A50%3A36.916943&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.342833 Mar 26 20:50:38.648298 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 328/570] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Mar 26 20:50:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-25T20%3A50%3A36.916943&end=2022-03-27T20%3A50%3A36.916943&detailed=1 => generated 123 bytes in 344 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:38.658841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:38.660706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:38.661644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:38.662221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:38.662811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:38.679176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:38.682362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:38.691576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.692092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.692968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.693416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.712830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.719245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.724560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.725021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.784476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Getting quotas for project 3aa6068dd8e94d7dbbd6dc1fcc7f236c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:38.798718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Getting quotas for user 19597b33d62b4218ad7117bd8a520522 and project 3aa6068dd8e94d7dbbd6dc1fcc7f236c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:38.826965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:38.829888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:38.884139 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d64af5b-e929-419b-ab8f-c769ca8e034d tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934313 Mar 26 20:50:38.891535 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 243/571] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:38.897766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:38.899622 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:38.899622 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:38.901423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.902174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.904725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.905258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.938241 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-255b29e8-f1ea-4180-b51c-9c22005ba120 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044169 Mar 26 20:50:38.940724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 244/572] 10.222.0.16 () {60 vars in 1216 bytes} [Sat Mar 26 20:50:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:50:38.946490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:38.949027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:38.959632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.960969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:38.961963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:38.962628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.201740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:39.212446 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6872821b-bc96-49da-9c0c-71268039061d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.561994 Mar 26 20:50:39.213324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 329/573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:38 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:39.218111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4855efe4-e549-4467-875d-1c4ba2dfdc61 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.218721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4855efe4-e549-4467-875d-1c4ba2dfdc61 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:39.306709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4855efe4-e549-4467-875d-1c4ba2dfdc61 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:39.314620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4855efe4-e549-4467-875d-1c4ba2dfdc61 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1218 microversion: 2.1 time: 0.100168 Mar 26 20:50:39.316595 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 330/574] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:39.328724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:39.329648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:39.341400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:39.343772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.344457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.345966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.348436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.350121 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8112b2b-d7c6-4453-8775-b66a14ab1ea1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1494 microversion: 2.1 time: 0.408111 Mar 26 20:50:39.350717 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 245/575] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:38 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:39.365315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.369402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:39.386484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.386951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.392310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.393215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.530153 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1e2cd5b-5ff2-4e15-8a82-825a354a2fb1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24/action" status: 202 len: 0 microversion: 2.25 time: 0.208372 Mar 26 20:50:39.532004 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 331/576] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:50:39 2022] POST /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:39.561667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.563119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:39.574314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.575029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.576354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:39.576952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:39.673203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:39.680954 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ed9a580-0856-46e2-99e1-b047c2e129b6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.324675 Mar 26 20:50:39.681833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 246/577] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:39.974993 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a318c884-b0ad-4c38-95c0-2e629c1fcfc2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1645 microversion: 2.1 time: 0.440310 Mar 26 20:50:39.975907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-adbd00f2-3dd8-4226-ae33-f27741177fba tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.976954 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 332/578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1645 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:39.989317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-adbd00f2-3dd8-4226-ae33-f27741177fba tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.305893 Mar 26 20:50:39.990174 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 247/579] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:39.992642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.993551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:39.996575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:39.997515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:40.002274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.002766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.004200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.004807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.005500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.005965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.006822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.007321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.200820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48600555-17d2-41a1-9cc3-abf5a9f4acf5 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1645 microversion: 2.1 time: 0.208854 Mar 26 20:50:40.202809 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 248/580] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1645 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:40.332639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:40.365237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b34ec634-af4f-41ef-ba8a-791ddddbc616 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 2036 microversion: 2.25 time: 0.385415 Mar 26 20:50:40.365868 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 333/581] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:39 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 2036 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:40.377653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:40.383849 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:40.383849 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:40.385389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.386035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.387811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.388818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.422396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df653fb3-093b-4e12-a4d2-29c43e752fe1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050847 Mar 26 20:50:40.423673 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 334/582] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:50:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:40.428921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:40.429948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:40.457997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.458816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.460116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.461184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.558867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e73777c-2f81-40bc-8f9a-2602c1fab7a3 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1737148830", "id": 409083189, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:40.560650 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:40.560650 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:40.592517 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e73777c-2f81-40bc-8f9a-2602c1fab7a3 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.387847 Mar 26 20:50:40.593669 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 249/583] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:40 2022] POST /compute/v2.1/flavors => generated 422 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:40.603823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:40.604731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:40.616479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.617211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.620523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.622851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.788924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:40.800804 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31eaa449-7d97-48cf-8b12-9488284ee9bd tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1288 microversion: 2.1 time: 0.203160 Mar 26 20:50:40.803170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 250/584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:40 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1288 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:40.815903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:40.819450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:40.819756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:40.833223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.833691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.834405 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-326eed3f-4867-4996-8df5-cde5d762e04c tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1472 microversion: 2.1 time: 0.409268 Mar 26 20:50:40.834558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.834922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.835346 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 335/585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:40 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:40.850597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:40.851576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:40.859069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.859790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.860914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:40.861540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:40.881286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'flavor' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:40.918086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Going to try to live migrate instance to nch1-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:50:40.975840 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e03b8a7a-af4e-4b55-8b19-32a79a58063d tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87/action" status: 202 len: 0 microversion: 2.1 time: 0.136170 Mar 26 20:50:40.983587 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 336/586] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:40 2022] POST /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:40.990404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a20c385a-62c6-4796-8aaa-2713afc9ea3b tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:41.002509 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a20c385a-62c6-4796-8aaa-2713afc9ea3b tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015989 Mar 26 20:50:41.005116 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 337/587] 10.222.0.16 () {58 vars in 1181 bytes} [Sat Mar 26 20:50:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:41.019892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:41.023183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:41.051228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.051764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:41.054082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.054553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:41.430599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:41.442870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4dddfe83-e038-4a81-b979-c983c4100594 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.436462 Mar 26 20:50:41.445497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 338/588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:41 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:41.452089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:41.464600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:41.472495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.473202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:41.474179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.481785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:41.781947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3aa403c-9e6b-49a4-999d-15d2678e2ea3 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1630 microversion: 2.1 time: 0.332474 Mar 26 20:50:41.783383 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 339/589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:41 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1630 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:41.797397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c16e6580-3c0a-451b-acc6-1180a112792b tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1807091095", "id": 1908811229, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:41.799829 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:41.799829 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:41.839139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c16e6580-3c0a-451b-acc6-1180a112792b tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.053084 Mar 26 20:50:41.840638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 340/590] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:41 2022] POST /compute/v2.1/flavors => generated 425 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:41.855505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:41.857398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:41.900504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.901093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:41.902183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:41.902492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:42.070028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lazy-loading 'flavor' on Instance uuid 3ff44aab-d15a-47cd-a2d7-217166bc5e87 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:50:42.175478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Going to try to live migrate instance to nch2-master-1 {{(pid=141581) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:50:43.329409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-143b1de1-ba43-45f2-92ad-48a8f38668a8 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24/action" status: 202 len: 0 microversion: 2.25 time: 2.524863 Mar 26 20:50:43.333165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 251/591] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:50:40 2022] POST /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24/action => generated 0 bytes in 2526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:50:43.335043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:43.335668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:43.342922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:43.343369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:43.344240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:43.344852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:43.972709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:43.986484 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a275b9c5-c660-49f4-a4ef-a4bf3a14ae70 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.652611 Mar 26 20:50:43.998211 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 252/592] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:43 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:44.025739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:44.026970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:44.039140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.040227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.041175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.042294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.473347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:44.483382 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fdc0f55a-0d77-4c77-be68-ec19d84b9029 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.483774 Mar 26 20:50:44.492548 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 253/593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:43 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:44.500220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-71a1569d-19e4-4240-961d-638d08f39352 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:44.512555 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-71a1569d-19e4-4240-961d-638d08f39352 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017740 Mar 26 20:50:44.513149 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 254/594] 10.222.0.16 () {58 vars in 1181 bytes} [Sat Mar 26 20:50:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:44.687316 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25110546-66b3-47e8-b404-1f3ece50bee2 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87/action" status: 202 len: 0 microversion: 2.1 time: 2.842161 Mar 26 20:50:44.689316 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 341/595] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:41 2022] POST /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87/action => generated 0 bytes in 2848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:44.695826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:44.702434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:44.726510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.728990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.730112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.733558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.870260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59cd7310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:44.872963 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:44.872963 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:44.874762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.875380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.877454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.878190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.911287 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73036093-8bad-4d1f-92ca-cd017cf5cb2d tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.394006 Mar 26 20:50:44.912747 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 255/596] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:50:44 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:44.919219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-160f2e4e-c127-4555-a119-e34fedde152a req-d49a0567-535e-4f47-b6ff-fa33f4e3c6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c", "tag": "7f9dbd4b-d061-4ca4-82e6-42454e573a0d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:44.930261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-160f2e4e-c127-4555-a119-e34fedde152a req-d49a0567-535e-4f47-b6ff-fa33f4e3c6ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.931045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-160f2e4e-c127-4555-a119-e34fedde152a req-d49a0567-535e-4f47-b6ff-fa33f4e3c6ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.947283 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-160f2e4e-c127-4555-a119-e34fedde152a req-d49a0567-535e-4f47-b6ff-fa33f4e3c6ba service nova] Creating event network-changed:7f9dbd4b-d061-4ca4-82e6-42454e573a0d for instance 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c on nch1-master-1 Mar 26 20:50:44.954488 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-160f2e4e-c127-4555-a119-e34fedde152a req-d49a0567-535e-4f47-b6ff-fa33f4e3c6ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039814 Mar 26 20:50:44.956053 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 256/597] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:44.961759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:44.963617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:44.985778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.987061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:44.989540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:44.990296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.148543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:45.180862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f3f688c-eda5-4ca0-af34-bbece16b0609 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.489785 Mar 26 20:50:45.194289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 342/598] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:44 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:45.223651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Action: 'create', calling method: .version_select at 0x7f6e597cab80>, body: {"keypair": {"name": "tempest-keypair-1724354145"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:45.243145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for project c71abac018054ac59df8204f06278c20. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:45.259483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for user f730effcbf03473fbdb527fa499ec181 and project c71abac018054ac59df8204f06278c20. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:45.470823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:45.478930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:45.480488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:45.481669 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f54c7b7e-0065-4303-8196-e3b9e2dfa647 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.524181 Mar 26 20:50:45.482240 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 257/599] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:44 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:45.509002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:45.509632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:45.527632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.528127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.528937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.529739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.566613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for project c71abac018054ac59df8204f06278c20. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:45.572552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for user f730effcbf03473fbdb527fa499ec181 and project c71abac018054ac59df8204f06278c20. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:45.589369 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8419d9f-dbd2-4764-95b9-622ed9f455d5 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.393428 Mar 26 20:50:45.591381 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 343/600] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:50:45 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:45.606079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e596f69d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:45.608988 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:45.608988 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:45.625161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.629350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.630834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.632922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.677672 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e45b4d54-393f-48c5-9549-3f1ea4d36afd tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.076383 Mar 26 20:50:45.678610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 344/601] 10.222.0.16 () {58 vars in 1138 bytes} [Sat Mar 26 20:50:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:45.683287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:45.684810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:45.691821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.693481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.696064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:45.696703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:45.977524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:45.993858 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-216cede8-4c3b-430d-93e8-3fe678d47781 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.313999 Mar 26 20:50:45.994647 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 345/602] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:45 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:46.001934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a1ebe61d-500e-468d-9e3c-577a6e75aa57 req-52c7241c-b996-4587-9a68-90c50dd94b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946921b2-6fe2-4057-9572-adb926bd277d", "name": "network-vif-plugged", "status": "completed", "tag": "45b38ca2-4fe0-430a-bebd-437115db1ae6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:46.039056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a1ebe61d-500e-468d-9e3c-577a6e75aa57 req-52c7241c-b996-4587-9a68-90c50dd94b1b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.039595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a1ebe61d-500e-468d-9e3c-577a6e75aa57 req-52c7241c-b996-4587-9a68-90c50dd94b1b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.056230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a1ebe61d-500e-468d-9e3c-577a6e75aa57 req-52c7241c-b996-4587-9a68-90c50dd94b1b service nova] Creating event network-vif-plugged:45b38ca2-4fe0-430a-bebd-437115db1ae6 for instance 946921b2-6fe2-4057-9572-adb926bd277d on nch1-master-1 Mar 26 20:50:46.061689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a1ebe61d-500e-468d-9e3c-577a6e75aa57 req-52c7241c-b996-4587-9a68-90c50dd94b1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065588 Mar 26 20:50:46.062729 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 346/603] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:46.069093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.069879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:46.091419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.093036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.093946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.094397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.419210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:46.427068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:46.428648 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5eb1393e-098b-4868-a1d1-53ee08753e62 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 0.923304 Mar 26 20:50:46.432844 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 258/604] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:45 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:46.438585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59748160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.440263 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:46.440263 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:46.442042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.442704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.444928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.445730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.450270 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bf084696-4e5e-43a5-afd4-75d524721217 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.386081 Mar 26 20:50:46.453130 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 347/605] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:46.460515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.461200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:46.470916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.471367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.472615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.473106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.490842 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-029ce8c6-822d-4006-96d7-bd269bdb01bf tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056170 Mar 26 20:50:46.492880 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 259/606] 10.222.0.16 () {58 vars in 1144 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:50:46.511259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.513610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:46.520901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.521655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.522604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.523088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.779326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:46.787754 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10932fb6-d66e-44ae-8186-0de4d9088569 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1313 microversion: 2.1 time: 0.333507 Mar 26 20:50:46.791139 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 348/607] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:46.803680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59cff8b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.806528 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:46.806528 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:46.810337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.811102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.812289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.815366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.864378 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e90027f5-667f-477a-aa9c-41c11b0f8612 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.071872 Mar 26 20:50:46.865225 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 349/608] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:46.874905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59aec3a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.877663 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:46.877663 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:46.885582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.886300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.887524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.888218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.925716 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1567e2d8-78d8-49dc-8a10-90c26cee8de3 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.054573 Mar 26 20:50:46.930175 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 350/609] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:50:46.942917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59ecb430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:46.944219 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:46.944219 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:46.947416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.950867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:46.950867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:46.950867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.003623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:47.015726 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a183272e-b361-4a1a-8630-5ca5d8b109ec tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.077032 Mar 26 20:50:47.016952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 351/610] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:47.027291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:47.027291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:47.029058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:47.030739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:47.039217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d04298df-ad68-4b0e-ad1a-32c4148a5582 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.539568 Mar 26 20:50:47.040087 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 260/611] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:46 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:47.042123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.045231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.046195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.048946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.052207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e5972c4c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:47.053299 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:47.053299 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:47.067559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.068408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.100975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.103033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.164281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-57a95de4-5a6d-42c4-8ab1-74114726b5b8 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.122809 Mar 26 20:50:47.165229 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 261/612] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:50:47 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 860 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:47.174962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Calling method '.version_select at 0x7f6e59870700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:47.176087 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:47.176087 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:47.182730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.183505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.199776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.208894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.248378 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de50f561-3978-4eea-80cc-5474955a3567 tempest-HostsAdminTestJSON-1857702213 tempest-HostsAdminTestJSON-1857702213-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 860 microversion: 2.1 time: 0.077382 Mar 26 20:50:47.253087 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 262/613] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:50:47 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 860 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:50:47.447486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:47.448769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:47.461425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.464742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.466031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.470978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:47.479417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.481879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32ab781a-6f0b-47e5-bce6-c0e396f09693 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.459737 Mar 26 20:50:47.482492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 352/614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:47 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:47.503485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:47.513899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:47.535402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.536193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.537070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:47.546325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:47.995787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:48.005200 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fe8c5c32-eec9-4700-9326-17aba44823a5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.521626 Mar 26 20:50:48.018539 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 353/615] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:47 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:48.033245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-502317aa-acee-463a-a010-84bbc2873b4c req-19ad6b6c-8f34-4951-8628-338c37bc8b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84a2e73-0c4f-4855-a4b0-1dfe9af6db24", "name": "network-vif-unplugged", "status": "completed", "tag": "ae943f51-447b-434d-a20b-ea825ed34c1a"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:48.053481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-502317aa-acee-463a-a010-84bbc2873b4c req-19ad6b6c-8f34-4951-8628-338c37bc8b01 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.060647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-502317aa-acee-463a-a010-84bbc2873b4c req-19ad6b6c-8f34-4951-8628-338c37bc8b01 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.078739 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-502317aa-acee-463a-a010-84bbc2873b4c req-19ad6b6c-8f34-4951-8628-338c37bc8b01 service nova] Creating event network-vif-unplugged:ae943f51-447b-434d-a20b-ea825ed34c1a for instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 on nch2-master-1 Mar 26 20:50:48.096295 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-502317aa-acee-463a-a010-84bbc2873b4c req-19ad6b6c-8f34-4951-8628-338c37bc8b01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076093 Mar 26 20:50:48.097577 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 354/616] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:48.109485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:48.111085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:48.123843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.128043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.129279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.129991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.551694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:48.567980 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7279de49-d073-4169-ba3c-3eed2be88a30 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1463 microversion: 2.1 time: 0.468934 Mar 26 20:50:48.577077 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 355/617] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:48 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:48.583735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:48.584795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:48.593276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.594044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.596100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.597066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.832769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:48.853189 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a742ef31-64ab-4c4c-92bc-3c57964c6085 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 1.410170 Mar 26 20:50:48.854672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 263/618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:47 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:48.865177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7a547c06-57b6-488b-be04-62a8d1da47bc req-aed5325d-7291-42de-b218-69a0a386e44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-unplugged", "status": "completed", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:48.902740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7a547c06-57b6-488b-be04-62a8d1da47bc req-aed5325d-7291-42de-b218-69a0a386e44b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:48.906850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7a547c06-57b6-488b-be04-62a8d1da47bc req-aed5325d-7291-42de-b218-69a0a386e44b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:48.966219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7a547c06-57b6-488b-be04-62a8d1da47bc req-aed5325d-7291-42de-b218-69a0a386e44b service nova] Creating event network-vif-unplugged:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:50:48.984067 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7a547c06-57b6-488b-be04-62a8d1da47bc req-aed5325d-7291-42de-b218-69a0a386e44b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121753 Mar 26 20:50:48.987515 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 264/619] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:49.003156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:49.003878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:49.008996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:49.030458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:49.038404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.038939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:49.039823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.040315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:49.043057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:49.044435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-293b8aef-6907-4930-b3a5-64197f0e987d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.465124 Mar 26 20:50:49.048813 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 356/620] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:48 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:49.063283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:49.064725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:49.072795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.073608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:49.074614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.075524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:49.231802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:49.248171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Old instance type m1.heat2, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 20:50:49.265706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:49.266147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:49.272509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:49.273042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:49.273492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:49.564391 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b74f6b4-eddd-433c-9ae4-538a2afc951b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d/action" status: 202 len: 0 microversion: 2.1 time: 0.506413 Mar 26 20:50:49.565373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 357/621] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:50:49 2022] POST /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:50:49.579401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:49.583892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:49.605789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.606259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:49.620391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:49.621101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:50.191434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:50.219630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcb22bef-f132-499f-a23c-272bf6723afb tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.651104 Mar 26 20:50:50.220955 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 358/622] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:49 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:50.238075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:50.238946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:50.256816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:50.261203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:50.264259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:50.264826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:50.456427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:50.462965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:50.466475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e165744c-3777-4287-a21e-746f158a9fea tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1472 microversion: 2.1 time: 0.244031 Mar 26 20:50:50.467481 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 359/623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:50 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:50.473849 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1366112a-d9be-4482-9539-0751fd142cf3 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 1.484508 Mar 26 20:50:50.474490 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 265/624] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:48 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:50.475886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2008783449", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "1908811229", "adminPass": "***", "networks": [{"uuid": "f8ad645e-691e-4200-a0a6-1147f6f8ec71"}], "security_groups": [{"name": "tempest-securitygroup--1013381703"}], "key_name": "tempest-keypair-1724354145", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:50.490050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:50.490980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:50.515062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:50.517081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:50.518685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:50.519455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:50.651818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] validate_networks() for [('f8ad645e-691e-4200-a0a6-1147f6f8ec71', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:50:51.131012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:51.152198 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7f3212f4-c0a8-47e6-bd9c-8190b60da386 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 0.653697 Mar 26 20:50:51.176324 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 266/625] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:50 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:51.184684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:51.197264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:51.212457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.214256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.215947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.217413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.495287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:50:51.495791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:50:51.496215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:50:51.496631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:50:51.497058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:50:51.511220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.512609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.514614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.515951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.546232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for project c71abac018054ac59df8204f06278c20. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:50:51.554229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for user f730effcbf03473fbdb527fa499ec181 and project c71abac018054ac59df8204f06278c20. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:50:51.573410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:50:51.577603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:50:51.657873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef23b9e8-f41c-49a2-a63f-0a4c8928149c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.188014 Mar 26 20:50:51.659775 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 360/626] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:50:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:50:51.668659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff44aab-d15a-47cd-a2d7-217166bc5e87", "name": "network-vif-unplugged", "status": "completed", "tag": "3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54"}, {"name": "network-changed", "server_uuid": "e84a2e73-0c4f-4855-a4b0-1dfe9af6db24", "tag": "ae943f51-447b-434d-a20b-ea825ed34c1a"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:51.683333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.684098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.702434 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] Creating event network-vif-unplugged:3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54 for instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 on nch1-master-1 Mar 26 20:50:51.703568 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] Creating event network-changed:ae943f51-447b-434d-a20b-ea825ed34c1a for instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 on nch2-master-1 Mar 26 20:50:51.714726 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c67a43a2-7476-4fbf-aa19-ae466541de30 req-fb2be243-ef70-44e2-a473-7415a8e91168 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053259 Mar 26 20:50:51.717336 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 361/627] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:51.726964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:51.728472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:51.736527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.737232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:51.738730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:51.739623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.083598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.092427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.093942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.095634 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8eea89a2-d5a9-4a4f-b8fa-7e51577fe429 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.917431 Mar 26 20:50:52.096657 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 267/628] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:51 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:52.101181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:52.108542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:52.137878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.140012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.141080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.141869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.348952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.357172 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6cc197b-9b2a-4071-bf3c-492a253b7589 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.637661 Mar 26 20:50:52.357771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 362/629] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:51 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:52.362205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:52.362812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:52.387592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.388087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.389544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.389994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.553166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.561345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37e26d75-62e8-4ad5-b7da-3b24cfdcaa79 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.202547 Mar 26 20:50:52.561914 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 363/630] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:52 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:52.572854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c5ff2954-2e54-47c5-85ca-3a4e14061e77 req-116d69d9-1f06-482c-9a82-81b2daff5b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-plugged", "status": "completed", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:52.576598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c5ff2954-2e54-47c5-85ca-3a4e14061e77 req-116d69d9-1f06-482c-9a82-81b2daff5b67 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.577495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c5ff2954-2e54-47c5-85ca-3a4e14061e77 req-116d69d9-1f06-482c-9a82-81b2daff5b67 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.590956 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c5ff2954-2e54-47c5-85ca-3a4e14061e77 req-116d69d9-1f06-482c-9a82-81b2daff5b67 service nova] Creating event network-vif-plugged:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:50:52.596199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c5ff2954-2e54-47c5-85ca-3a4e14061e77 req-116d69d9-1f06-482c-9a82-81b2daff5b67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Mar 26 20:50:52.597273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 364/631] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:52.622971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:52.623756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:52.636124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.636591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.637596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.638055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.755141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.769004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a448bd8-37a1-4170-a3d1-78e2f886d777 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1261 microversion: 2.1 time: 0.170000 Mar 26 20:50:52.785885 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 365/632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:52 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:52.803173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:52.805940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:52.818520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.820153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.821598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:52.823225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:52.950033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:52.969478 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ead075a-a8cd-4f93-96cc-5c5a226fb63d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1472 microversion: 2.1 time: 0.871592 Mar 26 20:50:52.970108 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 268/633] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:52 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1472 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:53.198094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Calling method '.version_select at 0x7f6e598e13a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.200341 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:53.200341 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:53.202092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.202817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.222282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.223545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.237855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.238745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.241167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:53.248022 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4f035cf7-c70d-4e5d-b7e3-03cf343e3655 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.276798 Mar 26 20:50:53.248717 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68d5a847-a556-4b59-a8ab-5d19638e5a64 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 0.460670 Mar 26 20:50:53.249543 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 366/634] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:52 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:53.255550 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 269/635] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:53.270346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.271176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:53.286751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.287842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.291318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.292520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.409082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17b0457c-cafb-4cee-b27f-963eeac55c34 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Calling method '.version_select at 0x7f6e598e1550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.409841 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:53.409841 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:53.412857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-17b0457c-cafb-4cee-b27f-963eeac55c34 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f435557ffd274e2b9cc4d00ee67c5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758b0b02434b76b69d5dea22bd5945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:53.413971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17b0457c-cafb-4cee-b27f-963eeac55c34 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:53.415020 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17b0457c-cafb-4cee-b27f-963eeac55c34 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.158195 Mar 26 20:50:53.423706 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 270/636] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 20:50:53 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:53.428952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.436218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:53.447715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.448592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.449553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.450417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.718557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:53.732071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:53.734436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:53.737185 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8bcdbc67-8588-4daa-814f-f96d2ce98da3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.486923 Mar 26 20:50:53.740012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 367/637] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:53 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:53.743693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Calling method '.version_select at 0x7f6e5963df70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.744760 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:53.744760 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:53.746250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.746812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.756159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Mar 26 20:50:53.756878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:53.757869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac9f3d20-d751-4404-aa84-284a0c2b4623 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.018537 Mar 26 20:50:53.762870 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 368/638] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 20:50:53 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:53.769522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:53.770330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:53.779224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.779861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:53.783046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:53.783555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.075881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:54.089560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b947a90-9029-4630-bcea-2b7a74ca7373 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.664320 Mar 26 20:50:54.101114 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 271/639] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:53 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:54.108848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-37b46550-f8b1-48c4-8ad5-3cd9b8b2108d req-53d68abd-2935-4514-94da-173f695edd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff44aab-d15a-47cd-a2d7-217166bc5e87", "tag": "3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:54.121648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-37b46550-f8b1-48c4-8ad5-3cd9b8b2108d req-53d68abd-2935-4514-94da-173f695edd32 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.122689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-37b46550-f8b1-48c4-8ad5-3cd9b8b2108d req-53d68abd-2935-4514-94da-173f695edd32 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.141529 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-37b46550-f8b1-48c4-8ad5-3cd9b8b2108d req-53d68abd-2935-4514-94da-173f695edd32 service nova] Creating event network-changed:3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54 for instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 on nch1-master-1 Mar 26 20:50:54.148754 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-37b46550-f8b1-48c4-8ad5-3cd9b8b2108d req-53d68abd-2935-4514-94da-173f695edd32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045827 Mar 26 20:50:54.149721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 272/640] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:54.159810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Calling method '.version_select at 0x7f6e59b7c040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.162360 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:54.162360 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:50:54.164095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.164972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.189623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.190728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.198312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:54.206743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e39a846f-a0fb-425e-8ca7-9cc432ad0757 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.441638 Mar 26 20:50:54.207520 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 369/641] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:53 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:54.208606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.209174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.217392 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41d927be-101e-47c1-986d-50126e88ea54 tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064972 Mar 26 20:50:54.224034 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 273/642] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:54.230050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.230807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:54.235776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.236436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:54.239152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.240136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.241399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.242283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.245613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.246060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.246846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.247286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.367716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:54.377791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9bb0b776-2702-4399-9a01-3fe0d450e26f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1323 microversion: 2.1 time: 0.155638 Mar 26 20:50:54.379794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 370/643] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:54.385554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6752d6ff-44af-4848-91a3-2bdf0ac3bbf7 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Calling method '.version_select at 0x7f6e59dc4d30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.386975 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:54.386975 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:54.390007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6752d6ff-44af-4848-91a3-2bdf0ac3bbf7 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f435557ffd274e2b9cc4d00ee67c5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758b0b02434b76b69d5dea22bd5945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:54.392626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6752d6ff-44af-4848-91a3-2bdf0ac3bbf7 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:54.393751 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6752d6ff-44af-4848-91a3-2bdf0ac3bbf7 tempest-HypervisorAdminNegativeUnderV252Test-10098982 tempest-HypervisorAdminNegativeUnderV252Test-10098982-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011964 Mar 26 20:50:54.394841 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 371/644] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:54.402838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.403525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:54.411833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.412566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.413522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.414146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.745092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:54.754899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d0b70a3-5710-48de-8df1-465720876ff5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 0.358828 Mar 26 20:50:54.766650 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 372/645] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:54.771649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Calling method '.version_select at 0x7f6e596f60d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.772845 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:50:54.772845 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:50:54.774494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.775009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.781488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] HTTP exception thrown: No hypervisor matching '257fe45d-be3d-4380-a422-6c4b61c437ec' could be found. Mar 26 20:50:54.782801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] Returning 404 to user: No hypervisor matching '257fe45d-be3d-4380-a422-6c4b61c437ec' could be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:50:54.783718 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3cafdcd5-b9e4-4aec-b394-3ea97a01ca7d tempest-HypervisorAdminNegativeUnderV252Test-1598745084 tempest-HypervisorAdminNegativeUnderV252Test-1598745084-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/257fe45d-be3d-4380-a422-6c4b61c437ec/servers" status: 404 len: 123 microversion: 2.1 time: 0.015757 Mar 26 20:50:54.784488 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 373/646] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/os-hypervisors/257fe45d-be3d-4380-a422-6c4b61c437ec/servers => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:50:54.803680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b6ba3dd2-46e6-42da-9075-23640e3cf2ff req-18f1f19c-6037-4224-9acb-2e5c016e51a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c", "name": "network-vif-plugged", "status": "completed", "tag": "7f9dbd4b-d061-4ca4-82e6-42454e573a0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:54.819737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b6ba3dd2-46e6-42da-9075-23640e3cf2ff req-18f1f19c-6037-4224-9acb-2e5c016e51a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.820283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b6ba3dd2-46e6-42da-9075-23640e3cf2ff req-18f1f19c-6037-4224-9acb-2e5c016e51a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.833891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b6ba3dd2-46e6-42da-9075-23640e3cf2ff req-18f1f19c-6037-4224-9acb-2e5c016e51a4 service nova] Creating event network-vif-plugged:7f9dbd4b-d061-4ca4-82e6-42454e573a0d for instance 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c on nch1-master-1 Mar 26 20:50:54.839957 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b6ba3dd2-46e6-42da-9075-23640e3cf2ff req-18f1f19c-6037-4224-9acb-2e5c016e51a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053901 Mar 26 20:50:54.845753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 374/647] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:54.855465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:54.857405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:54.867367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.867831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:54.868669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:54.869111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.234360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:55.265434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-609455f6-bd4f-4630-8787-2713c42ae020 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1472 microversion: 2.1 time: 1.039677 Mar 26 20:50:55.276874 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 274/648] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1472 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:55.300841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:55.303515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:55.315340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.317721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.320264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.324787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.429386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:55.439610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:55.446427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:55.452078 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2e86ffd9-a552-475d-b880-4e1270a213b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1568 microversion: 2.25 time: 0.604658 Mar 26 20:50:55.453096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 375/649] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:54 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1568 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:55.468302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:55.468973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:55.480453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.481098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.481897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.482339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.861390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:55.869584 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13dfe572-64e6-4071-97a7-159b111cb9d3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1478 microversion: 2.1 time: 0.580542 Mar 26 20:50:55.879739 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 275/650] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:55 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1478 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:55.884857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:55.885663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:55.892704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.893609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:55.894573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:55.895244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:56.084908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:56.092517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ea30ac8-877f-4db3-997b-6304474bd6cb tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1318 microversion: 2.1 time: 0.638178 Mar 26 20:50:56.093131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 376/651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:55 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:56.225377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb189eb9-3318-4aba-8972-b6211ed5de8e tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Action: 'create', calling method: .version_select at 0x7f6e596f6700>, body: {"pool": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:56.255492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:56.265176 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-747c457e-d744-4dc5-9014-f1eb1f6d6e23 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1391 microversion: 2.1 time: 0.384004 Mar 26 20:50:56.268225 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 276/652] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:55 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:56.273620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:56.274432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:56.281562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:56.282524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:56.283514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:56.284242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:56.614275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:56.621810 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e497e33-5f61-4c97-840f-37c663c565fb tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1504 microversion: 2.1 time: 0.352224 Mar 26 20:50:56.626159 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 277/653] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:56 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:56.637950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:56.638759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:56.651529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:56.652045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:56.652837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:56.657099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:57.328471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:57.356865 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1358c335-15a8-4277-9c1e-2018a8fd0746 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.729318 Mar 26 20:50:57.357783 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 278/654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:56 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:57.364949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:57.365805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:57.376026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:57.396012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:57.398165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:57.399206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:58.066511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:58.082622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:58.084273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:58.085647 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-260e1fb0-59bc-41ac-b08e-a0962e16598f tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1543 microversion: 2.25 time: 0.726772 Mar 26 20:50:58.086400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 279/655] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:50:57 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1543 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:58.111754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:58.112423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:58.124523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:58.125176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:58.128257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:58.128892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:58.757854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:58.765522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2927a219-1fcb-432a-8804-a5c5a0c3da9a tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1464 microversion: 2.1 time: 0.664735 Mar 26 20:50:58.766520 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 280/656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:58 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1464 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:58.771085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:58.771711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:58.801301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:58.802003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:58.802955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:58.803544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.191017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:59.198349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67840d26-1ffd-47d0-9f50-3877615e191f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1508 microversion: 2.1 time: 0.430842 Mar 26 20:50:59.208233 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 281/657] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:58 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:59.212190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:59.212793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:59.230274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.233845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.234849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.236405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.249387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb189eb9-3318-4aba-8972-b6211ed5de8e tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.146503 Mar 26 20:50:59.256641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 377/658] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:50:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:59.261730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-77148113-68a7-4ea0-9921-051de8b9210c req-4e6dd478-4c68-4cfe-9672-edb689e438bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b31b55-e687-4df8-8057-fdf7bffce5fa", "tag": "eb28e42c-172b-407b-901a-05cc677135e3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:50:59.274250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-77148113-68a7-4ea0-9921-051de8b9210c req-4e6dd478-4c68-4cfe-9672-edb689e438bd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.275032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-77148113-68a7-4ea0-9921-051de8b9210c req-4e6dd478-4c68-4cfe-9672-edb689e438bd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.288438 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-77148113-68a7-4ea0-9921-051de8b9210c req-4e6dd478-4c68-4cfe-9672-edb689e438bd service nova] Creating event network-changed:eb28e42c-172b-407b-901a-05cc677135e3 for instance b6b31b55-e687-4df8-8057-fdf7bffce5fa on nch1-master-1 Mar 26 20:50:59.295356 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-77148113-68a7-4ea0-9921-051de8b9210c req-4e6dd478-4c68-4cfe-9672-edb689e438bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037316 Mar 26 20:50:59.296698 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 378/659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:50:59.304564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:59.307959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:59.318302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.319203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.320295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.321344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.569156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:59.577157 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3e21430-43d9-4544-aa55-138bffc85391 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1391 microversion: 2.1 time: 0.374599 Mar 26 20:50:59.592057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 282/660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:59 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1391 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:59.604401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1242b37-b338-43b6-b2bf-977e13187946 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '.version_select at 0x7f6e596581f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:59.611424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1242b37-b338-43b6-b2bf-977e13187946 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.613150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1242b37-b338-43b6-b2bf-977e13187946 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.632257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:59.644807 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1242b37-b338-43b6-b2bf-977e13187946 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.050270 Mar 26 20:50:59.647945 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 283/661] 10.222.0.16 () {60 vars in 1183 bytes} [Sat Mar 26 20:50:59 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:50:59.655145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ea5bba3-2faf-4125-a95e-9a802572786c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1479 microversion: 2.1 time: 0.348285 Mar 26 20:50:59.656106 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 379/662] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:59 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1479 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:59.658737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:59.659395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:59.661814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:50:59.662871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:50:59.668796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.669315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.670197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.670488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.670651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.671870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:50:59.673018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.675142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:50:59.882458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:50:59.896378 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63c07ef5-84f8-44bf-bc08-026520062113 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.247119 Mar 26 20:50:59.901315 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 284/663] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:59 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:50:59.907249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-530c0816-8986-4f5e-a4f0-a4fbf82fc09b tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Action: 'create', calling method: .version_select at 0x7f6e59a66550>, body: {"pool": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:00.243475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:00.255175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2c86cee1-d58f-4ac3-a60c-07d5581a8bb3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1464 microversion: 2.1 time: 0.597299 Mar 26 20:51:00.267506 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 380/664] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:50:59 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1464 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:00.276800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:00.277460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:00.299281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.299744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.300574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.301027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.605016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:00.619564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3d88959-a69b-4cbb-b555-76691e439975 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 2036 microversion: 2.25 time: 0.355271 Mar 26 20:51:00.620456 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 381/665] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:00 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 2036 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:00.642560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef08891e-8b7b-42a4-9c5d-36fb6627f305 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '.version_select at 0x7f6e596fad30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:00.645496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef08891e-8b7b-42a4-9c5d-36fb6627f305 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.645956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef08891e-8b7b-42a4-9c5d-36fb6627f305 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.658769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef08891e-8b7b-42a4-9c5d-36fb6627f305 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.026299 Mar 26 20:51:00.659370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 382/666] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:51:00 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:00.666170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:00.668122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:00.676780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.677378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.678375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.678882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.791802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:00.792864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:00.798655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:00.799557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:00.800226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:00.925750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:00.932077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.932543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.933568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.934558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.963561 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33c252ba-14b6-446b-89ab-1bf751817599 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 1068 microversion: 2.1 time: 0.301226 Mar 26 20:51:00.964592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 383/667] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:00 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 1068 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 26 20:51:00.969565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:00.970229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:00.980082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.980560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:00.981433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:00.981831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.220325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:01.230108 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf746101-969f-46f0-ac3e-efa0daffe2b6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1391 microversion: 2.1 time: 0.264618 Mar 26 20:51:01.231694 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 384/668] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:00 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:01.236716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:01.237359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:01.243337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.244128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.245041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.245705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.406360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e637d300-1b40-43ed-892f-8800d1fb80b8 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1630 microversion: 2.1 time: 0.173748 Mar 26 20:51:01.406964 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 385/669] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:01 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1630 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:01.425239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-661570833", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b4f1069c-0aa3-4d88-b2ef-9a5c20f55049"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:01.478787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] validate_networks() for [('b4f1069c-0aa3-4d88-b2ef-9a5c20f55049', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:01.626271 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-530c0816-8986-4f5e-a4f0-a4fbf82fc09b tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.723584 Mar 26 20:51:01.627957 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 285/670] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:50:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:01.631953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:01.632750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:01.639292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.639755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.640571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.641070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.774234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:01.782114 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-420ec9ee-96d8-47ef-bcce-4771ca058645 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.153429 Mar 26 20:51:01.782670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 286/671] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:01 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:01.787235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:01.788209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:01.794448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.794905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.795682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.796543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.858042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:01.858475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:01.858951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:01.859407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:01.860387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:01.870525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.871016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.871852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.872349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.889398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:01.894620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for user 2bcd816c4f3a495cbe7ce636cf0e2f8a and project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:01.907239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:01.909543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:01.930972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:01.938861 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2df9d21f-0a5f-4866-9828-cd1f24c0aab3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.155026 Mar 26 20:51:01.939589 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 287/672] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:01 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:01.951143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bcafd78-22b6-4646-9380-81d4488a36cd"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:01.952293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:01.958484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.958936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.959700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:01.961051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:01.962166 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e575fba4-f094-4126-820d-7a5c34fc8f03 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.543936 Mar 26 20:51:01.967576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 386/673] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 20:51:02.093532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-687c0084-2640-4f26-8cba-94284ad3778d tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997 tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:02.094979 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:02.094979 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:02.097190 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-687c0084-2640-4f26-8cba-94284ad3778d tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997 tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Mar 26 20:51:02.097859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-687c0084-2640-4f26-8cba-94284ad3778d tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997 tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:02.098670 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-687c0084-2640-4f26-8cba-94284ad3778d tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997 tempest-InstanceUsageAuditLogNegativeTestJSON-2030149997-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.134858 Mar 26 20:51:02.099303 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 387/674] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:02.103783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1832418489", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3719dfee-4a50-4ee6-a6eb-866a85cdf502"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:02.158240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] validate_networks() for [('3719dfee-4a50-4ee6-a6eb-866a85cdf502', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:02.311338 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb50cd78-c21b-4c9a-9cc2-24f55d70a992 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "POST /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370328 Mar 26 20:51:02.312031 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 288/675] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 20:51:01 2022] POST /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:02.318640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df5882fb-f0bd-45e8-b938-7ea02ee07cb7 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Action: 'create', calling method: .version_select at 0x7f6e59658c10>, body: {"pool": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:02.608164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:02.608748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:02.609096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:02.609716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:02.610139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:02.624631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:02.625849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:02.628027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:02.628641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:02.659978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:02.665984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for user c9bd4f2793ec48a5b31d081c269a39c2 and project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:02.685284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:02.689063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:02.760490 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd69a906-4126-43ed-8973-59930e8f1688 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659469 Mar 26 20:51:02.763751 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 388/676] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:02.769179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:02.772195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:02.784987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:02.786887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:02.788362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:02.788959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:02.866609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:02.876290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:02.878320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:02.879440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a04046b3-319f-4864-b2b9-842fdba60ab0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1313 microversion: 2.25 time: 0.114502 Mar 26 20:51:02.880667 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 389/677] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:02 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1313 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:03.102476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4689438-c4e2-4019-8b90-859dacd5e30f tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:03.103491 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:03.103491 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:03.104629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4689438-c4e2-4019-8b90-859dacd5e30f tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8a305a2bbad0435aae633817fb21b0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f94d873110d4ecea9d0fb0a8a4bc894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:03.105272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4689438-c4e2-4019-8b90-859dacd5e30f tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:03.106083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4689438-c4e2-4019-8b90-859dacd5e30f tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.224134 Mar 26 20:51:03.109381 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 390/678] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 20:51:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:03.118828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:03.119494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:03.144725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.145202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.146002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.146927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.385938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:03.408579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16392552-0906-44aa-aaff-c7c67c211a19 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1391 microversion: 2.1 time: 0.297169 Mar 26 20:51:03.410176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 391/679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:03 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1391 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:03.428040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:03.429569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:03.438800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.439530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.440532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.441154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.522739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:03.532194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf663404-90e1-4b10-8b56-5eb59ca1ca7d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1215 microversion: 2.1 time: 0.110783 Mar 26 20:51:03.535862 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 392/680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:03 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:03.550412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:03.551102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:03.557795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.558537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.559526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.560071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.772751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:03.782377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-226f2292-57f6-481a-80d5-f2fc7d7847c2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.244958 Mar 26 20:51:03.783109 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 393/681] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:03 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:03.789063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:03.789678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:03.796884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.797906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.798716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.799164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:03.952847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:03.962315 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1408d4d5-ba8e-44e3-bb4b-b80a1487b028 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.177778 Mar 26 20:51:03.962912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 394/682] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:03 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:03.977201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-05d29961-57f7-4dda-b3a2-7223fa09ae7b req-ac43ee2d-8202-4c2a-a82a-add4519b07cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b31b55-e687-4df8-8057-fdf7bffce5fa", "name": "network-vif-plugged", "status": "completed", "tag": "eb28e42c-172b-407b-901a-05cc677135e3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:03.985731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05d29961-57f7-4dda-b3a2-7223fa09ae7b req-ac43ee2d-8202-4c2a-a82a-add4519b07cb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:03.986185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05d29961-57f7-4dda-b3a2-7223fa09ae7b req-ac43ee2d-8202-4c2a-a82a-add4519b07cb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.001917 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-05d29961-57f7-4dda-b3a2-7223fa09ae7b req-ac43ee2d-8202-4c2a-a82a-add4519b07cb service nova] Creating event network-vif-plugged:eb28e42c-172b-407b-901a-05cc677135e3 for instance b6b31b55-e687-4df8-8057-fdf7bffce5fa on nch1-master-1 Mar 26 20:51:04.007169 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-05d29961-57f7-4dda-b3a2-7223fa09ae7b req-ac43ee2d-8202-4c2a-a82a-add4519b07cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Mar 26 20:51:04.007781 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 395/683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:04.016444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c42dbfda-4f32-4268-b0f4-97130c92089d tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:04.017288 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:04.017288 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:04.018404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c42dbfda-4f32-4268-b0f4-97130c92089d tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8a305a2bbad0435aae633817fb21b0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f94d873110d4ecea9d0fb0a8a4bc894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.019067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c42dbfda-4f32-4268-b0f4-97130c92089d tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:04.019891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c42dbfda-4f32-4268-b0f4-97130c92089d tempest-InstanceUsageAuditLogNegativeTestJSON-787833528 tempest-InstanceUsageAuditLogNegativeTestJSON-787833528-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-26 20:51:03" status: 403 len: 128 microversion: 2.1 time: 0.008271 Mar 26 20:51:04.024115 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 396/684] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 20:51:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-26%2020%3A51%3A03 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:04.032593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:04.033343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:04.053641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.054100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.054897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.055488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.166176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.179038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.180784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.182745 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bbdf4347-ec9e-4cbf-9480-2ea3ddaefb45 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1319 microversion: 2.25 time: 0.154893 Mar 26 20:51:04.196902 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 397/685] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:04 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:04.382698 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df5882fb-f0bd-45e8-b938-7ea02ee07cb7 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.068542 Mar 26 20:51:04.383692 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 289/686] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:51:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:04.397683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a3a95e1a-6df4-431a-bfca-1669a825f01b tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Action: 'create', calling method: .version_select at 0x7f6e595d5040>, body: {"pool": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:04.428785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:04.429689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:04.439260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.440080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.441098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.442466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.747072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.755683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18b739b3-bdc5-49f8-afd8-a67adc540eef tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1391 microversion: 2.1 time: 0.331392 Mar 26 20:51:04.766623 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 290/687] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:04 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:04.773181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:04.773936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:04.780538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.781774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.782879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.783528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.878032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:04.887043 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae7a0a73-0694-443e-be48-adfc83b92bf9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1269 microversion: 2.1 time: 0.118813 Mar 26 20:51:04.887630 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 291/688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:04 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:04.901313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:04.901928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:04.909391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.909839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:04.910612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:04.911229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.256819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:05.270524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e2c4dabf-849b-4678-802b-e1e9824a92cb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.372743 Mar 26 20:51:05.271986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 292/689] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:04 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:05.287679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:05.288725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:05.297109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.297803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.299138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.300012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.577503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:05.589266 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f54c20f-a9eb-4c41-8934-9cf54ba2a64d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.312572 Mar 26 20:51:05.590117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 293/690] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:05 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:05.606875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:05.608942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:05.617206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.618167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.619200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.620140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.884391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:05.897263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:05.900653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:05.901813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-45fdeb2f-0cb0-431b-a46a-8089a51424ae tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1361 microversion: 2.25 time: 0.299946 Mar 26 20:51:05.902615 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 294/691] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:05 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:05.908675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:05.909554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:05.916452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.917301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:05.918171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:05.918684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.220113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:06.230325 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ea48bc8b-c40b-4be3-a070-ff65655aac9f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1590 microversion: 2.1 time: 0.326415 Mar 26 20:51:06.230904 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 295/692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:05 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1590 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:06.238566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a4170ee7-115e-4817-adba-7b6845342542 req-ec6690a5-a985-433b-a8f2-5763ba4db677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20", "tag": "d6806923-920b-4eab-b4f5-2134464682ab"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:06.247606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a4170ee7-115e-4817-adba-7b6845342542 req-ec6690a5-a985-433b-a8f2-5763ba4db677 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.248930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a4170ee7-115e-4817-adba-7b6845342542 req-ec6690a5-a985-433b-a8f2-5763ba4db677 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.262621 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a4170ee7-115e-4817-adba-7b6845342542 req-ec6690a5-a985-433b-a8f2-5763ba4db677 service nova] Creating event network-changed:d6806923-920b-4eab-b4f5-2134464682ab for instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 on nch2-master-1 Mar 26 20:51:06.267877 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a4170ee7-115e-4817-adba-7b6845342542 req-ec6690a5-a985-433b-a8f2-5763ba4db677 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Mar 26 20:51:06.268689 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 296/693] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:06.273909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:06.275854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:06.284767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.285471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.286609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.287340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.474295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:06.482242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-095c7850-f51d-4280-b3b9-7df0c4c93243 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.212149 Mar 26 20:51:06.482832 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 297/694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:06 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:06.487003 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a3a95e1a-6df4-431a-bfca-1669a825f01b tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.095581 Mar 26 20:51:06.489185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:06.489762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:06.490561 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 398/695] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:51:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:06.496273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:06.496537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.497056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.498094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.498723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.499926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:06.516220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.520717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.524686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:06.525432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:06.732735 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-366dd7d0-2c18-4071-bef3-769a21654a8f tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248681 Mar 26 20:51:06.734385 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 298/696] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:51:06 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:06.744370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1ce755ab-b538-4285-bc6f-04e92b9ad56a tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e596074c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:07.139597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:07.153540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab27d522-1f78-4949-aa1c-9c06f8aa5502 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.660398 Mar 26 20:51:07.155361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 399/697] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:06 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:07.172235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:07.173060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:07.180575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.182722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.183949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.184699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.462234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:07.472948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37e592f3-606b-4206-ad85-b839e6ec9679 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.315737 Mar 26 20:51:07.485723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 400/698] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:07 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:07.490558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7bc022f0-2075-4f5d-9d8a-2c863407b62f req-dfde72fe-520e-4d65-8da0-8bec74e5e3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2e17aad-e4e4-48db-a406-de8c22855a57", "tag": "c7df1940-2f47-4d41-b48f-8078b14b9cc2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:07.498641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7bc022f0-2075-4f5d-9d8a-2c863407b62f req-dfde72fe-520e-4d65-8da0-8bec74e5e3e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.499318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7bc022f0-2075-4f5d-9d8a-2c863407b62f req-dfde72fe-520e-4d65-8da0-8bec74e5e3e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.511447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7bc022f0-2075-4f5d-9d8a-2c863407b62f req-dfde72fe-520e-4d65-8da0-8bec74e5e3e1 service nova] Creating event network-changed:c7df1940-2f47-4d41-b48f-8078b14b9cc2 for instance d2e17aad-e4e4-48db-a406-de8c22855a57 on nch2-master-1 Mar 26 20:51:07.516857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7bc022f0-2075-4f5d-9d8a-2c863407b62f req-dfde72fe-520e-4d65-8da0-8bec74e5e3e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029873 Mar 26 20:51:07.517496 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 401/699] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:07.523373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:07.524279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:07.541877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.543363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.544385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.545025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.752193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1ce755ab-b538-4285-bc6f-04e92b9ad56a tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/bea20a95-32ac-45ea-9ff7-e0404cbc3558" status: 200 len: 142 microversion: 2.1 time: 1.012611 Mar 26 20:51:07.752774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 299/700] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:06 2022] GET /compute/v2.1/os-floating-ips/bea20a95-32ac-45ea-9ff7-e0404cbc3558 => generated 142 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:07.769937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:07.771716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:07.787389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.787859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.788699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:07.789147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:07.848525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:07.865155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:07.869864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:07.871143 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a8746fd-004e-491b-9569-1110b96a4371 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1361 microversion: 2.25 time: 0.352394 Mar 26 20:51:07.880118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 402/701] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:07 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:07.880118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-456e8103-f99a-41e8-b1eb-beacae05ec1d tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e595d5f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:08.182465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:08.198421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-195aaedc-b2b9-419d-84b9-9692daadd1e6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.437559 Mar 26 20:51:08.199125 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 300/702] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:07 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:08.449041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cc5e1a08-95f8-4707-bf7d-1e85dd7f4f88"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:08.450678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:08.457758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.458208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.459158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.459603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.639161 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] HTTP exception thrown: Volume cc5e1a08-95f8-4707-bf7d-1e85dd7f4f88 could not be found. Mar 26 20:51:08.639810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Returning 400 to user: Volume cc5e1a08-95f8-4707-bf7d-1e85dd7f4f88 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:08.641356 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1453a3ce-7214-43e9-9111-075f483012f7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/8bcafd78-22b6-4646-9380-81d4488a36cd" status: 400 len: 107 microversion: 2.1 time: 0.439906 Mar 26 20:51:08.642098 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 301/703] 10.222.0.16 () {60 vars in 1432 bytes} [Sat Mar 26 20:51:08 2022] PUT /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/8bcafd78-22b6-4646-9380-81d4488a36cd => generated 107 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:51:08.646827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:08.647406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:08.659463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.660272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.661450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.662332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.850293 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-456e8103-f99a-41e8-b1eb-beacae05ec1d tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/bea20a95-32ac-45ea-9ff7-e0404cbc3558" status: 202 len: 0 microversion: 2.1 time: 0.977104 Mar 26 20:51:08.850873 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 403/704] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:51:07 2022] DELETE /compute/v2.1/os-floating-ips/bea20a95-32ac-45ea-9ff7-e0404cbc3558 => generated 0 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:08.911390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:08.915470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1447195723", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:08.919030 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77ef0932-5acb-409c-b560-162522e52470 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.276078 Mar 26 20:51:08.919585 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 302/705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:08 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:08.924515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:08.929346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:08.935262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.936024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.936525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:08.936968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:08.969766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:09.082599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.090252 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5594293b-7b28-4dd0-aaf1-31c04d177660 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.169670 Mar 26 20:51:09.091224 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 303/706] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:08 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:09.096990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.097828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.103708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.104905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.105789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.106443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.190540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:09.190967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:09.191448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:09.191860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:09.192309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:09.201974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.202431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.203820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.204359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.221883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Getting quotas for project 54c513bf41bd4101914b82a4b39e4030. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:09.227275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Getting quotas for user 0d404d270f3a41c9bb725f0ea552c76c and project 54c513bf41bd4101914b82a4b39e4030. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:09.240044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lazy-loading 'services' on Instance uuid 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:09.240227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:09.242498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:09.287242 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d15b889-bdca-469f-bdde-7a05a254edf8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435158 Mar 26 20:51:09.287939 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 404/707] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:09.292599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae6b2f23-a962-4a92-b8d2-f293e7e15574 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e595f4940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.377708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aaf855df-35b3-41c9-97e3-b7e7c4cdab1b tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/8bcafd78-22b6-4646-9380-81d4488a36cd" status: 202 len: 0 microversion: 2.1 time: 0.283305 Mar 26 20:51:09.378344 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 304/708] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 20:51:09 2022] DELETE /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/8bcafd78-22b6-4646-9380-81d4488a36cd => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:09.401882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.402643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.420192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.420697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.422183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.422693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.583755 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae6b2f23-a962-4a92-b8d2-f293e7e15574 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.294668 Mar 26 20:51:09.585046 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 405/709] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:09.591491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.592406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.602155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.602806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.604019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.604623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.693909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.706005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.708390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.710451 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a3a2a85-123a-4000-94db-b681738ac739 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1361 microversion: 2.25 time: 0.329411 Mar 26 20:51:09.711508 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 305/710] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:09.726848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4fb43b0c-3b70-4189-a43f-3bb06fdafa48 req-404061d4-c39e-444f-8357-8c1f5f26b0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b31b55-e687-4df8-8057-fdf7bffce5fa", "tag": "eb28e42c-172b-407b-901a-05cc677135e3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:09.737002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4fb43b0c-3b70-4189-a43f-3bb06fdafa48 req-404061d4-c39e-444f-8357-8c1f5f26b0ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.737983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4fb43b0c-3b70-4189-a43f-3bb06fdafa48 req-404061d4-c39e-444f-8357-8c1f5f26b0ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.751584 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4fb43b0c-3b70-4189-a43f-3bb06fdafa48 req-404061d4-c39e-444f-8357-8c1f5f26b0ea service nova] Creating event network-changed:eb28e42c-172b-407b-901a-05cc677135e3 for instance b6b31b55-e687-4df8-8057-fdf7bffce5fa on nch1-master-1 Mar 26 20:51:09.759100 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4fb43b0c-3b70-4189-a43f-3bb06fdafa48 req-404061d4-c39e-444f-8357-8c1f5f26b0ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046196 Mar 26 20:51:09.759723 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 306/711] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:09.770100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.771043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.782022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.782757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.783624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.784110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.790230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.802527 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca799897-566b-497d-ba3e-f2b9b3c8d1f2 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 200 len: 1590 microversion: 2.1 time: 0.216131 Mar 26 20:51:09.805239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 406/712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 1590 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:09.816810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c86fd71-b49f-4800-9e4b-0856da690f36 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.817697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c86fd71-b49f-4800-9e4b-0856da690f36 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.905872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c86fd71-b49f-4800-9e4b-0856da690f36 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:09.913199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c86fd71-b49f-4800-9e4b-0856da690f36 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1222 microversion: 2.1 time: 0.106563 Mar 26 20:51:09.916677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 407/713] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:09.924887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:09.926547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:09.934300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.934841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.936018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:09.936653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:09.977262 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a58ec25d-2660-4343-81a3-3e20dae6f96e tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057188 Mar 26 20:51:09.981031 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 408/714] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:09.985799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e170f34-2e92-41d2-af9d-1c5b362e94fb tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e595f4670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:10.043332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:10.053524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2505154e-5763-4cb6-ae91-62d19ce111ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.292091 Mar 26 20:51:10.069659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 307/715] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:10.069659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:10.073836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:10.082395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.082760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:10.083587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.084110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:10.319507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:10.332871 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b78183d7-ac4b-4e5d-94c1-4f25e6681f2c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.268368 Mar 26 20:51:10.333779 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 308/716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:10 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:10.348758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:10.349864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:10.356758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.357322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:10.358360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.358916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:10.533267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:10.540878 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ba02936-8946-4c95-aac7-8a92bf659920 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.196211 Mar 26 20:51:10.541675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 309/717] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:10 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:10.599233 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e170f34-2e92-41d2-af9d-1c5b362e94fb tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.620013 Mar 26 20:51:10.600098 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 409/718] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:51:09 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:10.613057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-738b7ff8-c0a5-46c9-ae06-6c6c8c2d0641 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e59648160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:10.731175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:10.732462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:10.744837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.745307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:10.746109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:10.746547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.007636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.020730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.022652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.023999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f1d314b1-fe70-45a3-a6cd-4f4b930a4247 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1361 microversion: 2.25 time: 0.297244 Mar 26 20:51:11.033509 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 410/719] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:10 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:51:11.037971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:11.038741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:11.044999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.045639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.046420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.046867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.111775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.119889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57bcb5f7-f701-47ff-8576-722e73f4c345 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1280 microversion: 2.1 time: 0.093819 Mar 26 20:51:11.120525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 411/720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:11 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:11.125501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:11.126488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:11.132831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.133282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.134067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.134506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.167144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6f790cb-0495-4970-b472-4615e01d432f tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045475 Mar 26 20:51:11.167733 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 412/721] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:51:11 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:11.172378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:11.172985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:11.179182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.179610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.180381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.180818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.332346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.348556 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44839336-6d21-4cc8-8ec3-596294e3d621 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.178486 Mar 26 20:51:11.350088 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 413/722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:11 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:11.363525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:11.364172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:11.372711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.373333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.374194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.375141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.595801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.606240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c054b28f-7562-40cd-b19a-9e21bbc8bbf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1477 microversion: 2.1 time: 0.254804 Mar 26 20:51:11.609731 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 414/723] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:11 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:11.620523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:11.622193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:11.634466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.634953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.642799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.644539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.809704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:11.821892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eba6710f-4039-4b05-9c52-2b6ad160bd66 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.210658 Mar 26 20:51:11.822481 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 415/724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:11 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:11.864614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-04564354-7157-4cd9-b9c0-e425157e14be req-240912ce-7ae9-443a-866d-fb89e6997120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20", "name": "network-vif-plugged", "status": "completed", "tag": "d6806923-920b-4eab-b4f5-2134464682ab"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:11.876310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-04564354-7157-4cd9-b9c0-e425157e14be req-240912ce-7ae9-443a-866d-fb89e6997120 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:11.876993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-04564354-7157-4cd9-b9c0-e425157e14be req-240912ce-7ae9-443a-866d-fb89e6997120 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:11.902611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-04564354-7157-4cd9-b9c0-e425157e14be req-240912ce-7ae9-443a-866d-fb89e6997120 service nova] Creating event network-vif-plugged:d6806923-920b-4eab-b4f5-2134464682ab for instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 on nch2-master-1 Mar 26 20:51:11.909033 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-04564354-7157-4cd9-b9c0-e425157e14be req-240912ce-7ae9-443a-866d-fb89e6997120 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050310 Mar 26 20:51:11.910477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 416/725] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:51:12.043003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:12.044540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:12.052948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.053731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.054757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.055409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.219826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.220476 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-738b7ff8-c0a5-46c9-ae06-6c6c8c2d0641 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/2286ae6c-e83e-4e55-9049-7086a4a31ef5" status: 202 len: 0 microversion: 2.1 time: 1.609500 Mar 26 20:51:12.226052 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 310/726] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:51:10 2022] DELETE /compute/v2.1/os-floating-ips/2286ae6c-e83e-4e55-9049-7086a4a31ef5 => generated 0 bytes in 1618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:12.229515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.231173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.232105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:12.232339 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c0a3b06d-e6a6-4321-826e-cbf69bd696f3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1361 microversion: 2.25 time: 0.193640 Mar 26 20:51:12.233274 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 417/727] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:12 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:51:12.234704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:12.239207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44e136f5-cb36-4a82-a5f5-e07db6665678 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e595ac4c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:12.243887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.244958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.246855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.247617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.332760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.341538 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb5e5500-41f2-4f54-8a55-466bb9cff293 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1280 microversion: 2.1 time: 0.114231 Mar 26 20:51:12.342418 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 311/728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:12 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:12.366492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:12.367230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:12.373348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.374663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.376109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.377464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.602972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.630021 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b36a6e0c-2351-4b97-b88d-46899d68579f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.267397 Mar 26 20:51:12.653282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 312/729] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:12 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:12.664961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:12.666625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:12.681334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.688295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.689421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:12.689978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:12.990351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:12.997912 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47396d5d-5bc1-4d26-bb03-60498dfbef91 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1476 microversion: 2.1 time: 0.343207 Mar 26 20:51:12.998489 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 313/730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:12 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:13.004220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "691bf6f5-d70c-4f1a-b703-ade41950e2ac"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:13.005538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:13.011549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.012296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.013076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.013655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.074154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] HTTP exception thrown: Volume b2ebd7fb-a817-4cac-bf1e-ab71938a8cdb could not be found. Mar 26 20:51:13.074154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] Returning 404 to user: Volume b2ebd7fb-a817-4cac-bf1e-ab71938a8cdb could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:13.074154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5da5c8fa-eb38-4946-8228-4b2a5d412ba7 tempest-VolumesAdminNegativeTest-998527766 tempest-VolumesAdminNegativeTest-998527766-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/b2ebd7fb-a817-4cac-bf1e-ab71938a8cdb" status: 404 len: 109 microversion: 2.1 time: 0.071902 Mar 26 20:51:13.077035 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 314/731] 10.222.0.16 () {60 vars in 1432 bytes} [Sat Mar 26 20:51:12 2022] PUT /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c/os-volume_attachments/b2ebd7fb-a817-4cac-bf1e-ab71938a8cdb => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:13.082854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:13.083621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:13.091911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.092128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.092794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.093269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.319961 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44e136f5-cb36-4a82-a5f5-e07db6665678 tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/dfd3fd5d-179a-45a2-9012-62b394e3dbfb" status: 202 len: 0 microversion: 2.1 time: 1.085602 Mar 26 20:51:13.321927 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 418/732] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:51:12 2022] DELETE /compute/v2.1/os-floating-ips/dfd3fd5d-179a-45a2-9012-62b394e3dbfb => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:13.332464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:13.336822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:13.357529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.358582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.362426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.363286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.533027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:13.544650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cc241b24-40cd-4d33-9c0a-85138c1fb67e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.465824 Mar 26 20:51:13.545506 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 315/733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:13 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:13.551957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9705e010-5c1c-4020-8358-f1c05cfb3ecf tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] Calling method '.version_select at 0x7f6e59607d30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:13.718930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:13.730214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:13.731755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:13.732965 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fde0fb5-6412-4a10-ac56-bcea43a05915 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1558 microversion: 2.25 time: 0.410025 Mar 26 20:51:13.733730 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 419/734] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:13 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1558 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:13.748684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:13.749897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:13.757129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.757629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.758554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:13.758948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:13.960243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:13.967992 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b8a87fc-b974-4c72-ae7e-795341d79537 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.230461 Mar 26 20:51:13.977865 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 420/735] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:13 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:13.987539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:13.991658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:14.003554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.004041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.017074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.017792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.183352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:14.191954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01516746-e8f6-40d7-ab55-a21b31311546 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.214276 Mar 26 20:51:14.192533 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 421/736] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:13 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:14.197694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:14.198463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:14.204809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.205380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.206213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.206661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.346622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:14.362107 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e98d5389-d4ce-4637-a234-06fbc5455c27 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 2050 microversion: 2.25 time: 0.166922 Mar 26 20:51:14.363059 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 422/737] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:14 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 2050 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:14.369481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-69a36518-3205-4b14-9002-773a90b88c7e req-c1285fd1-d11c-4fa8-824d-7e6910f904d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3da99d9-228b-417e-aff7-488957ac8c33", "tag": "be7b6f80-22ba-471b-968f-ba95ce014ba3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:14.379376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-69a36518-3205-4b14-9002-773a90b88c7e req-c1285fd1-d11c-4fa8-824d-7e6910f904d4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.379947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-69a36518-3205-4b14-9002-773a90b88c7e req-c1285fd1-d11c-4fa8-824d-7e6910f904d4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.397589 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-69a36518-3205-4b14-9002-773a90b88c7e req-c1285fd1-d11c-4fa8-824d-7e6910f904d4 service nova] Creating event network-changed:be7b6f80-22ba-471b-968f-ba95ce014ba3 for instance b3da99d9-228b-417e-aff7-488957ac8c33 on nch1-master-1 Mar 26 20:51:14.403372 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-69a36518-3205-4b14-9002-773a90b88c7e req-c1285fd1-d11c-4fa8-824d-7e6910f904d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039192 Mar 26 20:51:14.404521 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 423/738] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:14.414351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-aed18897-3a54-4661-9bfc-df052dd0a34c req-01addbde-0fa4-473e-af62-695ca9004e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e17aad-e4e4-48db-a406-de8c22855a57", "name": "network-vif-plugged", "status": "completed", "tag": "c7df1940-2f47-4d41-b48f-8078b14b9cc2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:14.421041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aed18897-3a54-4661-9bfc-df052dd0a34c req-01addbde-0fa4-473e-af62-695ca9004e1d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.421526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aed18897-3a54-4661-9bfc-df052dd0a34c req-01addbde-0fa4-473e-af62-695ca9004e1d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.434786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-aed18897-3a54-4661-9bfc-df052dd0a34c req-01addbde-0fa4-473e-af62-695ca9004e1d service nova] Creating event network-vif-plugged:c7df1940-2f47-4d41-b48f-8078b14b9cc2 for instance d2e17aad-e4e4-48db-a406-de8c22855a57 on nch2-master-1 Mar 26 20:51:14.441590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-aed18897-3a54-4661-9bfc-df052dd0a34c req-01addbde-0fa4-473e-af62-695ca9004e1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035860 Mar 26 20:51:14.442597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 424/739] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:14.448091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:14.448880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:14.456527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.457089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.457782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.458228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.676356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:14.684900 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b309d1f-d49e-463b-a9b0-223c14f0aa82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1474 microversion: 2.1 time: 0.240946 Mar 26 20:51:14.685649 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 425/740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:14 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1474 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:14.691131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:14.692537 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:14.692537 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:14.693729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.694176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.694980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.695417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.720342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53db3136-460e-4d66-a933-b78d3b6f075f tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033269 Mar 26 20:51:14.721045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 426/741] 10.222.0.16 () {60 vars in 1216 bytes} [Sat Mar 26 20:51:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:51:14.733570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:14.735531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:14.742564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.743098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.744645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:14.745223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:14.861174 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9705e010-5c1c-4020-8358-f1c05cfb3ecf tempest-FloatingIPDetailsTestJSON-245127548 tempest-FloatingIPDetailsTestJSON-245127548-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/4d50880c-594d-420e-9a1c-d0f6d74c6af5" status: 202 len: 0 microversion: 2.1 time: 1.314337 Mar 26 20:51:14.866013 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 316/742] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:51:13 2022] DELETE /compute/v2.1/os-floating-ips/4d50880c-594d-420e-9a1c-d0f6d74c6af5 => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:14.992085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:14.994115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:14.999003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:15.010631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.011102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.011904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.011904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.016360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-375f6684-33f4-4e59-b6bf-dfd36d8e7873 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.294075 Mar 26 20:51:15.016952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 427/743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:14 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:15.209169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:15.209606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:15.241634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.248159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.248747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.249193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.309271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:15.318119 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b8bc156-a050-447b-86ce-ba51891c3239 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.336478 Mar 26 20:51:15.318700 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 317/744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:14 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:15.473030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:15.474200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:15.483300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.484416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.485537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.486726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.518681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:15.529136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:15.542095 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9f30ec6-a6e1-4857-9bff-e42852ee3f30 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1311 microversion: 2.1 time: 0.336739 Mar 26 20:51:15.551303 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 428/745] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:15 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:15.623323 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9246857a-65b9-4b08-b9bf-5848c01b3528 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 204 len: 0 microversion: 2.1 time: 0.156242 Mar 26 20:51:15.626774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 318/746] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:15 2022] DELETE /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:51:15.634751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:15.635372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:15.641882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.642343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.643121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.643592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.704188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:15.704923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:15.711796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.712286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.713077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:15.713520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:15.873994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:15.883375 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f17d7f06-b52e-43a6-a70d-4e9709436945 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1474 microversion: 2.1 time: 0.184337 Mar 26 20:51:15.884136 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 319/747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:15 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1474 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:16.033241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:16.033888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.041943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.042462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.043423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.044065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.136197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:16.144628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b86e28f-ae3c-4ee3-bc58-1705bce26f97 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1514 microversion: 2.1 time: 0.514158 Mar 26 20:51:16.145210 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 429/748] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:15 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1514 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:16.185726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:16.194039 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afb523e5-1a85-4a40-b967-1cd8386754e5 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.164764 Mar 26 20:51:16.194627 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 320/749] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:16 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:16.335284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:16.336564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.343758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.344344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.345216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.345976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.356926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ace3a31-6c6a-489d-a7e5-62054bbbe359", "device": "/dev/xvdb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:16.358543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.365989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.366579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.367368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.367812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.612318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:16.620619 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa1f1689-b791-4616-88af-55df86ea2c6b tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.289235 Mar 26 20:51:16.623142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 430/750] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:16 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:16.628992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:16.629811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.638791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.638791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.639432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.640727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.688168 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7bf93099-8f3d-4254-ab2a-22d0d8812ad5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "POST /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.334371 Mar 26 20:51:16.689234 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 321/751] 10.222.0.16 () {62 vars in 1363 bytes} [Sat Mar 26 20:51:16 2022] POST /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:51:16.905119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:16.906040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.914043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.914551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.915671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.924838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.945544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:16.953380 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af3bbeba-8a70-4f82-abef-fc77c4a654ba tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1495 microversion: 2.1 time: 0.328887 Mar 26 20:51:16.953965 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 431/752] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:16 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1495 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:16.971098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:16.972001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:16.978308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.984454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:16.985505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:16.986534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.129663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:17.138214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-909cedcc-525d-468c-bc4d-8341e6c6fd78 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1471 microversion: 2.1 time: 0.240124 Mar 26 20:51:17.139395 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 322/753] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:16 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:17.144830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946921b2-6fe2-4057-9572-adb926bd277d", "name": "network-vif-unplugged", "status": "completed", "tag": "45b38ca2-4fe0-430a-bebd-437115db1ae6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:17.158195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.158667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.176517 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] Creating event network-vif-unplugged:45b38ca2-4fe0-430a-bebd-437115db1ae6 for instance 946921b2-6fe2-4057-9572-adb926bd277d on nch1-master-1 Mar 26 20:51:17.183035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] Instance 946921b2-6fe2-4057-9572-adb926bd277d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:51:17.190609 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-30fec42c-b023-4cdc-beaa-1628a206ee6f req-948d9e68-716a-4551-84af-2963eead33eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049598 Mar 26 20:51:17.191678 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 323/754] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:17.197748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:17.198382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:17.206186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.206186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.206779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.207319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.286098 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-04d09a61-a8ee-4546-9398-b45f1c90ab37 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d/action" status: 204 len: 0 microversion: 2.1 time: 0.092409 Mar 26 20:51:17.287753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 324/755] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:17 2022] POST /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:17.296004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93f74c4e-2a9c-4ff5-9ac8-ec05293e23b0 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1646 microversion: 2.1 time: 0.329689 Mar 26 20:51:17.296632 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 432/756] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:16 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1646 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:17.307226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:17.307226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:17.314978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:17.317227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.317794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.318697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.318847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:17.319322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.333295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.334020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.335452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.336217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.591328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:17.601267 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b52d09d2-40b5-4d4d-bdad-843bc2de531c tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1514 microversion: 2.1 time: 0.310102 Mar 26 20:51:17.601877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 325/757] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:17 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:17.625512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:17.626173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:17.638421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.638885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.640510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.641042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.765842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:17.778236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a3a579c-5f79-4bb1-99a7-9e27cce44821 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.468778 Mar 26 20:51:17.814636 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 433/758] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:17 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:17.827008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:17.832073 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:17.832073 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:17.836284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.838545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.840252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.841756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.920109 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d21cc4ba-e1b7-4468-8ca0-103728317058 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.103896 Mar 26 20:51:17.922632 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 434/759] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:51:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:17.935272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:17.938562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:17.953263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.953739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:17.954999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:17.956810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:18.086558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:18.100341 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c0dcc4a-34c1-4acd-9784-b721cfb4262e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1471 microversion: 2.1 time: 0.483866 Mar 26 20:51:18.105671 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 326/760] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:17 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:18.328781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:18.337058 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36721544-e91d-4efd-bd5e-64cdced4ac5c tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.408659 Mar 26 20:51:18.348620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 435/761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:17 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:18.618860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:18.619635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:18.632982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:18.633514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:18.634528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:18.635048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:18.818780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:18.820098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:18.826710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:18.828081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:18.829191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:18.829764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:18.955016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19597b33d62b4218ad7117bd8a520522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:18.974817 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f043d476-5d28-429c-b4e5-8c9461f9fb95 tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 200 len: 1514 microversion: 2.1 time: 0.359890 Mar 26 20:51:18.976029 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 327/762] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:18 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:18.998616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-cc347c18-2987-4411-99ab-98a761ea3eb5 req-e1ceb099-5ee9-4843-bba4-6c9368dc1d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c", "name": "network-vif-deleted", "tag": "7f9dbd4b-d061-4ca4-82e6-42454e573a0d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:19.069508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cc347c18-2987-4411-99ab-98a761ea3eb5 req-e1ceb099-5ee9-4843-bba4-6c9368dc1d1c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.072432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cc347c18-2987-4411-99ab-98a761ea3eb5 req-e1ceb099-5ee9-4843-bba4-6c9368dc1d1c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.097548 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-cc347c18-2987-4411-99ab-98a761ea3eb5 req-e1ceb099-5ee9-4843-bba4-6c9368dc1d1c service nova] Creating event network-vif-deleted:7f9dbd4b-d061-4ca4-82e6-42454e573a0d for instance 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c on nch1-master-1 Mar 26 20:51:19.104293 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-cc347c18-2987-4411-99ab-98a761ea3eb5 req-e1ceb099-5ee9-4843-bba4-6c9368dc1d1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125673 Mar 26 20:51:19.105038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 328/763] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:19.123854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:19.127229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:19.134374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.135121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.135910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.136387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.165883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:19.185149 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-80bc8809-5a0c-4c4a-b5d1-fe0914e34fd3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.369910 Mar 26 20:51:19.195804 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 436/764] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:18 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:19.306854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:19.317842 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2bdbc6d1-c372-435f-9cb6-f9ee2973ba02 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1471 microversion: 2.1 time: 0.199594 Mar 26 20:51:19.318442 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 329/765] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:19 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:19.355411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:19.355966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:19.362333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.362803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.363666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.364286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.594525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "332c6932-b720-4149-a33d-66740c6c06f2", "device": "/dev/xvdb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:19.596132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:19.602741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.603348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.604500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:19.605285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:19.760979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:19.772295 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-295610e5-ac2a-47cb-a571-c2c7ba2e522d tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.418718 Mar 26 20:51:19.786281 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 437/766] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:19 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:19.899078 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-562d4a64-93cb-40ea-aaa8-1c06ba10d5d1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "POST /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308418 Mar 26 20:51:19.899687 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 330/767] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 20:51:19 2022] POST /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:19.992247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:19.993092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] [instance: 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:20.000514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.001187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.002107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.002751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.018645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] HTTP exception thrown: Instance 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c could not be found. Mar 26 20:51:20.019472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] Returning 404 to user: Instance 83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:20.020417 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f87124a-4f5d-4cd4-b50d-3c6ffb1c46ac tempest-VolumesAdminNegativeTest-1124448885 tempest-VolumesAdminNegativeTest-1124448885-project] 10.222.0.16 "GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c" status: 404 len: 111 microversion: 2.1 time: 0.032086 Mar 26 20:51:20.021375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 438/768] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:19 2022] GET /compute/v2.1/servers/83b8d983-ed6b-4e51-a7d4-8df9c90b1c0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:20.203980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:20.204894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:20.217686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.218383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.219283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.225004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.345042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:20.345917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:20.359808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.363198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.364230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.364780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.555775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:20.563838 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25e569ee-cc53-4a3e-996f-c3c3ee6df6f1 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.364724 Mar 26 20:51:20.573226 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 331/769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:20 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:20.778088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:20.788665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:20.789299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:20.801791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41a8e471-c45f-413f-b689-98423f7ee10d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1463 microversion: 2.1 time: 0.467291 Mar 26 20:51:20.802384 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 439/770] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:20 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1463 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:20.818837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.818837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.818837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.819119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.819527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:20.820265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:20.844483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.845197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:20.847467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:20.848289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.143705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:21.153879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ab916c1-6b09-4a62-9150-5a9897f72ca6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1463 microversion: 2.1 time: 0.338650 Mar 26 20:51:21.157111 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 440/771] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:20 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1463 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:21.171510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-327162ae-fe5b-4056-85cf-19d5de610492 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '.version_select at 0x7f6e59db5550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:21.180570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-327162ae-fe5b-4056-85cf-19d5de610492 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.182361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-327162ae-fe5b-4056-85cf-19d5de610492 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.193539 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-327162ae-fe5b-4056-85cf-19d5de610492 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.025766 Mar 26 20:51:21.194393 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 441/772] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:51:21 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:21.213328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-132aeb69-fc87-4334-9388-24f355eb5635 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:21.229186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-132aeb69-fc87-4334-9388-24f355eb5635 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020259 Mar 26 20:51:21.237670 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 442/773] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:21.245710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-324f75b3-9eb8-4f02-88eb-156325aefa88 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2093529409", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:21.250022 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:21.250022 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:21.259781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:21.268347 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f587da93-fa4f-43f7-a4e5-82cbdb517a25 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.483429 Mar 26 20:51:21.271531 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 332/774] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:20 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:21.278401 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-324f75b3-9eb8-4f02-88eb-156325aefa88 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.039295 Mar 26 20:51:21.287054 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 443/775] 10.222.0.16 () {60 vars in 1145 bytes} [Sat Mar 26 20:51:21 2022] POST /compute/v2.1/flavors => generated 499 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:21.291488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c64262be-a29c-496c-b851-3eb58b248272 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:21.297162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-aa8aef49-837f-4c35-9121-2b1727d6bf9f req-dfca7350-fdc0-4ceb-9c5d-a92564fe9fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946921b2-6fe2-4057-9572-adb926bd277d", "name": "network-vif-plugged", "status": "completed", "tag": "45b38ca2-4fe0-430a-bebd-437115db1ae6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:21.313469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aa8aef49-837f-4c35-9121-2b1727d6bf9f req-dfca7350-fdc0-4ceb-9c5d-a92564fe9fe8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.314852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aa8aef49-837f-4c35-9121-2b1727d6bf9f req-dfca7350-fdc0-4ceb-9c5d-a92564fe9fe8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.317392 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c64262be-a29c-496c-b851-3eb58b248272 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029835 Mar 26 20:51:21.323713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 333/776] 10.222.0.16 () {58 vars in 1181 bytes} [Sat Mar 26 20:51:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 20:51:21.344935 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-aa8aef49-837f-4c35-9121-2b1727d6bf9f req-dfca7350-fdc0-4ceb-9c5d-a92564fe9fe8 service nova] Creating event network-vif-plugged:45b38ca2-4fe0-430a-bebd-437115db1ae6 for instance 946921b2-6fe2-4057-9572-adb926bd277d on nch1-master-1 Mar 26 20:51:21.350981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-aa8aef49-837f-4c35-9121-2b1727d6bf9f req-dfca7350-fdc0-4ceb-9c5d-a92564fe9fe8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060072 Mar 26 20:51:21.352275 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 444/777] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:21.434466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2005835159", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "61883ed4-106e-4e24-b733-cc02cba252d3"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:21.495514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:21.589971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:21.590968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:21.597799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.598505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.599621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.600098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.824386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:21.825047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:21.825547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:21.825987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:21.828282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:21.841703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.842181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.843498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:21.844106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:21.870343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:21.885089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for user 4ef943b3272c48aa884a7ff4a7e854d0 and project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:21.899370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:21.901702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:21.955365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:21.959625 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2a4461ec-34d1-42d2-91b0-4cdd0c85c25f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529055 Mar 26 20:51:21.964577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3939c5f0-4b63-436f-ac64-084d76d8b5f3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.376992 Mar 26 20:51:21.966194 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 334/778] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:21.973526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96c90c42-a212-484b-820e-4420206d39a2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:21.974411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96c90c42-a212-484b-820e-4420206d39a2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:21.976199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 445/779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:21 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:22.048563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96c90c42-a212-484b-820e-4420206d39a2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:22.056247 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96c90c42-a212-484b-820e-4420206d39a2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1279 microversion: 2.1 time: 0.088712 Mar 26 20:51:22.057149 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 335/780] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:21 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:22.286487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:22.287245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:22.298294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.298814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.302697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.304277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.516380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:22.517857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:22.554256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.554883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.562880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.563494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.568825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:22.580547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c577daa-dd73-4c8f-8eda-f43733849faa tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.298607 Mar 26 20:51:22.581450 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 446/781] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:22 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:22.742603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:22.759054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ec39f7af-5877-48de-b045-be80022b5545 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 2128 microversion: 2.25 time: 0.249068 Mar 26 20:51:22.759964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 336/782] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:22 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 2128 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:22.777114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:22.779023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:22.787050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.792123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.793260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:22.793953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:22.819277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'flavor' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:22.835461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Going to try to live migrate instance to nch1-master-1 {{(pid=141581) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:51:22.924728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e596a0e50>, body: {"keypair": {"name": "tempest-keypair-1931817570"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:22.949849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:22.955603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:23.070678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:23.076246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:23.092450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-192ca03b-eb00-43b7-b360-cfa2d1aa11ff tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.299589 Mar 26 20:51:23.093139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 337/783] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:22 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 301 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:23.100924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.101541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:23.107744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.108251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.109881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.110334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.423361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:23.430832 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7be08b61-a504-4fa7-aa04-a38830d9b7fd tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.333699 Mar 26 20:51:23.440616 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 338/784] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:23 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:23.445846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.446455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:23.454233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.454846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.456114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.456549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.537669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:23.547095 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1bf3429-3e27-4e39-9266-c7421f416be7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1337 microversion: 2.1 time: 0.105138 Mar 26 20:51:23.547749 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 339/785] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:23 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:23.559429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c9f2e71-6597-4cb3-b25d-59727f332fce tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e596074c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.566700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c9f2e71-6597-4cb3-b25d-59727f332fce tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1931817570" status: 200 len: 706 microversion: 2.2 time: 0.017839 Mar 26 20:51:23.567604 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 340/786] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Mar 26 20:51:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1931817570 => generated 706 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:23.571909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.572839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:23.579900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.580474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.581338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.581837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.794566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90357210-b913-476b-9b67-19dbf71d46a1 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1692 microversion: 2.1 time: 0.225877 Mar 26 20:51:23.796954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 341/787] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:23 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:23.811041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2fec33ab-bb27-4edd-85ed-a8c2124986f8 req-2c6b932b-37fc-47ee-9c97-2d648bc8bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3da99d9-228b-417e-aff7-488957ac8c33", "name": "network-vif-plugged", "status": "completed", "tag": "be7b6f80-22ba-471b-968f-ba95ce014ba3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:23.820309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2fec33ab-bb27-4edd-85ed-a8c2124986f8 req-2c6b932b-37fc-47ee-9c97-2d648bc8bf0a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.820774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2fec33ab-bb27-4edd-85ed-a8c2124986f8 req-2c6b932b-37fc-47ee-9c97-2d648bc8bf0a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.833021 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2fec33ab-bb27-4edd-85ed-a8c2124986f8 req-2c6b932b-37fc-47ee-9c97-2d648bc8bf0a service nova] Creating event network-vif-plugged:be7b6f80-22ba-471b-968f-ba95ce014ba3 for instance b3da99d9-228b-417e-aff7-488957ac8c33 on nch1-master-1 Mar 26 20:51:23.837960 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2fec33ab-bb27-4edd-85ed-a8c2124986f8 req-2c6b932b-37fc-47ee-9c97-2d648bc8bf0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039564 Mar 26 20:51:23.838557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 342/788] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:23.847906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e55ad81e-9494-4aa9-bc2b-f34e96e6891c tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e59505310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.866522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e55ad81e-9494-4aa9-bc2b-f34e96e6891c tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931817570" status: 204 len: 0 microversion: 2.2 time: 0.023435 Mar 26 20:51:23.867967 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 343/789] 10.222.0.16 () {60 vars in 1260 bytes} [Sat Mar 26 20:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931817570 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:23.876240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:23.877445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:23.885665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.886134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:23.887154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:23.887605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:24.240947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:24.248206 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b762052d-5a65-47f4-8683-06163d439b7e tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1322 microversion: 2.1 time: 0.378983 Mar 26 20:51:24.248779 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 344/790] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:23 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:24.253796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:24.255183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:24.260895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:24.261344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:24.262119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:24.262564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:24.286625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lazy-loading 'flavor' on Instance uuid d2e17aad-e4e4-48db-a406-de8c22855a57 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:24.298472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Going to try to live migrate instance to nch1-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:51:24.452543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73716ad7-cb45-4714-a69b-a328a46460e2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/action" status: 202 len: 0 microversion: 2.25 time: 1.679169 Mar 26 20:51:24.453185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 447/791] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:51:22 2022] POST /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/action => generated 0 bytes in 1681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:24.459602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e595e74c0>, body: {"keypair": {"name": "tempest-keypair-558450048"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:24.526415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:24.538939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:24.847709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:24.853658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:24.879965 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-784f5bf3-40f7-4de2-b099-761f284b2bbb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.424860 Mar 26 20:51:24.884939 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 448/792] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:24 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 426 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:25.034029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d07b9708-f4e8-48ed-87b3-3b85b6242eb2 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.043406 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d07b9708-f4e8-48ed-87b3-3b85b6242eb2 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.161591 Mar 26 20:51:25.044366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 449/793] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:25.056596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.057460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:25.063600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.064324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.065284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.066032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.321867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:25.332615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa06a8fa-ee40-4ca6-b00b-fd980f52c054 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.278977 Mar 26 20:51:25.332615 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 450/794] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:25 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:25.337620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.338249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:25.346735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.347308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.348437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.349204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.531004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:25.542580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:25.544486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:25.546592 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0d1101d1-8d16-43f5-8390-ca08cf9ea8a3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.213031 Mar 26 20:51:25.552361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 451/795] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:25 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:25.564083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.565580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:25.582911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.583397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.584861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.585331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.774846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:25.782430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d60c37ff-da48-4c1c-9941-05c3fcd30aaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.228286 Mar 26 20:51:25.782935 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 452/796] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:25 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:25.787666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d8720ba-d2e2-46a8-90f5-c1426bd52fce tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e5958bee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.807904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d8720ba-d2e2-46a8-90f5-c1426bd52fce tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558450048" status: 204 len: 0 microversion: 2.2 time: 0.023716 Mar 26 20:51:25.808871 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 453/797] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Mar 26 20:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558450048 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:25.820335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c463aae-2551-45da-8088-557bf23cb3ff tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.841689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c463aae-2551-45da-8088-557bf23cb3ff tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3397 microversion: 2.1 time: 0.025898 Mar 26 20:51:25.842553 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 454/798] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:51:25 2022] GET /compute/v2.1/flavors => generated 3397 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:25.847230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:25.848072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:25.854224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.854686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:25.855467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:25.855931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:26.007768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:26.017325 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c5c30066-9740-49fe-9419-dd02aaab82c8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1472 microversion: 2.1 time: 0.173535 Mar 26 20:51:26.018592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 455/799] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:25 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:26.024975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-684141b8-96a5-435b-a2a9-65eac9e2cb12 req-68686d8c-81b3-4dbb-a5b8-72a6a7baab98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:26.051521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-684141b8-96a5-435b-a2a9-65eac9e2cb12 req-68686d8c-81b3-4dbb-a5b8-72a6a7baab98 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:26.052601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-684141b8-96a5-435b-a2a9-65eac9e2cb12 req-68686d8c-81b3-4dbb-a5b8-72a6a7baab98 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:26.065873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-684141b8-96a5-435b-a2a9-65eac9e2cb12 req-68686d8c-81b3-4dbb-a5b8-72a6a7baab98 service nova] Creating event network-changed:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:51:26.071073 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-684141b8-96a5-435b-a2a9-65eac9e2cb12 req-68686d8c-81b3-4dbb-a5b8-72a6a7baab98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050747 Mar 26 20:51:26.072013 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 456/800] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:26.078052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-13d10291-c887-4239-a854-c1d8de0dac24 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e595e7ee0>, body: {"keypair": {"name": "tempest-keypair-676943957", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:26.093703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-13d10291-c887-4239-a854-c1d8de0dac24 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:26.100436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-13d10291-c887-4239-a854-c1d8de0dac24 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:26.129132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-13d10291-c887-4239-a854-c1d8de0dac24 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.055770 Mar 26 20:51:26.129900 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 457/801] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 20:51:26 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Mar 26 20:51:26.135896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eab46c5b-0617-451b-928e-128d6001820e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.147062 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eab46c5b-0617-451b-928e-128d6001820e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015921 Mar 26 20:51:26.148017 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 458/802] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:26.267131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c48de59e-5d93-4efc-9df6-6598aa3a97d9 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:26.268293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c48de59e-5d93-4efc-9df6-6598aa3a97d9 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] [instance: 3c0233d5-6b36-4b6c-81a3-285508626a01] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:26.274397 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c48de59e-5d93-4efc-9df6-6598aa3a97d9 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] HTTP exception thrown: Instance 3c0233d5-6b36-4b6c-81a3-285508626a01 could not be found. Mar 26 20:51:26.275201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c48de59e-5d93-4efc-9df6-6598aa3a97d9 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Returning 404 to user: Instance 3c0233d5-6b36-4b6c-81a3-285508626a01 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:26.277079 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c48de59e-5d93-4efc-9df6-6598aa3a97d9 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3c0233d5-6b36-4b6c-81a3-285508626a01/action" status: 404 len: 111 microversion: 2.1 time: 0.127609 Mar 26 20:51:26.277962 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 459/803] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:26 2022] POST /compute/v2.1/servers/3c0233d5-6b36-4b6c-81a3-285508626a01/action => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:26.283991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-676513e7-cf37-4325-a07e-e4be9282b16b tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e5958baf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.307581 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-676513e7-cf37-4325-a07e-e4be9282b16b tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676943957" status: 204 len: 0 microversion: 2.2 time: 0.028016 Mar 26 20:51:26.314108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 460/804] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Mar 26 20:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676943957 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:26.321702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab8106b4-ae15-4774-bb0a-2a3278b289f4 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.332300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab8106b4-ae15-4774-bb0a-2a3278b289f4 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016467 Mar 26 20:51:26.334336 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 461/805] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:26.342032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e5958e550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1952490206"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:26.364349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:26.370963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:26.470720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7c4afd9-41c8-444a-a4e6-fa0f6d07c78b tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/action" status: 202 len: 0 microversion: 2.1 time: 2.220314 Mar 26 20:51:26.471396 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 345/806] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:24 2022] POST /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/action => generated 0 bytes in 2222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:26.476726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad3419c4-1507-4f67-92c7-14d4bf95da18 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.534951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad3419c4-1507-4f67-92c7-14d4bf95da18 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.061380 Mar 26 20:51:26.537431 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 346/807] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Mar 26 20:51:26 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:26.546106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.546973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:26.555786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:26.556600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:26.557466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:26.558051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:26.772801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:26.777584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:26.791721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dff39318-9090-49df-a069-1da4d3a54e01 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.455660 Mar 26 20:51:26.797148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 462/808] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:26 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 457 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:26.801898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-64349875", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:26.851723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:26.865335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:26.872826 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24a53095-18c8-4954-9e98-fad1a5fe0775 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.331010 Mar 26 20:51:26.873574 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 347/809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:26 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:26.888736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:26.889384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:26.895190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:26.895637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:26.896440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:26.896876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.072579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:27.073008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:27.073483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:27.073896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:27.074567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:27.083518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.083998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.084809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.085250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.103303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Getting quotas for project 54c513bf41bd4101914b82a4b39e4030. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.109189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Getting quotas for user 0d404d270f3a41c9bb725f0ea552c76c and project 54c513bf41bd4101914b82a4b39e4030. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.119208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.121292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:27.123595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:27.127404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cd132d8c-19d7-458e-bf1b-51ee57f33046 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.243540 Mar 26 20:51:27.132602 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 348/810] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:26 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.138645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-97966002-4163-4c57-94a7-0e10bb3a920f tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.148041 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-97966002-4163-4c57-94a7-0e10bb3a920f tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018910 Mar 26 20:51:27.148812 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 349/811] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.153798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.155580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:27.161848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.162408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.164486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.165130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.168181 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3c3fff0-de56-4782-9eb6-8aef1a0cc4b9 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.374847 Mar 26 20:51:27.171309 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 463/812] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:27.174415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.175050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:27.181495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.181952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.182738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.183435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.337778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.347588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.349573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.351871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.353242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e40c39e0-3402-44b8-831c-f4dadbb39dc6 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.203400 Mar 26 20:51:27.353954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 350/813] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:27.359297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e59505790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-777461294"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:27.366857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-200bd768-638d-496c-b910-221906358046 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.196764 Mar 26 20:51:27.367532 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 464/814] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.371872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01db00d5-91f7-4fb8-89ee-bf66849753ea tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.379524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.384961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.397214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01db00d5-91f7-4fb8-89ee-bf66849753ea tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.028624 Mar 26 20:51:27.397859 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 465/815] 10.222.0.16 () {58 vars in 1168 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.403222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86118ebe-de15-4647-8d81-a706f0259549 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.403866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-86118ebe-de15-4647-8d81-a706f0259549 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:27.462863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-86118ebe-de15-4647-8d81-a706f0259549 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:27.471198 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-86118ebe-de15-4647-8d81-a706f0259549 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1220 microversion: 2.1 time: 0.072368 Mar 26 20:51:27.472099 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 466/816] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.476780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1f482c64-5259-430b-8b06-1692d299d070 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.490658 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1f482c64-5259-430b-8b06-1692d299d070 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017495 Mar 26 20:51:27.491698 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 467/817] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.496964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.503427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.504335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6491ed74-0eeb-472e-adf2-0e25a6c2cf3e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.515695 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6491ed74-0eeb-472e-adf2-0e25a6c2cf3e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016465 Mar 26 20:51:27.516680 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 468/818] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.518940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7951ea17-46ab-4b7a-b9b5-aedf55512757 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.163734 Mar 26 20:51:27.519620 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 351/819] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:27 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:27.527911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa8a5d1e-2388-45e7-973c-e30e5c63fb1e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.529185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e594998b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1471578478"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:27.543425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.548960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.567440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa8a5d1e-2388-45e7-973c-e30e5c63fb1e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2989 microversion: 2.1 time: 0.044410 Mar 26 20:51:27.576984 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 469/820] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2989 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.581699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7afbd69d-cb65-436e-b863-c653abffbf6e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.590252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7afbd69d-cb65-436e-b863-c653abffbf6e tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012072 Mar 26 20:51:27.592339 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 470/821] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.601726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb80a60b-cae4-4bac-aa93-f132d91cbaee tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.632535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb80a60b-cae4-4bac-aa93-f132d91cbaee tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.034811 Mar 26 20:51:27.633117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 471/822] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.646107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f8fedd1-68c1-4a81-9ef0-e77c179cb3fd tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.654614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f8fedd1-68c1-4a81-9ef0-e77c179cb3fd tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012943 Mar 26 20:51:27.656139 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 472/823] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.666692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a785f9f5-d54c-4275-aab2-64d155a75504 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.684562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a785f9f5-d54c-4275-aab2-64d155a75504 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.021731 Mar 26 20:51:27.685439 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 473/824] 10.222.0.16 () {58 vars in 1147 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:27.697648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25a01c73-810a-4adc-a5cb-d81521a3ea5c tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.709690 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25a01c73-810a-4adc-a5cb-d81521a3ea5c tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.015584 Mar 26 20:51:27.710310 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 474/825] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:51:27.721275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa570b96-32d1-4ced-84b9-c9ae2a4df46d tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.729232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.729623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa570b96-32d1-4ced-84b9-c9ae2a4df46d tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012261 Mar 26 20:51:27.730260 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 475/826] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:51:27.737556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.741521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3f20a82-a141-4831-a8fa-02f7a145b429 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.753978 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-718c2ed6-0817-4a9f-9fa4-ca55f57bb11e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.228645 Mar 26 20:51:27.754573 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 352/827] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:27 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 230 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:51:27.763044 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3f20a82-a141-4831-a8fa-02f7a145b429 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1618 microversion: 2.1 time: 0.025259 Mar 26 20:51:27.763622 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 476/828] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors?marker=452 => generated 1618 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:27.764447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fcedbe2d-4c71-4d7e-af63-80e81e916c02 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e59499670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.767200 ncdv-master-1 devstack@n-api.service[141580]: WARNING oslo_db.sqlalchemy.utils [None req-fcedbe2d-4c71-4d7e-af63-80e81e916c02 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:51:27.774624 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fcedbe2d-4c71-4d7e-af63-80e81e916c02 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1723 microversion: 2.2 time: 0.014457 Mar 26 20:51:27.775174 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 353/829] 10.222.0.16 () {60 vars in 1176 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/os-keypairs => generated 1723 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:27.775295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6938af63-b340-447b-9e02-2f83d534f788 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.784802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7f071302-0fad-4ffc-950a-3c9150f42189 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e596480d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.796493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6938af63-b340-447b-9e02-2f83d534f788 tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6307 microversion: 2.1 time: 0.024138 Mar 26 20:51:27.797130 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 477/830] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/detail => generated 6307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:27.802553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7f071302-0fad-4ffc-950a-3c9150f42189 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1471578478" status: 204 len: 0 microversion: 2.2 time: 0.021210 Mar 26 20:51:27.803338 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 354/831] 10.222.0.16 () {60 vars in 1320 bytes} [Sat Mar 26 20:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1471578478 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:51:27.812157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-485993d9-ca07-4f62-bd76-2256ec64ede3 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e5958e040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.812693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2a19b4dc-302a-467d-98ea-68e5cbfc52eb tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.823133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2a19b4dc-302a-467d-98ea-68e5cbfc52eb tempest-FlavorsV2TestJSON-1882099139 tempest-FlavorsV2TestJSON-1882099139-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015021 Mar 26 20:51:27.823639 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 355/832] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:27.836587 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-485993d9-ca07-4f62-bd76-2256ec64ede3 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-777461294" status: 204 len: 0 microversion: 2.2 time: 0.028718 Mar 26 20:51:27.837331 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 478/833] 10.222.0.16 () {60 vars in 1317 bytes} [Sat Mar 26 20:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-777461294 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:27.846601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f95b0a42-0d00-4c61-bea9-e05ac8b42f0c tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e59505040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.865176 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f95b0a42-0d00-4c61-bea9-e05ac8b42f0c tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1952490206" status: 204 len: 0 microversion: 2.2 time: 0.023565 Mar 26 20:51:27.865860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 356/834] 10.222.0.16 () {60 vars in 1320 bytes} [Sat Mar 26 20:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1952490206 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:27.875307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e5958b280>, body: {"keypair": {"name": "tempest-keypair-1665000568"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:27.891447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:27.891902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:27.892666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:27.896652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:27.900574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.901035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:27.902840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:27.903440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.086925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.096009 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5fcb74a1-5ca2-467e-898b-5c5eab24ebef tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1473 microversion: 2.1 time: 0.209023 Mar 26 20:51:28.102154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:28.105373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 357/835] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:27 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:28.107134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:28.121968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9ba22f5-5c40-4466-8e47-07c736048b99 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.250637 Mar 26 20:51:28.122673 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 479/836] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:27 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:28.132451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53087307-9f77-4fad-a3eb-c4a7967cc89a tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e594c0ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.139772 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53087307-9f77-4fad-a3eb-c4a7967cc89a tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1665000568" status: 200 len: 707 microversion: 2.2 time: 0.011113 Mar 26 20:51:28.140432 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 358/837] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1665000568 => generated 707 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:28.145052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.145677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:28.151012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8aed93c8-ed9e-435f-816c-987285bdc012 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e594994c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.153597 ncdv-master-1 devstack@n-api.service[141580]: WARNING oslo_db.sqlalchemy.utils [None req-8aed93c8-ed9e-435f-816c-987285bdc012 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:51:28.153982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.154443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.155957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.156833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.168712 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8aed93c8-ed9e-435f-816c-987285bdc012 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.021914 Mar 26 20:51:28.170410 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 359/838] 10.222.0.16 () {60 vars in 1176 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:51:28.181400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77ca5a15-170a-4848-a0d1-4607f0a32ef1 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e594a5a60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.207904 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77ca5a15-170a-4848-a0d1-4607f0a32ef1 tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665000568" status: 204 len: 0 microversion: 2.2 time: 0.030817 Mar 26 20:51:28.208543 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 360/839] 10.222.0.16 () {60 vars in 1260 bytes} [Sat Mar 26 20:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665000568 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:51:28.218643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Action: 'create', calling method: .version_select at 0x7f6e594a5f70>, body: {"keypair": {"name": "tempest-keypair-1424986848", "type": "x509"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:28.237851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:28.243092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:28.262280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.processutils [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpbpagcuxb/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbpagcuxb/temp.key -subj /CN=4eb49b548d3745a7ba0ceecc1030f94f -extensions v3_req_client {{(pid=141580) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:28.402292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.413640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc08caaf-4a28-499d-a31e-4f40dccec145 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.272628 Mar 26 20:51:28.424126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 480/840] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:28.428884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.429497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:28.435654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.436257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.437065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.437485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.736432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.processutils [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpbpagcuxb/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbpagcuxb/temp.key -subj /CN=4eb49b548d3745a7ba0ceecc1030f94f -extensions v3_req_client" returned: 0 in 0.474s {{(pid=141580) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:28.737954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.processutils [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpbpagcuxb/temp.key -password pass: {{(pid=141580) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 26 20:51:28.740210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.750682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.753851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.755094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2b41729-30cb-4f65-b6cc-ed3859a7c816 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.329980 Mar 26 20:51:28.755656 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 481/841] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:28.775733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.776469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.processutils [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpbpagcuxb/temp.key -password pass:" returned: 0 in 0.037s {{(pid=141580) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 26 20:51:28.777245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:28.784212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.786984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.788010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.788745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.822604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:28.828728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Getting quotas for user 4eb49b548d3745a7ba0ceecc1030f94f and project 60d45f79e7e74256970478d54e49d034. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:28.857066 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bb3176b9-376c-4dfc-9ca9-94aeb858b3eb tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.643080 Mar 26 20:51:28.862773 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 361/842] 10.222.0.16 () {62 vars in 1197 bytes} [Sat Mar 26 20:51:28 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 645 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:28.866441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.867236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:28.877431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.877996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.878936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:28.879459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:28.973263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:28.981196 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e5b88f1-6382-4a33-b49a-cc9078ee3a16 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1278 microversion: 2.1 time: 0.120994 Mar 26 20:51:28.982108 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 362/843] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:28.987639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63552990-ea2e-45e8-9643-19fbe66376fe tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e594a5b80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:28.995324 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63552990-ea2e-45e8-9643-19fbe66376fe tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1424986848" status: 200 len: 1534 microversion: 2.2 time: 0.012007 Mar 26 20:51:28.996795 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 363/844] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1424986848 => generated 1534 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:29.010530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6dcf6139-110a-4cb7-8726-3f4f62337d7e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e595443a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:29.017644 ncdv-master-1 devstack@n-api.service[141580]: WARNING oslo_db.sqlalchemy.utils [None req-6dcf6139-110a-4cb7-8726-3f4f62337d7e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:51:29.023332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6dcf6139-110a-4cb7-8726-3f4f62337d7e tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.018214 Mar 26 20:51:29.024598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 364/845] 10.222.0.16 () {60 vars in 1176 bytes} [Sat Mar 26 20:51:29 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:29.037419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-843d0554-0ea7-4ce6-880f-8803d14b3dee tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] Calling method '.version_select at 0x7f6e59513c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:29.073210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:29.084586 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9f25db6-bae3-4377-820e-201955c21f04 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.318386 Mar 26 20:51:29.089312 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-843d0554-0ea7-4ce6-880f-8803d14b3dee tempest-KeyPairsV22TestJSON-1740640205 tempest-KeyPairsV22TestJSON-1740640205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424986848" status: 204 len: 0 microversion: 2.2 time: 0.057635 Mar 26 20:51:29.090235 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 365/846] 10.222.0.16 () {60 vars in 1260 bytes} [Sat Mar 26 20:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424986848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:29.095441 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 482/847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:28 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:29.114672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:29.115623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:29.130387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.131173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.132236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.133625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.431250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:29.431874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:29.440079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.440806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.445647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.446108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.527455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:29.538803 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9aff135-44b4-414e-ba0f-70457829b5fa tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.429139 Mar 26 20:51:29.539416 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 366/848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:29 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:29.774752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:29.775417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:29.783892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.784640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.785616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.786209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.877199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:29.888122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ff77befa-4d59-4844-8185-58bb345e1104 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.460871 Mar 26 20:51:29.892188 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 483/849] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:29 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:29.908858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a2422927-7f32-47e4-9698-bc88c963f58a req-39c6e2de-3187-419b-9e29-3b9ac1bcd3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20", "name": "network-vif-unplugged", "status": "completed", "tag": "d6806923-920b-4eab-b4f5-2134464682ab"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:29.932267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a2422927-7f32-47e4-9698-bc88c963f58a req-39c6e2de-3187-419b-9e29-3b9ac1bcd3b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:29.933775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a2422927-7f32-47e4-9698-bc88c963f58a req-39c6e2de-3187-419b-9e29-3b9ac1bcd3b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:29.960006 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a2422927-7f32-47e4-9698-bc88c963f58a req-39c6e2de-3187-419b-9e29-3b9ac1bcd3b6 service nova] Creating event network-vif-unplugged:d6806923-920b-4eab-b4f5-2134464682ab for instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 on nch2-master-1 Mar 26 20:51:29.966580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a2422927-7f32-47e4-9698-bc88c963f58a req-39c6e2de-3187-419b-9e29-3b9ac1bcd3b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072878 Mar 26 20:51:29.968262 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 484/850] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:30.000866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:30.002833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:30.016972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.020088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.021489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.023658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.162421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:30.173461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:30.175199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:30.176693 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-faa7eba6-8718-49f4-b687-2ad063588103 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.406039 Mar 26 20:51:30.177447 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 367/851] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:29 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:51:30.193663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:30.194281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:30.201135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.202418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.203448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.204154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.549092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:30.559425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9d603fb-36d1-4901-bbbf-503ec4675135 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.564347 Mar 26 20:51:30.562239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 485/852] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:29 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:30.571419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:30.573766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:30.581797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.582631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.583727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.584516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.595884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:30.608882 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f844054-aa53-4589-acd4-2e219a85a0fd tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.418220 Mar 26 20:51:30.609732 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 368/853] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:30 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:30.908735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:30.909406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:30.922856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.923587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:30.927982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:30.928494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.050159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.075392 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85b29638-4a7c-4ac0-a0c2-bc4915b629ff tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.511269 Mar 26 20:51:31.077084 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 486/854] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:30 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:31.087682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b13be80-7886-4ea7-a04b-01115390cc51 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e596fa3a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:31.134619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.158140 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e90f07e-a6a3-4953-897d-be36be821b32 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.254174 Mar 26 20:51:31.167751 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 369/855] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:30 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:31.205555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-32a938d3-c569-43e1-9182-1d4dc5e65b56 req-eb9a4cb8-16f6-4005-a445-c1ab32871fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b58496-7be2-4549-9972-f88f5860a630", "tag": "50c8a773-79de-421d-b7fc-05f78140912b"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:31.210507 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b13be80-7886-4ea7-a04b-01115390cc51 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a" status: 200 len: 636 microversion: 2.1 time: 0.130198 Mar 26 20:51:31.211422 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 487/856] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:31 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a => generated 636 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:31.219266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-32a938d3-c569-43e1-9182-1d4dc5e65b56 req-eb9a4cb8-16f6-4005-a445-c1ab32871fd2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.220066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-32a938d3-c569-43e1-9182-1d4dc5e65b56 req-eb9a4cb8-16f6-4005-a445-c1ab32871fd2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.222640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:31.226454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:31.240825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-32a938d3-c569-43e1-9182-1d4dc5e65b56 req-eb9a4cb8-16f6-4005-a445-c1ab32871fd2 service nova] Creating event network-changed:50c8a773-79de-421d-b7fc-05f78140912b for instance d8b58496-7be2-4549-9972-f88f5860a630 on nch2-master-1 Mar 26 20:51:31.243392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.245517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.246594 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-32a938d3-c569-43e1-9182-1d4dc5e65b56 req-eb9a4cb8-16f6-4005-a445-c1ab32871fd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076596 Mar 26 20:51:31.247710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 370/857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:31.248438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.249891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.266965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-adb4320d-f9ae-4cce-aaaf-cb13934abe12 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e594d39d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:31.335005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-adb4320d-f9ae-4cce-aaaf-cb13934abe12 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:31.345781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-adb4320d-f9ae-4cce-aaaf-cb13934abe12 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:31.587547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.602719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.604753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.605941 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad4ec885-90d9-4fb8-98c3-5b5503901974 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.393492 Mar 26 20:51:31.613263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 488/858] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:31 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:31.627963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:31.629340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:31.646563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.649187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.650274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.650729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.763618 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-adb4320d-f9ae-4cce-aaaf-cb13934abe12 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.514462 Mar 26 20:51:31.764973 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 371/859] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:31 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:31.771759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:31.772971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:31.780587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.781261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.782214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:31.782844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:31.917089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:31.924981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de542202-7c94-42d9-a7f3-163cf3a9db85 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.310459 Mar 26 20:51:31.939152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 489/860] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:31 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:31.950096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d1cc7ce-e412-4f28-8c16-4542ce49822d tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e595ac0d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.026739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:32.036809 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-721554b6-25d5-46bb-9a25-75799c919568 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.270326 Mar 26 20:51:32.037451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 372/861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:31 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:32.043830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7feaab8a-068d-4c70-9a37-0bfcbf86dda2 req-747551cf-b705-46d1-8602-fa5ebb3d5a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-plugged", "status": "completed", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:32.057740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7feaab8a-068d-4c70-9a37-0bfcbf86dda2 req-747551cf-b705-46d1-8602-fa5ebb3d5a8d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.058475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7feaab8a-068d-4c70-9a37-0bfcbf86dda2 req-747551cf-b705-46d1-8602-fa5ebb3d5a8d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.076063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7feaab8a-068d-4c70-9a37-0bfcbf86dda2 req-747551cf-b705-46d1-8602-fa5ebb3d5a8d service nova] Creating event network-vif-plugged:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:51:32.082380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7feaab8a-068d-4c70-9a37-0bfcbf86dda2 req-747551cf-b705-46d1-8602-fa5ebb3d5a8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043489 Mar 26 20:51:32.083367 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 373/862] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:32.092497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-43eef7d9-32fe-464e-a5ad-19f8a4ddfd29 req-41311663-885f-4621-97c9-783014746ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20", "tag": "d6806923-920b-4eab-b4f5-2134464682ab"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:32.102680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-43eef7d9-32fe-464e-a5ad-19f8a4ddfd29 req-41311663-885f-4621-97c9-783014746ac0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.103364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-43eef7d9-32fe-464e-a5ad-19f8a4ddfd29 req-41311663-885f-4621-97c9-783014746ac0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.120070 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-43eef7d9-32fe-464e-a5ad-19f8a4ddfd29 req-41311663-885f-4621-97c9-783014746ac0 service nova] Creating event network-changed:d6806923-920b-4eab-b4f5-2134464682ab for instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 on nch2-master-1 Mar 26 20:51:32.127531 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-43eef7d9-32fe-464e-a5ad-19f8a4ddfd29 req-41311663-885f-4621-97c9-783014746ac0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041574 Mar 26 20:51:32.129025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 374/863] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:32.138245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.139182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:32.148048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.148867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.149863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.150455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.427151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d1cc7ce-e412-4f28-8c16-4542ce49822d tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "DELETE /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.486592 Mar 26 20:51:32.427730 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 490/864] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 20:51:31 2022] DELETE /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_version => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:32.435030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.436197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:32.444654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.445989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.447674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.449107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.473910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:32.484861 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb01afd4-08ae-4caa-a5d0-05c5105f6e91 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.354484 Mar 26 20:51:32.494211 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 375/865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:32 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:32.502200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-34e3d3b2-4016-440f-b65d-1fef9f820083 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e594c0af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.552026 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-34e3d3b2-4016-440f-b65d-1fef9f820083 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.055665 Mar 26 20:51:32.552026 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 376/866] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:32 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 37 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:32.561919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb4ae5a9-433b-46d2-805b-b701b64d2f14 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e59597310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:32.626554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cb4ae5a9-433b-46d2-805b-b701b64d2f14 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:32.631910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cb4ae5a9-433b-46d2-805b-b701b64d2f14 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:32.823653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:32.836942 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48b8bedc-b431-42ee-9353-64586239b59c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.407473 Mar 26 20:51:32.839170 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 491/867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:32 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:32.847684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.851244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:32.861486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.862450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.863551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.865112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.970835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb4ae5a9-433b-46d2-805b-b701b64d2f14 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.412946 Mar 26 20:51:32.971665 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 377/868] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:32 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:32.980499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:32.981383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:32.988987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.989441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:32.990227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:32.990666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.151073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.158855 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c80325f-06e9-44c5-8805-4685e77349e7 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.186188 Mar 26 20:51:33.159420 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 378/869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:32 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:33.163956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cbf56dc-7871-4a78-961e-c405d4d2522b tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e594d0820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.203953 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cbf56dc-7871-4a78-961e-c405d4d2522b tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.043468 Mar 26 20:51:33.204675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 379/870] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_distro => generated 33 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:33.213139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.213764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:33.219694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.220187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.221035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.221428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.275505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.285122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.287052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.288960 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f019123-1a5a-4ca1-b945-5d26a054a36e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.447581 Mar 26 20:51:33.290124 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 492/871] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:32 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:33.295233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a32dfa9-b0b9-460e-9d7a-47c77cd0c517 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e5958e1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:33.354539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a32dfa9-b0b9-460e-9d7a-47c77cd0c517 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:33.359642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a32dfa9-b0b9-460e-9d7a-47c77cd0c517 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:33.372235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.381016 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-adcbe9b9-5ca8-438b-892c-a0e53e2a175c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.175092 Mar 26 20:51:33.388337 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 380/872] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:33.505884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.508510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:33.515187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.515907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.516897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.517490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.628410 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a32dfa9-b0b9-460e-9d7a-47c77cd0c517 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.336589 Mar 26 20:51:33.629024 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 493/873] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:33 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:33.690542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:33.698013 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-559b3467-44a5-4dba-b25e-43702853afd7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.199381 Mar 26 20:51:33.698585 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 381/874] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:33.707510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-310a6c58-af98-41d0-94af-ca95f7d57b7f tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e59648160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.745721 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-310a6c58-af98-41d0-94af-ca95f7d57b7f tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.045854 Mar 26 20:51:33.746291 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 382/875] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:33.756460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca702532-41f8-458e-bf2c-971bffa98f19 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e594e0a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:33.757237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Calling method '.version_select at 0x7f6e5952daf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.777735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 437802dd-670b-4ee5-aca7-63d0867290b6 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:51:33.778351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Neutron security group 437802dd-670b-4ee5-aca7-63d0867290b6 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:51:33.778884 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] HTTP exception thrown: Security group 437802dd-670b-4ee5-aca7-63d0867290b6 does not exist Mar 26 20:51:33.778884 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-d6914bea-d7a1-4685-b7eb-9f0c2808ce06'] Mar 26 20:51:33.779672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Returning 404 to user: Security group 437802dd-670b-4ee5-aca7-63d0867290b6 does not exist Mar 26 20:51:33.779672 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-d6914bea-d7a1-4685-b7eb-9f0c2808ce06'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:33.780389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08232d03-356d-4053-a61d-defc8316cd00 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/437802dd-670b-4ee5-aca7-63d0867290b6" status: 404 len: 194 microversion: 2.1 time: 0.150442 Mar 26 20:51:33.781021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 494/876] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:51:33 2022] DELETE /compute/v2.1/os-security-groups/437802dd-670b-4ee5-aca7-63d0867290b6 => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:33.790591 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56de1987-684f-4809-b463-96ee8cc293bb tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004625 Mar 26 20:51:33.791129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 495/877] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Mar 26 20:51:33 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 26 20:51:33.799462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19c972e6-e51a-44c2-a355-a777f341c939 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Calling method '.version_select at 0x7f6e5952d820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.804105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ca702532-41f8-458e-bf2c-971bffa98f19 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:33.808957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ca702532-41f8-458e-bf2c-971bffa98f19 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:33.945739 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19c972e6-e51a-44c2-a355-a777f341c939 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.150138 Mar 26 20:51:33.946357 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 496/878] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:51:33.956566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:33.957178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:33.963176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.963635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:33.964448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:33.964896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.046228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca702532-41f8-458e-bf2c-971bffa98f19 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.292744 Mar 26 20:51:34.046833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 383/879] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:33 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 20:51:34.051677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6db75ec7-885a-423d-a2d7-f7bbf45525a8 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Calling method '.version_select at 0x7f6e594d03a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.100099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.108655 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d24ee10-ca69-4fd8-8987-7b0e51ca5c7c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.155153 Mar 26 20:51:34.109219 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 497/880] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:33 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:34.114037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fdb7d0f-274a-4605-ac33-ae4bc20c5929 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e5952d0d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:34.157585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-6db75ec7-885a-423d-a2d7-f7bbf45525a8 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:51:34.158352 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-6db75ec7-885a-423d-a2d7-f7bbf45525a8 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] HTTP exception thrown: Insufficient rights for removing default security group. Mar 26 20:51:34.158352 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-2f791ea4-96a3-4767-8144-7b742117b405'] Mar 26 20:51:34.158972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6db75ec7-885a-423d-a2d7-f7bbf45525a8 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Returning 400 to user: Insufficient rights for removing default security group. Mar 26 20:51:34.158972 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-2f791ea4-96a3-4767-8144-7b742117b405'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:34.159825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6db75ec7-885a-423d-a2d7-f7bbf45525a8 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/bd5d9332-9cbf-4346-b43a-ce5735be5ca4" status: 400 len: 182 microversion: 2.1 time: 0.112060 Mar 26 20:51:34.160418 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 384/881] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:51:34 2022] DELETE /compute/v2.1/os-security-groups/bd5d9332-9cbf-4346-b43a-ce5735be5ca4 => generated 182 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:51:34.161747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1fdb7d0f-274a-4605-ac33-ae4bc20c5929 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:34.170937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1fdb7d0f-274a-4605-ac33-ae4bc20c5929 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:34.173596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Calling method '.version_select at 0x7f6e59499790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.196192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fb46d2e-bdce-447e-b521-8184db61f802 does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:51:34.197154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Neutron security group 2fb46d2e-bdce-447e-b521-8184db61f802 not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:51:34.197711 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] HTTP exception thrown: Security group 2fb46d2e-bdce-447e-b521-8184db61f802 does not exist Mar 26 20:51:34.197711 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-a6c30b16-a5ff-4524-9ef6-43dab22c66f0'] Mar 26 20:51:34.198283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Returning 404 to user: Security group 2fb46d2e-bdce-447e-b521-8184db61f802 does not exist Mar 26 20:51:34.198283 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-a6c30b16-a5ff-4524-9ef6-43dab22c66f0'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:34.199351 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d77fe0d-03ce-4674-a66c-e2f11e831188 tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/2fb46d2e-bdce-447e-b521-8184db61f802" status: 404 len: 194 microversion: 2.1 time: 0.030133 Mar 26 20:51:34.202114 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 385/882] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/os-security-groups/2fb46d2e-bdce-447e-b521-8184db61f802 => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:51:34.207743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.208398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:34.214740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.215195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.216003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.216453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.354128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.361455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c2870ce-348f-4015-bc87-caef752194b3 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.157521 Mar 26 20:51:34.362026 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 386/883] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:34.366313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-57b9f07c-0923-4b9d-8262-02711fe9cc66 req-bf03d8fe-d118-445c-b617-3a3e65793010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-unplugged", "status": "completed", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:34.374174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-57b9f07c-0923-4b9d-8262-02711fe9cc66 req-bf03d8fe-d118-445c-b617-3a3e65793010 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.374614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-57b9f07c-0923-4b9d-8262-02711fe9cc66 req-bf03d8fe-d118-445c-b617-3a3e65793010 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.385384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-57b9f07c-0923-4b9d-8262-02711fe9cc66 req-bf03d8fe-d118-445c-b617-3a3e65793010 service nova] Creating event network-vif-unplugged:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:51:34.390821 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-57b9f07c-0923-4b9d-8262-02711fe9cc66 req-bf03d8fe-d118-445c-b617-3a3e65793010 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027701 Mar 26 20:51:34.391566 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 387/884] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:34.396468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Action: 'update', calling method: .version_select at 0x7f6e59499d30>, body: {"security_group": {"name": "tempest-sg-9138908", "description": "tempest-description-669224273"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:34.417747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 603fe27c-8134-4db1-be1a-b68424547b80 does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:51:34.418341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Neutron security group 603fe27c-8134-4db1-be1a-b68424547b80 not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:51:34.418888 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] HTTP exception thrown: Security group 603fe27c-8134-4db1-be1a-b68424547b80 does not exist Mar 26 20:51:34.418888 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-d3d72dcd-2c10-4177-b45b-bd2504c51dc5'] Mar 26 20:51:34.419457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] Returning 404 to user: Security group 603fe27c-8134-4db1-be1a-b68424547b80 does not exist Mar 26 20:51:34.419457 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-d3d72dcd-2c10-4177-b45b-bd2504c51dc5'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:34.420704 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f55b361-c5df-4c53-93b1-2e3f18a3373d tempest-SecurityGroupsNegativeTestJSON-665159390 tempest-SecurityGroupsNegativeTestJSON-665159390-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/603fe27c-8134-4db1-be1a-b68424547b80" status: 404 len: 194 microversion: 2.1 time: 0.028152 Mar 26 20:51:34.421267 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 388/885] 10.222.0.16 () {60 vars in 1288 bytes} [Sat Mar 26 20:51:34 2022] PUT /compute/v2.1/os-security-groups/603fe27c-8134-4db1-be1a-b68424547b80 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:34.425756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.426486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:34.433743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.434200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.435148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.435600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.493878 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fdb7d0f-274a-4605-ac33-ae4bc20c5929 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.383275 Mar 26 20:51:34.495117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 498/886] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:34 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 64 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:34.501280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.502709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:34.511664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.512527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.513308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.514525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.579436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.587869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.589409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.590563 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-503dbce9-7161-454a-ba99-3f1ee36264fa tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.168396 Mar 26 20:51:34.591342 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 389/887] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:34.595534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c91b967e-56e2-4625-bb53-a0fb267740da tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e594d0310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.637388 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c91b967e-56e2-4625-bb53-a0fb267740da tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.045232 Mar 26 20:51:34.638127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 390/888] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 64 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:34.648217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11051cb2-ab81-49cd-b46c-d58de9ecaf46 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e59499160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:34.696271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-11051cb2-ab81-49cd-b46c-d58de9ecaf46 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:34.701607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-11051cb2-ab81-49cd-b46c-d58de9ecaf46 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:34.746035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.755595 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10d4892b-f5f8-40f8-a833-d2ec739b7248 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1379 microversion: 2.1 time: 0.258913 Mar 26 20:51:34.756183 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 499/889] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1379 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:34.763887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:34.765167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:34.772074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.772607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.773457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:34.773913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:34.943690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:34.951947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4eebf7e4-768d-4dfd-869f-29c12784c59f tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.194508 Mar 26 20:51:34.952532 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 500/890] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:34 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:35.068876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11051cb2-ab81-49cd-b46c-d58de9ecaf46 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.424444 Mar 26 20:51:35.069476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 391/891] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:34 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 20:51:35.078897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a55a5f3f-fcf2-419c-8ae7-87a7c03d0f82 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update', calling method: .version_select at 0x7f6e5958e9d0>, body: {"meta": {"os_version": "alt"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:35.126268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:35.127237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:35.128551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a55a5f3f-fcf2-419c-8ae7-87a7c03d0f82 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:35.135852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.136421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a55a5f3f-fcf2-419c-8ae7-87a7c03d0f82 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:35.137050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.138230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.138678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.309230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:35.319294 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1d48df6f-56a8-438a-a739-9cd29014bb65 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.197513 Mar 26 20:51:35.319978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 392/892] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:35 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:35.380367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:35.380367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:35.386244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.386808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.387790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.388719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.446382 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a55a5f3f-fcf2-419c-8ae7-87a7c03d0f82 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.371238 Mar 26 20:51:35.447515 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 501/893] 10.222.0.16 () {60 vars in 1312 bytes} [Sat Mar 26 20:51:35 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata/os_version => generated 31 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:35.457469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5071bf8-a757-4ee5-8dc7-4ec316882c74 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e59529280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:35.499894 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5071bf8-a757-4ee5-8dc7-4ec316882c74 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046306 Mar 26 20:51:35.500621 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 502/894] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:35 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 58 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:35.510756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b6b3251-9ab8-4d97-8a12-980a697823e3 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'update_all', calling method: .version_select at 0x7f6e595d5040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:35.564573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b6b3251-9ab8-4d97-8a12-980a697823e3 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:35.567050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:35.570590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b6b3251-9ab8-4d97-8a12-980a697823e3 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:35.575121 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4d4c48c-414d-43b8-9068-742dbf085cd8 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.200541 Mar 26 20:51:35.576246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 393/895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:35 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:35.609514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:35.610809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:35.618294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.618973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.620699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.621527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.777923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:35.787877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:35.790112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:35.791789 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5e5a34e-7526-49c7-92ae-b6d8df6b42b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.187355 Mar 26 20:51:35.792544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 394/896] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:35 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:51:35.800362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:35.801449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:35.815395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.816406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.816989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:35.817937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:35.993061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:36.002412 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-236125d9-3792-4f17-9db1-ca78b1ddc8b9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1529 microversion: 2.1 time: 0.208175 Mar 26 20:51:36.014883 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 395/897] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:35 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1529 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:36.020678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.021420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.030401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.031032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.032112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.032836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.035314 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b6b3251-9ab8-4d97-8a12-980a697823e3 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.528308 Mar 26 20:51:36.036022 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 503/898] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:51:35 2022] PUT /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 61 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 20:51:36.045933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.049064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.069515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.069974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.074817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.075276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.195708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:36.205512 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-681c8e85-572d-4b5b-b493-bf4343cd8cbc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.188881 Mar 26 20:51:36.206081 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 396/899] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:36.212836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-287bd698-0bf7-4fd0-a5f6-35018857a513 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Action: 'create', calling method: .version_select at 0x7f6e59499430>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:36.244327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:36.254542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6dc0a457-11c6-45ea-92c3-c2b74ff8fa22 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1529 microversion: 2.1 time: 0.213260 Mar 26 20:51:36.255286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 504/900] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1529 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:36.268782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-287bd698-0bf7-4fd0-a5f6-35018857a513 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:36.272682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a93afc4c-d6d8-44d2-9e91-ed80ff68b34d tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.273768 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:51:36.273768 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:51:36.282931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-287bd698-0bf7-4fd0-a5f6-35018857a513 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Getting quotas for user 0520acbd176641c2b46226fa3febe61a and project 299001bd661045f59e40ea0fac0af324. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:36.293459 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a93afc4c-d6d8-44d2-9e91-ed80ff68b34d tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/61883ed4-106e-4e24-b733-cc02cba252d3" status: 202 len: 0 microversion: 2.1 time: 0.024819 Mar 26 20:51:36.294201 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 505/901] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:36 2022] DELETE /compute/v2.1/flavors/61883ed4-106e-4e24-b733-cc02cba252d3 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:51:36.304785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-876538b2-4372-475a-a347-a7409b6473dc tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.337653 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-876538b2-4372-475a-a347-a7409b6473dc tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.038352 Mar 26 20:51:36.338373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 506/902] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:36.352385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.353013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.359393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.359600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.360952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.361079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.510493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:36.518391 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c2a83734-0049-4879-9bc5-7df79ba7cdf5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.179167 Mar 26 20:51:36.518976 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 507/903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:36.532936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:36.534086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.541206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.541884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.542863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.543458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.572429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:36.580492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Old instance type tempest-test_resize_flavor_-2093529409, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 20:51:36.592059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:36.592492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:36.593437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:36.593437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:36.594052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:36.672199 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-287bd698-0bf7-4fd0-a5f6-35018857a513 tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "POST /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.464202 Mar 26 20:51:36.673860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 397/904] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Mar 26 20:51:36 2022] POST /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 85 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:36.679021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7ce3b451-b758-45c6-a026-b2ce29807fe2 req-2ae5b7bb-596b-4a8e-ab88-bc33934c6226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-plugged", "status": "completed", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:36.689756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7ce3b451-b758-45c6-a026-b2ce29807fe2 req-2ae5b7bb-596b-4a8e-ab88-bc33934c6226 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.690450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7ce3b451-b758-45c6-a026-b2ce29807fe2 req-2ae5b7bb-596b-4a8e-ab88-bc33934c6226 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.701998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f1cc202-8575-458a-b83e-a9d31fe7f323 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650/action" status: 202 len: 0 microversion: 2.1 time: 0.172709 Mar 26 20:51:36.705788 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 508/905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:36 2022] POST /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:36.705918 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7ce3b451-b758-45c6-a026-b2ce29807fe2 req-2ae5b7bb-596b-4a8e-ab88-bc33934c6226 service nova] Creating event network-vif-plugged:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:51:36.708125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.708824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.710260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7ce3b451-b758-45c6-a026-b2ce29807fe2 req-2ae5b7bb-596b-4a8e-ab88-bc33934c6226 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Mar 26 20:51:36.710997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 398/906] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:36.715873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bdba7987-793f-42f3-b77c-d515ef8837eb tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] Calling method '.version_select at 0x7f6e594d0160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.716497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.717142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.718041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.718595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.790024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bdba7987-793f-42f3-b77c-d515ef8837eb tempest-ImagesMetadataTestJSON-473872553 tempest-ImagesMetadataTestJSON-473872553-project] 10.222.0.16 "GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.077967 Mar 26 20:51:36.790603 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 399/907] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/images/298e3ee8-3ae0-4b93-8468-764027717d1a/metadata => generated 85 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:51:36.800029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:36.800962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:36.814702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.815236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:36.817532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:36.818241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.127450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.143348 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-42c871a5-d71d-422b-a3ae-eecede165ffe tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.435085 Mar 26 20:51:37.145179 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 509/908] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:37.162662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:37.165004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:37.173744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.175955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.176612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.177400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.177834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.184637 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df4f7857-9bc2-497e-8286-fa5c6cdbf8fc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1538 microversion: 2.1 time: 0.392561 Mar 26 20:51:37.184809 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 400/909] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:36 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1538 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:37.222648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:37.223297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:37.230031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.230491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.231457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.232122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.397001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.409422 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c880b477-8ac7-49f6-9a2d-3915ea41bb17 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1479 microversion: 2.1 time: 0.190564 Mar 26 20:51:37.411436 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 401/910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:37 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1479 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:37.536755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:37.537432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:37.543995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.544522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.545853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:37.546302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:37.616142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.630753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.633142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.634404 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8fac5aa6-b4d4-4185-b71b-f7abdbef115e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.480787 Mar 26 20:51:37.635004 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 510/911] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:37 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:37.808148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:37.824866 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fae62e65-3c33-49fd-86a7-c90752e1c535 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.293059 Mar 26 20:51:37.825775 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 402/912] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:37 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:38.134206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1169558730", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "29f25562-2089-4ea5-a798-18bd9113e9ac"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:38.163495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:38.164463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:38.174704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.178628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.181591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.182976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.209302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] validate_networks() for [('29f25562-2089-4ea5-a798-18bd9113e9ac', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:38.503764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:38.512984 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ef77637-d59b-4f10-bf47-9df88a81768f tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.354917 Mar 26 20:51:38.538825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 403/913] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:38 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:38.544322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:38.544975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:38.566463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.567323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.568560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.569073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.783291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:38.784261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:38.785024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:38.785515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:38.786213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:38.797257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.797968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.798989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.799741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.818095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:38.824508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for user b5effd8428df4616865ee71160f53594 and project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:38.841252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:38.846112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:38.858430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:38.865801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b01413d4-bcc3-47a9-932f-8c53f8a11a99 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1538 microversion: 2.1 time: 0.325555 Mar 26 20:51:38.866575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 404/914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:38 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1538 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:38.872592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:38.873342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:38.883242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.884181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.885263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.886048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.917272 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fee759a7-29c4-42f3-b6fb-e38931071dee tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860374 Mar 26 20:51:38.918695 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 511/915] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:38.924460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:38.925478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:38.931997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.932697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:38.933675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:38.934477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.098830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.110837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.112902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.113981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-77c9ea3f-209b-4541-acda-6a1a4bac4fe4 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1646 microversion: 2.25 time: 0.193393 Mar 26 20:51:39.121003 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 512/916] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:38 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1646 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:39.129827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3b2d5b6f-a6f3-424e-bf3a-73929854c6f7 req-eb57e917-8245-4078-a27a-ca5bc315799f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b58496-7be2-4549-9972-f88f5860a630", "name": "network-vif-plugged", "status": "completed", "tag": "50c8a773-79de-421d-b7fc-05f78140912b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:39.144361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3b2d5b6f-a6f3-424e-bf3a-73929854c6f7 req-eb57e917-8245-4078-a27a-ca5bc315799f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.145066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3b2d5b6f-a6f3-424e-bf3a-73929854c6f7 req-eb57e917-8245-4078-a27a-ca5bc315799f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.158874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3b2d5b6f-a6f3-424e-bf3a-73929854c6f7 req-eb57e917-8245-4078-a27a-ca5bc315799f service nova] Creating event network-vif-plugged:50c8a773-79de-421d-b7fc-05f78140912b for instance d8b58496-7be2-4549-9972-f88f5860a630 on nch2-master-1 Mar 26 20:51:39.164720 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3b2d5b6f-a6f3-424e-bf3a-73929854c6f7 req-eb57e917-8245-4078-a27a-ca5bc315799f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041082 Mar 26 20:51:39.165590 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 513/917] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:39.171599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:39.173086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.181692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.182154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.182958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.185493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.547694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.560385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31c314d7-d757-47e8-b918-679221d48a4d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1464 microversion: 2.1 time: 0.692455 Mar 26 20:51:39.572082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 405/918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:38 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1464 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:39.580370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:39.581027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.602164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.603638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.604652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.605407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.622774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.636686 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08c7b6bd-cdb5-4454-b7cc-c87c9e1b7263 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.467069 Mar 26 20:51:39.637482 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 514/919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:39 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:39.652012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:39.652800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.665262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.666501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.668853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.669501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.713023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.721921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11e6304b-25f5-4eb8-9251-a1d3c3a402b1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1222 microversion: 2.1 time: 0.148602 Mar 26 20:51:39.722789 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 406/920] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:39 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:39.728001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:39.729144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.736838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.737494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.738278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.738782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.869664 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67b14d83-f044-42b7-a90a-2f569359c5a9 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 0 microversion: 2.1 time: 0.144467 Mar 26 20:51:39.871801 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 407/921] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:39 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:39.881876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:39.883651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.894330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.895298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.896545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.897194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.930049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:39.939411 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46654c84-ffc6-4ccc-a781-ebc2e19a6695 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1320 microversion: 2.1 time: 0.299519 Mar 26 20:51:39.940453 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 515/922] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:39 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:39.947212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:39.948309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:39.957849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.958558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.959868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.960676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.967940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:39.969270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:39.970335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lazy-loading 'fault' on Instance uuid 7681c708-82a7-4715-8408-9ff49d5039af {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:40.266789 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bde3fb8f-821b-4ce7-b4f9-1b79d2fcbda0 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1598 microversion: 2.1 time: 0.390110 Mar 26 20:51:40.267542 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 408/923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:39 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1598 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:40.272997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:40.274129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:40.282019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.282848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.284317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.284982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.427459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:40.438352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1fb69be-0655-4536-8401-5b6eb4e1712b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1538 microversion: 2.1 time: 0.493205 Mar 26 20:51:40.438837 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 516/924] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:39 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1538 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:40.443409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:40.444477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:40.456629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.458342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.459238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.460068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.560071 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df9d4055-f9a0-46b7-ae5c-95bec5469e30 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action" status: 202 len: 0 microversion: 2.1 time: 0.119911 Mar 26 20:51:40.564198 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 517/925] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:40 2022] POST /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:40.577401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:40.578315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:40.590112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.591218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.594548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.595310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.728034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:40.741732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:40.744024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:40.745399 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e89272f-072d-4c40-9d2c-f397dba8ae32 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1636 microversion: 2.25 time: 0.476683 Mar 26 20:51:40.746172 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 409/926] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:40 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1636 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:40.751085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:40.751623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:40.762353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.763253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.764553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.765721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.895201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d554799-5413-42c5-8ee2-d703d79257c2 tempest-ServersAdminTestJSON-1469066631 tempest-ServersAdminTestJSON-1469066631-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1615 microversion: 2.1 time: 0.329374 Mar 26 20:51:40.896343 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 518/927] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:40 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1615 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:40.902729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:40.903613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:40.912341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.912794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:40.913674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:40.914025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.008543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:41.013231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:41.016997 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b7e76e9-8336-4830-94d6-ffccdde1cb2f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.269514 Mar 26 20:51:41.027037 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 410/928] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:40 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:41.037523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e47e7705-7612-4342-b87d-05ec0ceacae3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1276 microversion: 2.1 time: 0.133232 Mar 26 20:51:41.037523 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 519/929] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:40 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:41.048733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.048733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:41.052431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8834aa8-becd-4f29-a690-266a00202733 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '.version_select at 0x7f6e594994c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.059506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8834aa8-becd-4f29-a690-266a00202733 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.059687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.060043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.060606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8834aa8-becd-4f29-a690-266a00202733 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.061065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.061511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.085990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8834aa8-becd-4f29-a690-266a00202733 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4289 microversion: 2.25 time: 0.057642 Mar 26 20:51:41.092871 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 411/930] 10.222.0.16 () {60 vars in 1183 bytes} [Sat Mar 26 20:51:41 2022] GET /compute/v2.1/os-migrations => generated 4289 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:41.097783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.100257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:41.109165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.109869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.110820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.111419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.132668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:41.259118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38b266c7-f17d-46c5-a642-f24455a37db7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 204 len: 0 microversion: 2.1 time: 0.225192 Mar 26 20:51:41.260143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 520/931] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:41 2022] DELETE /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:41.271276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.272190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:41.285738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.286397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.287474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.288118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.478226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:41.495803 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c3e1e83-8644-48a2-9301-e3cfaef876da tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1470 microversion: 2.1 time: 0.401657 Mar 26 20:51:41.496853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:41.498485 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 412/932] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:41 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:41.511842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.512801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:41.514774 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f103eabb-08c9-45e5-894a-6a766a4baebf tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 2128 microversion: 2.25 time: 0.252352 Mar 26 20:51:41.519969 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 521/933] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:41 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 2128 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:41.520127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.520229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.520949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.521393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.664444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-19936078", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:41.720488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:41.773634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:41.782242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3319f6d0-b7ea-441f-b516-b48801b77af3 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1470 microversion: 2.1 time: 0.280874 Mar 26 20:51:41.782809 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 413/934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:41 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:41.787514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:41.788410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:41.795749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.796248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:41.797155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:41.797599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.064322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:42.071989 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1560566-0bb2-49b3-a36d-8c10f1a0d337 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.287999 Mar 26 20:51:42.072796 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 414/935] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:41 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:42.077768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:42.078451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.084796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.085733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.086522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.087122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.113154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lazy-loading 'flavor' on Instance uuid d8b58496-7be2-4549-9972-f88f5860a630 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:42.192727 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5627201c-1d47-4433-ba02-27e856ad8283 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630/action" status: 202 len: 0 microversion: 2.1 time: 0.118258 Mar 26 20:51:42.193640 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 415/936] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:42 2022] POST /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:51:42.199520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:42.200519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.207344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.208119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.209050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.209696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.305396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:42.305817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:42.306532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:42.306967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:42.307413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:42.316847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.317556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.318366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.318970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.337678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:42.343621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:42.356962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:42.360643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:42.406121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd92ebf2-9e24-44c6-ab2f-01d85310de31 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888988 Mar 26 20:51:42.407176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 522/937] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:42.412081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:42.412705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.419412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.420466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.421328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.421783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.467406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:42.493434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17e1d22f-205f-4c99-8cad-2f4d079b8ff1 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 2128 microversion: 2.25 time: 0.297883 Mar 26 20:51:42.494867 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 416/938] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:51:42 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 2128 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:51:42.501982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:42.502667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.509867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.510664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.511529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.512094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.681943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:42.693902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56077932-93ab-48ed-8dff-a4c3c621b276 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.285592 Mar 26 20:51:42.694894 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 523/939] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:42 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:42.699636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:42.700502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.709981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.710560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.711527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:42.712112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:42.858135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:42.871707 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0dede4c0-3967-4380-9142-2f6364ea69c1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.372480 Mar 26 20:51:42.872581 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 417/940] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:42 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:42.884045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2225f46-89da-40b2-83c3-bd0ec6b93386 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:42.884999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d2225f46-89da-40b2-83c3-bd0ec6b93386 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:42.990896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2225f46-89da-40b2-83c3-bd0ec6b93386 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:42.998119 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2225f46-89da-40b2-83c3-bd0ec6b93386 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1191 microversion: 2.1 time: 0.122735 Mar 26 20:51:42.998699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 418/941] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:42 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:43.015845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.016378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.034962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.035641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.036612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.037227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.043354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65cb0f8d-cf54-4b3a-90a2-0faed1b9f7fd tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1629 microversion: 2.1 time: 0.346133 Mar 26 20:51:43.043983 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 524/942] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:42 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1629 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:43.058500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a3ae04eb-af0c-4491-bda5-2d857e298361 req-749950f3-e583-409d-a727-d2ec495ec6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9ddccd-3d9d-4f22-a991-d9f94e62e449", "tag": "51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:43.099995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a3ae04eb-af0c-4491-bda5-2d857e298361 req-749950f3-e583-409d-a727-d2ec495ec6eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.103814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a3ae04eb-af0c-4491-bda5-2d857e298361 req-749950f3-e583-409d-a727-d2ec495ec6eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.132996 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a3ae04eb-af0c-4491-bda5-2d857e298361 req-749950f3-e583-409d-a727-d2ec495ec6eb service nova] Creating event network-changed:51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694 for instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 on nch1-master-1 Mar 26 20:51:43.139326 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a3ae04eb-af0c-4491-bda5-2d857e298361 req-749950f3-e583-409d-a727-d2ec495ec6eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091580 Mar 26 20:51:43.140658 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 525/943] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:43.149595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.150626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.159999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.160562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.161487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.162780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.183982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lazy-loading 'services' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:43.307148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb9315ec-0f99-423b-ad4a-2b3c518202b1 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments/3ace3a31-6c6a-489d-a7e5-62054bbbe359" status: 202 len: 0 microversion: 2.25 time: 0.296551 Mar 26 20:51:43.308185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 419/944] 10.222.0.16 () {60 vars in 1456 bytes} [Sat Mar 26 20:51:42 2022] DELETE /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments/3ace3a31-6c6a-489d-a7e5-62054bbbe359 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:43.315481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.316798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.325889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.327210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.328302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.332733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.561798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:43.569468 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58004b19-9dc0-4410-bd4e-2cef2d147ff0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.259394 Mar 26 20:51:43.570208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 420/945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:43 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:43.574763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.575752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.582782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.583235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.584072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.584512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.585760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:43.600303 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac6974ec-40f2-42bc-bc69-381e6e860c3d tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 200 len: 1470 microversion: 2.1 time: 0.458137 Mar 26 20:51:43.601168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 526/946] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:43 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 1470 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:43.641744 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e9527f4a-be0e-4264-afcf-8b63b31907b3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070655 Mar 26 20:51:43.643020 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 421/947] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 20:51:43 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:51:43.714808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.716157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.724510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.725211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.726191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.726835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.799540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-32a68074-3526-4ec1-abe8-aa9158040665 req-7881de29-8821-4e4e-ac1f-87fc85a69f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f9a33-26ef-489d-8d73-aa5808fe755f", "name": "network-vif-deleted", "tag": "d757af78-d01b-4df4-85a2-26137d1db01e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:43.824195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-32a68074-3526-4ec1-abe8-aa9158040665 req-7881de29-8821-4e4e-ac1f-87fc85a69f27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.824879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-32a68074-3526-4ec1-abe8-aa9158040665 req-7881de29-8821-4e4e-ac1f-87fc85a69f27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.846393 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-32a68074-3526-4ec1-abe8-aa9158040665 req-7881de29-8821-4e4e-ac1f-87fc85a69f27 service nova] Creating event network-vif-deleted:d757af78-d01b-4df4-85a2-26137d1db01e for instance b94f9a33-26ef-489d-8d73-aa5808fe755f on nch2-master-1 Mar 26 20:51:43.856554 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-32a68074-3526-4ec1-abe8-aa9158040665 req-7881de29-8821-4e4e-ac1f-87fc85a69f27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061686 Mar 26 20:51:43.859831 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 422/948] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:43.890674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:43.891853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:43.902889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.903561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:43.904585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:43.911483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.075579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:44.085937 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fdb066c-46b4-4314-a07b-5690c23ce1e3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.378031 Mar 26 20:51:44.089319 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 527/949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:43 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.103877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.105103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.117196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.118727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.122233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.123039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.222387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:44.231892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ee942fea-87df-4a9f-96e9-e527c5d7e2a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1261 microversion: 2.1 time: 0.139922 Mar 26 20:51:44.234174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 528/950] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:44 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1261 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.239498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.240509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.247507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.249132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.250304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.251078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.432994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:44.440509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c8e7337-cc98-4486-83e6-691155e86583 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.555767 Mar 26 20:51:44.441191 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 423/951] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:43 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.560043 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22323fcc-3eb3-4887-a326-dfb6dbe5990b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1612 microversion: 2.1 time: 0.324090 Mar 26 20:51:44.561606 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 529/952] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:44 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1612 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.579840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:44.580782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.598365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.599272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.601430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.602318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.603846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.605914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.621155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.622035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.627128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.629975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.678969 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] HTTP exception thrown: Cannot 'migrate' instance d8b58496-7be2-4549-9972-f88f5860a630 while it is in vm_state suspended Mar 26 20:51:44.684571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Returning 409 to user: Cannot 'migrate' instance d8b58496-7be2-4549-9972-f88f5860a630 while it is in vm_state suspended {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:44.686179 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cdabe009-3291-4bfd-908d-0516a5fcb907 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630/action" status: 409 len: 148 microversion: 2.1 time: 0.111234 Mar 26 20:51:44.688504 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 424/953] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:44 2022] POST /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630/action => generated 148 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:51:44.700257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.701925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: b94f9a33-26ef-489d-8d73-aa5808fe755f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.710904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.711834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.713360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.714017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.732363 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] HTTP exception thrown: Instance b94f9a33-26ef-489d-8d73-aa5808fe755f could not be found. Mar 26 20:51:44.733034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Returning 404 to user: Instance b94f9a33-26ef-489d-8d73-aa5808fe755f could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:44.733962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52a5d5c1-1d6e-4678-88e9-f63417d12271 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f" status: 404 len: 111 microversion: 2.1 time: 0.043854 Mar 26 20:51:44.734815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 425/954] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:44 2022] GET /compute/v2.1/servers/b94f9a33-26ef-489d-8d73-aa5808fe755f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:44.739352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.740468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.746323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.746885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.748088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.748627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.785120 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00cbd79e-1467-4c6c-9a50-51ee4db5fdb7 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.049131 Mar 26 20:51:44.790354 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 426/955] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 20:51:44 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.793631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3885cad0-6dad-4f7d-b148-ffadbf5e2582 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:44.795169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3885cad0-6dad-4f7d-b148-ffadbf5e2582 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:44.796010 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3885cad0-6dad-4f7d-b148-ffadbf5e2582 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33/action" status: 400 len: 144 microversion: 2.1 time: 0.008665 Mar 26 20:51:44.796547 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 427/956] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:44 2022] POST /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:51:44.805247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.805765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.813634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.814516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.815792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.816268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.865884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:44.925622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:44.933284 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99b9f7f8-cce1-4afb-82e4-58d594f72bc2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.347555 Mar 26 20:51:44.942853 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 530/957] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:44 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:44.947894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-92bc425c-a418-4903-b0f4-fdcfe04fb2d3 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:44.949581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-92bc425c-a418-4903-b0f4-fdcfe04fb2d3 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:44.950545 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-92bc425c-a418-4903-b0f4-fdcfe04fb2d3 tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33/action" status: 400 len: 120 microversion: 2.1 time: 0.006500 Mar 26 20:51:44.951802 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 531/958] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:44 2022] POST /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33/action => generated 120 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:51:44.961101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4faa436f-3caa-4b0e-9be9-1ceef901558b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:44.962902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4faa436f-3caa-4b0e-9be9-1ceef901558b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Failed to fetch instance by id 999 {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 20:51:44.963625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-4faa436f-3caa-4b0e-9be9-1ceef901558b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] HTTP exception thrown: Instance 999 could not be found. Mar 26 20:51:44.964465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4faa436f-3caa-4b0e-9be9-1ceef901558b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:44.965517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4faa436f-3caa-4b0e-9be9-1ceef901558b tempest-ServersAdminNegativeTestJSON-100793634 tempest-ServersAdminNegativeTestJSON-100793634-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.008327 Mar 26 20:51:44.967715 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 532/959] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Mar 26 20:51:44 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:51:44.981124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:44.981924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:44.990700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.991756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:44.992741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:44.993462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.002304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9b7b6f9-61be-43ca-b7d0-5b6c9b674c8e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 204 len: 0 microversion: 2.1 time: 0.204324 Mar 26 20:51:45.003270 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 428/960] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:44 2022] DELETE /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:45.012253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.013105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.025357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.028813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.030386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.030937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.055758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:45.222395 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46b743a1-26f0-4acb-aee7-09f511fc5c04 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 204 len: 0 microversion: 2.1 time: 0.247875 Mar 26 20:51:45.228296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 533/961] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:44 2022] DELETE /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:45.239462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.240218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.251792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.252268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.253047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.253814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.320515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:45.330227 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67a15f3b-403d-47e6-9dfd-3f1176ca755e tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1469 microversion: 2.1 time: 0.322474 Mar 26 20:51:45.330699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 429/962] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1469 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:45.344607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.345448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.351733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.352237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.353025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.353472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.610187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:45.619078 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-583d35a4-565b-4513-ad7a-29aaa84c3be4 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.392241 Mar 26 20:51:45.619643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 534/963] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:45.620069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:45.627951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66789c88-c7d3-43e6-bbe1-9c8e81061822 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1467 microversion: 2.1 time: 0.287050 Mar 26 20:51:45.628449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 430/964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1467 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:45.636006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.637027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.639743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.640399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.648167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.648798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.649389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.649827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.650361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.652208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.654726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.655888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.894933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:45.903554 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c65cfc2b-b17a-4a82-8043-51ac6e637c50 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.274085 Mar 26 20:51:45.905699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 431/965] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:45.947940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:45.950705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:45.953225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:45.963066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.963525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.964348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:45.965314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:45.968728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39bb9d07-3e80-4fba-9411-ad8d2f9613be tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.340284 Mar 26 20:51:45.984498 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 535/966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:46.349481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:46.350323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:46.362810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.363418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.364370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.367559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.459717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:46.472246 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d1f7bc78-2609-4540-a20a-fb933404cec0 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.525644 Mar 26 20:51:46.473426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 432/967] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:45 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:46.478821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6b339477-6c75-4212-bc01-d65fcfea93a3 req-624b23cc-6737-43c4-a6d2-4214fe89ba4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d629c1e-b428-4d65-9d91-f111668c4474", "tag": "231a45bf-4b55-47bc-887f-02488ddbc3e0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:46.495376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6b339477-6c75-4212-bc01-d65fcfea93a3 req-624b23cc-6737-43c4-a6d2-4214fe89ba4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.496053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6b339477-6c75-4212-bc01-d65fcfea93a3 req-624b23cc-6737-43c4-a6d2-4214fe89ba4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.512027 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6b339477-6c75-4212-bc01-d65fcfea93a3 req-624b23cc-6737-43c4-a6d2-4214fe89ba4e service nova] Creating event network-changed:231a45bf-4b55-47bc-887f-02488ddbc3e0 for instance 1d629c1e-b428-4d65-9d91-f111668c4474 on nch2-master-1 Mar 26 20:51:46.521801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6b339477-6c75-4212-bc01-d65fcfea93a3 req-624b23cc-6737-43c4-a6d2-4214fe89ba4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046557 Mar 26 20:51:46.522608 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 433/968] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:46.641355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:46.643370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:46.662502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.664407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.668957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.675278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.957588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:46.969645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd927b74-e534-4c4f-85f5-2ab7a4120305 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1469 microversion: 2.1 time: 0.624616 Mar 26 20:51:46.980236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 536/969] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:46 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1469 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:46.986085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:46.986918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:46.993295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.993992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:46.994947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:46.995551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.142438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:47.158677 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-015436b8-93a7-4a6b-9e87-2d5ae2511630 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.523531 Mar 26 20:51:47.162297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 434/970] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:46 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:47.169237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2cf147d4-e746-4a62-a598-9366d62aca4d req-d010e9e4-eb46-4310-9163-0a8fd3b4fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e17aad-e4e4-48db-a406-de8c22855a57", "name": "network-vif-unplugged", "status": "completed", "tag": "c7df1940-2f47-4d41-b48f-8078b14b9cc2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:47.185854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2cf147d4-e746-4a62-a598-9366d62aca4d req-d010e9e4-eb46-4310-9163-0a8fd3b4fe83 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.186821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2cf147d4-e746-4a62-a598-9366d62aca4d req-d010e9e4-eb46-4310-9163-0a8fd3b4fe83 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.204596 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2cf147d4-e746-4a62-a598-9366d62aca4d req-d010e9e4-eb46-4310-9163-0a8fd3b4fe83 service nova] Creating event network-vif-unplugged:c7df1940-2f47-4d41-b48f-8078b14b9cc2 for instance d2e17aad-e4e4-48db-a406-de8c22855a57 on nch2-master-1 Mar 26 20:51:47.211784 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2cf147d4-e746-4a62-a598-9366d62aca4d req-d010e9e4-eb46-4310-9163-0a8fd3b4fe83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046998 Mar 26 20:51:47.213072 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 435/971] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:47.220990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:47.222744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:47.235247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.236236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.237805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.238410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.330462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:47.338860 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96f97595-27f0-45ff-a4ef-d07a58ca7377 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1467 microversion: 2.1 time: 0.357277 Mar 26 20:51:47.340489 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 537/972] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:46 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1467 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:47.355180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:47.356177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:47.365139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.365943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.366986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.367909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.791310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:47.801600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60167bf9-9d07-4edb-a2f9-af756cf0c0b6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.455373 Mar 26 20:51:47.803780 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 538/973] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:47 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:47.808994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:47.812024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:47.832427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.832902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:47.833783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:47.834295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.041721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:48.056498 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-507d2bd2-5710-4c81-afad-d47fa5a10079 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.841903 Mar 26 20:51:48.066856 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 436/974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:47 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:48.072424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:48.073486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:48.079884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.080583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.082102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.082959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.278186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:48.288590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-23d74cce-ee0b-41a2-aff5-ca3d7a3588f5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.483120 Mar 26 20:51:48.292100 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 539/975] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:47 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:48.302682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:48.306182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:48.320563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.321262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.322250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.322685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.504020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:48.520935 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7e801e7-348a-4d39-988e-767bd6489ca8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1469 microversion: 2.1 time: 0.452641 Mar 26 20:51:48.522423 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 437/976] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:48 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:48.535178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:48.536076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:48.547257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.548123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.549114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.550648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.593346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:48.608761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68a6c2cb-bbce-43fa-bc79-784bdbdcb5b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.314142 Mar 26 20:51:48.610084 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 540/977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:48 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:48.820523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:48.821143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:48.837347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.837776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:48.838578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:48.839023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.119874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:49.131595 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f414fce4-5376-4a81-b208-006935b877c9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.314730 Mar 26 20:51:49.142822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 541/978] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:48 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:49.154477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:49.155284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:49.163108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.163955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.164968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.165583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.383180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:49.397220 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff30e43a-d380-405e-a88d-342f11fd8af5 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 200 len: 1467 microversion: 2.1 time: 0.870585 Mar 26 20:51:49.398851 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 438/979] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:48 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 1467 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:49.404478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:49.434795 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a7e7cbb-152a-4762-93ea-e370a6c6f804 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.283764 Mar 26 20:51:49.438428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aba2d49-5b28-446f-b54b-63d414e692e6", "name": "network-vif-deleted", "tag": "058e2995-dda2-4257-be40-cd89ed465350"}, {"name": "network-changed", "server_uuid": "d2e17aad-e4e4-48db-a406-de8c22855a57", "tag": "c7df1940-2f47-4d41-b48f-8078b14b9cc2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:49.440970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 542/980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:49 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:49.463258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:49.465026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:49.475532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.476938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.478226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.483454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.484637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.485276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.521433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] Creating event network-vif-deleted:058e2995-dda2-4257-be40-cd89ed465350 for instance 4aba2d49-5b28-446f-b54b-63d414e692e6 on nch2-master-1 Mar 26 20:51:49.522297 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] Creating event network-changed:c7df1940-2f47-4d41-b48f-8078b14b9cc2 for instance d2e17aad-e4e4-48db-a406-de8c22855a57 on nch2-master-1 Mar 26 20:51:49.542585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9f994517-b55b-4ad2-901a-9453259a47ab req-260ed90d-5111-4bb9-ae07-960c3b807177 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.133375 Mar 26 20:51:49.556725 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 439/981] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:49.569678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:49.581999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:49.601738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.606471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.613041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.619470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.704116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.704844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.705421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lazy-loading 'fault' on Instance uuid 4aba2d49-5b28-446f-b54b-63d414e692e6 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:51:49.788228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:49.810403 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c76a29f2-b0ac-4c50-9f99-4269cbce2257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.365258 Mar 26 20:51:49.812852 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 543/982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:49 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:49.821215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:49.822139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:49.830904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.831067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:49.833010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.834047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:49.835248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:49.845074 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23eae4fc-c9d7-42de-9ec9-1a3c073b8494 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 200 len: 1303 microversion: 2.1 time: 0.284418 Mar 26 20:51:49.849100 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 440/983] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:49 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 1303 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:50.004307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:50.013798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24c9a1ce-2c25-4683-83f0-0bfc8eb9e115 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.198851 Mar 26 20:51:50.014543 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 544/984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:49 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:50.150962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.151821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.158810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.159608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.160547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.161183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.415438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.417665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: d8b58496-7be2-4549-9972-f88f5860a630] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.426693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.427659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.429142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.429591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.450709 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] HTTP exception thrown: Instance d8b58496-7be2-4549-9972-f88f5860a630 could not be found. Mar 26 20:51:50.452219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Returning 404 to user: Instance d8b58496-7be2-4549-9972-f88f5860a630 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:50.453167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-51c06b2b-64eb-497a-bc60-91f286bdb608 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630" status: 404 len: 111 microversion: 2.1 time: 0.041536 Mar 26 20:51:50.453741 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 545/985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/d8b58496-7be2-4549-9972-f88f5860a630 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:51:50.459995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.460582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.467169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.467725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.468817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.469399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.567346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:50.578075 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-efb6cf3a-b712-41e3-8001-27e692ed86a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.431633 Mar 26 20:51:50.586714 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 441/986] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:50.593178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.593689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.607877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.609279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.609899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.610338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.665749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:50.674754 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-30098a97-8714-4660-8cc7-7a633e42ffb8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.219971 Mar 26 20:51:50.675350 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 546/987] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:50.682144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:50.769416 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e708d9b1-6ad2-421b-bee8-a49da4a658cb tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 204 len: 0 microversion: 2.1 time: 0.180861 Mar 26 20:51:50.769996 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 442/988] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:50 2022] DELETE /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:50.778554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.779241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.786111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.786647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.787429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.787870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.831236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.831236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.835713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.836915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.837785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.838296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.933064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:50.945409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14ada583-0cc8-45f4-8611-fd8376d39f8a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1478 microversion: 2.1 time: 0.170561 Mar 26 20:51:50.946382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 547/989] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:50.957557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:50.958258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 4aba2d49-5b28-446f-b54b-63d414e692e6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:50.965744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.966394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.967384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:50.967880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:50.983434 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] HTTP exception thrown: Instance 4aba2d49-5b28-446f-b54b-63d414e692e6 could not be found. Mar 26 20:51:50.984190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Returning 404 to user: Instance 4aba2d49-5b28-446f-b54b-63d414e692e6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:50.985452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9d19252-62b1-4919-a179-16533a2d36bc tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6" status: 404 len: 111 microversion: 2.1 time: 0.037800 Mar 26 20:51:50.989024 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 548/990] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/4aba2d49-5b28-446f-b54b-63d414e692e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:51.001454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.001968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.002382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:51.013531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.013995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.014776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.015215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.019952 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a8917d0-5ce6-4d33-88dd-0ea4e1e44f7d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.195330 Mar 26 20:51:51.030936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 443/991] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:50 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:51.041926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.045326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.053456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:51.057258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.058000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.059122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.059640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.156760 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d56055e8-7cd3-448a-9944-f20124d6cd12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 204 len: 0 microversion: 2.1 time: 0.166123 Mar 26 20:51:51.161340 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 549/992] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:50 2022] DELETE /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:51:51.170402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.171751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.179967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.180436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.181476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.182104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.249356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:51.258611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e11e018c-6803-4ffb-9e87-73704f76b462 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.222536 Mar 26 20:51:51.259521 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 444/993] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:51 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:51.316426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-51772ee9-b646-435d-a226-c2cc02d285fa req-49b18b2e-2870-4c32-a575-1fb5b77f94ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9ddccd-3d9d-4f22-a991-d9f94e62e449", "name": "network-vif-plugged", "status": "completed", "tag": "51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:51.333386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51772ee9-b646-435d-a226-c2cc02d285fa req-49b18b2e-2870-4c32-a575-1fb5b77f94ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.333848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51772ee9-b646-435d-a226-c2cc02d285fa req-49b18b2e-2870-4c32-a575-1fb5b77f94ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.359333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:51.362506 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-51772ee9-b646-435d-a226-c2cc02d285fa req-49b18b2e-2870-4c32-a575-1fb5b77f94ed service nova] Creating event network-vif-plugged:51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694 for instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 on nch1-master-1 Mar 26 20:51:51.369277 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-51772ee9-b646-435d-a226-c2cc02d285fa req-49b18b2e-2870-4c32-a575-1fb5b77f94ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058369 Mar 26 20:51:51.370461 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfe5acce-9a50-4542-bec4-ad6cff0994d7 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1470 microversion: 2.1 time: 0.206566 Mar 26 20:51:51.370722 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 445/994] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:51.371121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 550/995] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:51 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:51.596773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.598069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.602642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9d213012-60e7-46eb-b00f-258bb35e1264 req-ae763bb2-8b31-41e6-a5a0-119b9fe92d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b58496-7be2-4549-9972-f88f5860a630", "name": "network-vif-deleted", "tag": "50c8a773-79de-421d-b7fc-05f78140912b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:51.604833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.605400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.606586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.607655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.616238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9d213012-60e7-46eb-b00f-258bb35e1264 req-ae763bb2-8b31-41e6-a5a0-119b9fe92d9f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.618061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9d213012-60e7-46eb-b00f-258bb35e1264 req-ae763bb2-8b31-41e6-a5a0-119b9fe92d9f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.632612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9d213012-60e7-46eb-b00f-258bb35e1264 req-ae763bb2-8b31-41e6-a5a0-119b9fe92d9f service nova] Creating event network-vif-deleted:50c8a773-79de-421d-b7fc-05f78140912b for instance d8b58496-7be2-4549-9972-f88f5860a630 on nch2-master-1 Mar 26 20:51:51.638589 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9d213012-60e7-46eb-b00f-258bb35e1264 req-ae763bb2-8b31-41e6-a5a0-119b9fe92d9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039559 Mar 26 20:51:51.639512 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 551/996] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:51.692820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.695106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.709375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.709804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.711412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.711964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.773821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:51.783833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fdbab02a-19be-4573-a229-b99230932fff tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.191547 Mar 26 20:51:51.784775 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 446/997] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:51 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:51.867280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:51.875240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08171861-4dc9-4613-8bd5-afcfce427f58 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.186818 Mar 26 20:51:51.885126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 552/998] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:51 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:51.967338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:51.967962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:51.974108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.974570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:51.975355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:51.975803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.041131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:52.041858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:52.049819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.050355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.051225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.051787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.138559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:52.146713 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e7901df5-69dd-43aa-b9c4-2db6dbb1b590 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1478 microversion: 2.1 time: 0.183815 Mar 26 20:51:52.147591 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 447/999] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:51 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:52.200246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:52.209001 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-472d5526-b4fd-4452-a77b-7a484faa9c82 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.171721 Mar 26 20:51:52.209576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 553/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:52 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:52.276382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:52.277573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:52.286437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.286703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.288290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.288905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.389314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:52.390016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:52.396482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.396934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.397702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.398137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.432464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:52.441201 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3981b870-f89f-4ed4-b3b9-12066fe2a099 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.169104 Mar 26 20:51:52.441554 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 448/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:52 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:52.543263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:52.550978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f18a457d-7e77-4b6c-8ec8-373d68623405 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1470 microversion: 2.1 time: 0.166078 Mar 26 20:51:52.551638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 554/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:52 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:52.801035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:52.801662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:52.809578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.809578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.809578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.810819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.893115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:52.893864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:52.907261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.907762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:52.908755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:52.909234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.098854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.107022 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cac04c95-1051-4201-a333-72506d130d1b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.217744 Mar 26 20:51:53.107759 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 555/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:52 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:53.123545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.135002 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c6edc72-85d5-4d21-82bc-b65ea8a8da67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.338066 Mar 26 20:51:53.135864 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 449/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:52 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:53.164301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:53.165192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:53.171097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.171953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.172665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.173146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.230437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:53.232982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:53.242457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.243531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.245622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.247145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.361046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.369104 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66b6b5ce-c019-451f-ad37-b563da7af8d4 tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1478 microversion: 2.1 time: 0.208708 Mar 26 20:51:53.370008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 556/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:53 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1478 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:53.458853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:53.459939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:53.467370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.468039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.468817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.469257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.629936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.640093 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c3c0cec-e492-4441-b530-11173f9f2795 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.185240 Mar 26 20:51:53.647555 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 557/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:53 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:53.668161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:53.670957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:53.685805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.687144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.690831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.692051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.886913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.894553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-75729acd-d837-4a0c-a570-39e17d3c55f2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.670738 Mar 26 20:51:53.895144 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 450/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:53 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:53.912885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-862269c8-98d8-47fd-a6d5-9356dad8a690 req-0606f2b8-57ba-44b0-a46e-a46854618ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d629c1e-b428-4d65-9d91-f111668c4474", "name": "network-vif-plugged", "status": "completed", "tag": "231a45bf-4b55-47bc-887f-02488ddbc3e0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:53.925611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-862269c8-98d8-47fd-a6d5-9356dad8a690 req-0606f2b8-57ba-44b0-a46e-a46854618ddc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:53.931441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-862269c8-98d8-47fd-a6d5-9356dad8a690 req-0606f2b8-57ba-44b0-a46e-a46854618ddc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:53.948571 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-862269c8-98d8-47fd-a6d5-9356dad8a690 req-0606f2b8-57ba-44b0-a46e-a46854618ddc service nova] Creating event network-vif-plugged:231a45bf-4b55-47bc-887f-02488ddbc3e0 for instance 1d629c1e-b428-4d65-9d91-f111668c4474 on nch2-master-1 Mar 26 20:51:53.949647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35af62292f65400bb9626ea4e897fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9695bc9bf47e4da7bd4c4636a4900f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:53.954071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-862269c8-98d8-47fd-a6d5-9356dad8a690 req-0606f2b8-57ba-44b0-a46e-a46854618ddc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057792 Mar 26 20:51:53.955800 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 451/1008] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:53.957969 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f07d8043-c8fe-4ca6-9afc-f5e5aa12fbd8 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 200 len: 1470 microversion: 2.1 time: 0.309235 Mar 26 20:51:53.960391 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 558/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:53 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:54.117813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2c2ede46-7f58-48cb-ab30-43c78776d310 req-a9b93cec-d576-4d95-9dd1-b5b8ffb2a276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7681c708-82a7-4715-8408-9ff49d5039af", "name": "network-vif-deleted", "tag": "dde38bc0-9758-4826-b43d-648f34fdfda0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:54.124170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.124597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.136951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.137343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.140489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.140627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.149836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2c2ede46-7f58-48cb-ab30-43c78776d310 req-a9b93cec-d576-4d95-9dd1-b5b8ffb2a276 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.154560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2c2ede46-7f58-48cb-ab30-43c78776d310 req-a9b93cec-d576-4d95-9dd1-b5b8ffb2a276 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.177969 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2c2ede46-7f58-48cb-ab30-43c78776d310 req-a9b93cec-d576-4d95-9dd1-b5b8ffb2a276 service nova] Creating event network-vif-deleted:dde38bc0-9758-4826-b43d-648f34fdfda0 for instance 7681c708-82a7-4715-8408-9ff49d5039af on nch2-master-1 Mar 26 20:51:54.184125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2c2ede46-7f58-48cb-ab30-43c78776d310 req-a9b93cec-d576-4d95-9dd1-b5b8ffb2a276 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070199 Mar 26 20:51:54.186022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 452/1010] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:54.194667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.196098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.206264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.207132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.208450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.208990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.559718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:54.567792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b0617cdf-401a-4713-92a0-d632cda7aa94 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1291 microversion: 2.1 time: 0.379479 Mar 26 20:51:54.568793 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 453/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1291 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:54.574317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.575022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.582863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.584232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.585258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.592320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.619274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:54.633825 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b4af59d-7a02-4932-9fe7-857a8e92bbf9 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1318 microversion: 2.1 time: 0.513961 Mar 26 20:51:54.636971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 559/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:54.658061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.661283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.668669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.669643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.670899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.671583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.685352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d404d270f3a41c9bb725f0ea552c76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c513bf41bd4101914b82a4b39e4030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:54.695240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c2d2654-7610-499a-82ab-bd3ea4bedb6a tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 200 len: 1436 microversion: 2.1 time: 0.125192 Mar 26 20:51:54.696326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 454/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 1436 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:54.703697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d0c763d6-0702-4171-89dd-facd12363a76 req-47eba4a2-d516-4067-acb6-cae651692e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3da99d9-228b-417e-aff7-488957ac8c33", "name": "network-vif-deleted", "tag": "be7b6f80-22ba-471b-968f-ba95ce014ba3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:54.713520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d0c763d6-0702-4171-89dd-facd12363a76 req-47eba4a2-d516-4067-acb6-cae651692e02 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.714180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d0c763d6-0702-4171-89dd-facd12363a76 req-47eba4a2-d516-4067-acb6-cae651692e02 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.734618 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d0c763d6-0702-4171-89dd-facd12363a76 req-47eba4a2-d516-4067-acb6-cae651692e02 service nova] Creating event network-vif-deleted:be7b6f80-22ba-471b-968f-ba95ce014ba3 for instance b3da99d9-228b-417e-aff7-488957ac8c33 on nch1-master-1 Mar 26 20:51:54.742043 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d0c763d6-0702-4171-89dd-facd12363a76 req-47eba4a2-d516-4067-acb6-cae651692e02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043501 Mar 26 20:51:54.743844 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 455/1014] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:51:54.886008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:54.895440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e7f0884e-d581-4626-97a7-d550866bce8d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.242141 Mar 26 20:51:54.905958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 560/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:54.915128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.916214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.923646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.924214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.925411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.925971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.979542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:54.980493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] [instance: 7681c708-82a7-4715-8408-9ff49d5039af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:54.987281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.987733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:54.988711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:54.989240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.007405 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] HTTP exception thrown: Instance 7681c708-82a7-4715-8408-9ff49d5039af could not be found. Mar 26 20:51:55.008314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] Returning 404 to user: Instance 7681c708-82a7-4715-8408-9ff49d5039af could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:55.009345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b4fca6f-e803-4f85-a906-212238218c12 tempest-ServersAdminTestJSON-2120696265 tempest-ServersAdminTestJSON-2120696265-project] 10.222.0.16 "GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af" status: 404 len: 111 microversion: 2.1 time: 0.037206 Mar 26 20:51:55.010385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 561/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/7681c708-82a7-4715-8408-9ff49d5039af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:51:55.121614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:55.132724 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f308077b-355d-4e8f-ae15-39aa6640e044 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.224699 Mar 26 20:51:55.133493 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 456/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:54 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:55.588261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:55.589982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:55.630240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.630967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.632134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.635265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.657376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:55.657947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:55.668837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.670067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.671185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.671777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.857498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:55.877628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d92e9ae-28c6-49a4-afcf-65ef0836426c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1471 microversion: 2.1 time: 0.294824 Mar 26 20:51:55.878334 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 562/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:55 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:55.884030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:55.884681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] [instance: b3da99d9-228b-417e-aff7-488957ac8c33] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:55.909156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.912663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.913164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.913632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.944357 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] HTTP exception thrown: Instance b3da99d9-228b-417e-aff7-488957ac8c33 could not be found. Mar 26 20:51:55.945163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] Returning 404 to user: Instance b3da99d9-228b-417e-aff7-488957ac8c33 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:55.946085 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b06421d7-53c4-42ce-ba85-8db41f81daba tempest-ServersAdminNegativeTestJSON-1322172486 tempest-ServersAdminNegativeTestJSON-1322172486-project] 10.222.0.16 "GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33" status: 404 len: 111 microversion: 2.1 time: 0.066542 Mar 26 20:51:55.947291 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 563/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:55 2022] GET /compute/v2.1/servers/b3da99d9-228b-417e-aff7-488957ac8c33 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:55.952443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:55.953422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:55.960885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.961360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:55.962143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:55.962695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.011336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:56.081617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:56.091123 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-edeab56e-d92e-4c87-9b3f-f00601d9f735 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1507 microversion: 2.1 time: 0.441155 Mar 26 20:51:56.093497 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 457/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:55 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:51:56.113122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:56.115635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:56.138496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.142267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.143162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.143623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.186282 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-006e181d-682d-4cf3-b8e6-c183eff4466c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 204 len: 0 microversion: 2.1 time: 0.237257 Mar 26 20:51:56.197677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 564/1021] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:55 2022] DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:56.197677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1033985819", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:56.296435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:56.523059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:56.531966 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d2af673-1d97-46bf-be26-8fc8db489270 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.436177 Mar 26 20:51:56.533419 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 458/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:56 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:56.540983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:56.542311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:56.553311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.554186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.555222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.555884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.747950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:56.768146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a8468b6-911d-4b17-a903-ad38715f2c4b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1507 microversion: 2.1 time: 0.232835 Mar 26 20:51:56.769765 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 459/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:56 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:56.793461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:56.794652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:56.802522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.802982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.804002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:56.804730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:56.982993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:56.983664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:56.984321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:56.984906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:56.985493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:56.999855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.002531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.003550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.004537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.053531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:57.077770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:57.098125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:57.101523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:57.160948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:57.185472 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2423686b-91c2-4341-b2f5-9af917b0fd3e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.407541 Mar 26 20:51:57.190018 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 460/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:56 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:57.199895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1766852746", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "409083189", "adminPass": "***", "networks": [{"uuid": "f8ad645e-691e-4200-a0a6-1147f6f8ec71"}], "security_groups": [{"name": "tempest-securitygroup--1013381703"}], "key_name": "tempest-keypair-1724354145", "user_data": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:57.209772 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1bf11b5f-a436-41b5-983f-177f7f8f34ae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018684 Mar 26 20:51:57.215554 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 565/1025] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:57.228867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:57.230375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:57.237616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.238065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.239260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.239722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.384227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:57.385943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:57.387584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:57.388937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:57.390298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:57.411305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] validate_networks() for [('f8ad645e-691e-4200-a0a6-1147f6f8ec71', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:51:57.542897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:57.562544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.563019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.567268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:57.568024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:57.705470 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b09176c-b11c-4996-b7c7-439aa8cfb88f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "POST /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449/action" status: 202 len: 1109 microversion: 2.1 time: 0.486993 Mar 26 20:51:57.708714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 566/1026] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:51:57 2022] POST /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449/action => generated 1109 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 26 20:51:57.728892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4bf06b2-61f7-4473-87fb-834d07935909 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:57.729466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d4bf06b2-61f7-4473-87fb-834d07935909 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:57.790428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d4bf06b2-61f7-4473-87fb-834d07935909 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:51:58.351524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:51:58.352702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:51:58.353283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:51:58.353776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:51:58.354285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:51:58.370286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.370836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.371875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.372389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.421493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-d4bf06b2-61f7-4473-87fb-834d07935909 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Instance Mapping does not exist while attempting local delete cleanup. Mar 26 20:51:58.423475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for project c71abac018054ac59df8204f06278c20. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:51:58.424619 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4bf06b2-61f7-4473-87fb-834d07935909 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695" status: 204 len: 0 microversion: 2.1 time: 0.714905 Mar 26 20:51:58.425633 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 567/1027] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:51:57 2022] DELETE /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:51:58.432135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:58.433092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:58.435533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Getting quotas for user f730effcbf03473fbdb527fa499ec181 and project c71abac018054ac59df8204f06278c20. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:51:58.442244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.442929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.444428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.445260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.462222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:51:58.466513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:51:58.546910 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1ba864f-4f70-448d-a302-d960e75acb39 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.355208 Mar 26 20:51:58.553338 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 461/1028] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:51:58.559232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:58.561412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:58.568602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.570407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.571501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.572202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.794878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:58.812132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e2948ef-4fbe-4c3e-a419-caf74022490a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1551 microversion: 2.1 time: 0.384648 Mar 26 20:51:58.812739 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 568/1029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:58 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1551 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:58.851309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:58.853528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:58.864256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.866080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:58.876347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:51:58.876919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:51:59.083084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:59.091823 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0d5d179-0508-4234-86ba-71789f6d4110 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.536856 Mar 26 20:51:59.095286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 462/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:58 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:59.111466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c67e452-c1a9-4c32-a20d-cd917c976dd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:59.116888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c67e452-c1a9-4c32-a20d-cd917c976dd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:59.144217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0c67e452-c1a9-4c32-a20d-cd917c976dd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. Mar 26 20:51:59.146410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c67e452-c1a9-4c32-a20d-cd917c976dd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:51:59.147502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c67e452-c1a9-4c32-a20d-cd917c976dd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695" status: 404 len: 111 microversion: 2.1 time: 0.050480 Mar 26 20:51:59.149319 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 463/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:59 2022] GET /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:59.173685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afb8ccda-59c2-4ff2-9a9a-7dbda7cfcb33 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:51:59.175020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afb8ccda-59c2-4ff2-9a9a-7dbda7cfcb33 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:51:59.299054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-afb8ccda-59c2-4ff2-9a9a-7dbda7cfcb33 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:59.307434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afb8ccda-59c2-4ff2-9a9a-7dbda7cfcb33 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1263 microversion: 2.1 time: 0.144015 Mar 26 20:51:59.320651 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 464/1032] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:59 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:59.344719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:51:59.362135 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9f79f9f-adea-451b-91db-7a919fb6c522 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.536693 Mar 26 20:51:59.364580 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 569/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:51:58 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:51:59.405913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1146227312", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:51:59.511495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:00.071663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:00.073954 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:00.073954 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:00.077148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.077854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.078989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.079585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.119818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-331b7b39-4696-4521-ad73-ff330573d063 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.553320 Mar 26 20:52:00.120556 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 570/1034] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:51:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:52:00.127578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:00.128318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:00.135371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.136142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.137391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.138659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.443084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:00.459252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d914801d-df0f-48b0-bda7-00e597e75c74 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1541 microversion: 2.1 time: 0.337151 Mar 26 20:52:00.471872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 571/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:00 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1541 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:00.484345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:00.485891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:00.501411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.502129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.515899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.516791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.910695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:00.928788 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df35570c-2ce0-4ce4-8183-122f5a9801df tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.452594 Mar 26 20:52:00.938433 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 572/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:00 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:00.938433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:00.938433 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:00.938433 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:00.938433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.938996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:00.940352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:00.940995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.008263 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88124952-d42f-4ab7-8866-21f342a5100d tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.076046 Mar 26 20:52:01.008263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 573/1037] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:52:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:01.021906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.022711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:01.029705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.030368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.031473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.032096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.115578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:01.116118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:01.116502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:01.116916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:01.117329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:01.138871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.139610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.143113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.143933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.162520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:01.174643 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-80b9e8eb-2ab2-4c3f-961d-7b3d0fa8c9a6 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1321 microversion: 2.1 time: 0.164897 Mar 26 20:52:01.175931 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 574/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:01.191190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.203517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:01.208083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:01.211831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:01.219886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.220712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.221774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.222851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.230293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:01.233968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:01.326027 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d32e341-7e8a-43a4-87e8-8ac3d039bb05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922280 Mar 26 20:52:01.332750 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 465/1039] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:01.342852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8a149288-c221-441e-8bfa-d610383f18e7 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '.version_select at 0x7f6e594e0790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.347753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a149288-c221-441e-8bfa-d610383f18e7 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.349103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a149288-c221-441e-8bfa-d610383f18e7 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.382867 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8a149288-c221-441e-8bfa-d610383f18e7 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3499 microversion: 2.1 time: 0.048678 Mar 26 20:52:01.383737 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 466/1040] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/os-migrations => generated 3499 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:01.389535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-da93c361-a329-4560-8d66-3410b361d19a req-f61f9e3b-46cf-48b8-ac9f-ea5b7bbad360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b31b55-e687-4df8-8057-fdf7bffce5fa", "name": "network-vif-deleted", "tag": "eb28e42c-172b-407b-901a-05cc677135e3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:01.408627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-da93c361-a329-4560-8d66-3410b361d19a req-f61f9e3b-46cf-48b8-ac9f-ea5b7bbad360 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.409091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-da93c361-a329-4560-8d66-3410b361d19a req-f61f9e3b-46cf-48b8-ac9f-ea5b7bbad360 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.437626 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-da93c361-a329-4560-8d66-3410b361d19a req-f61f9e3b-46cf-48b8-ac9f-ea5b7bbad360 service nova] Creating event network-vif-deleted:eb28e42c-172b-407b-901a-05cc677135e3 for instance b6b31b55-e687-4df8-8057-fdf7bffce5fa on nch1-master-1 Mar 26 20:52:01.456186 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-da93c361-a329-4560-8d66-3410b361d19a req-f61f9e3b-46cf-48b8-ac9f-ea5b7bbad360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070854 Mar 26 20:52:01.456814 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 467/1041] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:01.468201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.469719 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:01.469719 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:52:01.471277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.471733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.473170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.473838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.507888 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cbae4fce-e3eb-4acf-85f6-4dcc4b851e18 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.046130 Mar 26 20:52:01.508868 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 468/1042] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/os-services => generated 947 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:01.514951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4446a6b1-baba-43d1-bb97-d0517a537366 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.517209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4446a6b1-baba-43d1-bb97-d0517a537366 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:01.592036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4446a6b1-baba-43d1-bb97-d0517a537366 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:01.600842 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4446a6b1-baba-43d1-bb97-d0517a537366 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1221 microversion: 2.1 time: 0.090662 Mar 26 20:52:01.603817 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 469/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:01.619456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.621417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:01.630080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.630763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.635028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.635749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.796259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:01.809857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9dae0f5-1f31-4a5a-8507-bd3bdae936ce tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.632424 Mar 26 20:52:01.812959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 575/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:01.825426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.829336 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:01.829336 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:01.833692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.834315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.836901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.837463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.896839 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c44d78b2-5d8f-49f8-937f-f62b8077fc2b tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.081725 Mar 26 20:52:01.901821 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 576/1045] 10.222.0.16 () {58 vars in 1195 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:52:01.914694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.916064 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:01.916064 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:01.920608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.922172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.922734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d88b3c39-7793-4d75-b9ea-a83349449915 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1692 microversion: 2.1 time: 0.307517 Mar 26 20:52:01.923665 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 470/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1692 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:01.925442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.926038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.939277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.940155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:01.953627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.964449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.964449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:01.964449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:01.980408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b7f0341-1f74-45bd-9b70-6a4a896c0464 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.071420 Mar 26 20:52:01.989010 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 577/1047] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/os-services => generated 947 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:52:01.992617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:01.995152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:02.011651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.012200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.013688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.015170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.340313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:02.356779 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36b0bd77-4ab1-49ba-a7f8-e9afd1c257cb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.369187 Mar 26 20:52:02.369611 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 578/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:02.376702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:02.378654 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:02.378654 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:02.380861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.381614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.382909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.383590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.429668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8864a303-b867-40aa-8234-f5872e1b672c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1692 microversion: 2.1 time: 0.494725 Mar 26 20:52:02.437594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ff21b07-11f1-468f-b11c-a3a9577e4ac5 tempest-ServicesAdminNegativeTestJSON-566436872 tempest-ServicesAdminNegativeTestJSON-566436872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.046380 Mar 26 20:52:02.441562 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 579/1049] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Mar 26 20:52:02 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:52:02.446280 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 471/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:01 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1692 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:02.453200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:02.454607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:02.469446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.474469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.475483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.476111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.912637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f6305924-154e-40b8-b509-7206950f9b78 tempest-ServicesAdminNegativeTestJSON-2109698295 tempest-ServicesAdminNegativeTestJSON-2109698295-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:02.914145 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:02.914145 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:52:02.915536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f6305924-154e-40b8-b509-7206950f9b78 tempest-ServicesAdminNegativeTestJSON-2109698295 tempest-ServicesAdminNegativeTestJSON-2109698295-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7f795eae56d941ffaa55d9cd8438bee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6eaf7923064ac9837391c71a0d85a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:02.916394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f6305924-154e-40b8-b509-7206950f9b78 tempest-ServicesAdminNegativeTestJSON-2109698295 tempest-ServicesAdminNegativeTestJSON-2109698295-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:02.926724 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f6305924-154e-40b8-b509-7206950f9b78 tempest-ServicesAdminNegativeTestJSON-2109698295 tempest-ServicesAdminNegativeTestJSON-2109698295-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.472093 Mar 26 20:52:02.932430 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 472/1051] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:52:02 2022] GET /compute/v2.1/os-services => generated 112 bytes in 480 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:52:02.945197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:02.948763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:02.963179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:02.964266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:02.994384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.000415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.051703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:03.073067 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abc034d0-5ce8-4ddc-992e-2ea2f13c6cc9 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.629929 Mar 26 20:52:03.086187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 580/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:02 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:03.091472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:03.109766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:03.138835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.139526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.144012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.144742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.241280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lazy-loading 'services' on Instance uuid d2e17aad-e4e4-48db-a406-de8c22855a57 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:03.385568 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4e4e814-e564-4826-b48f-65840cb969a1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments/332c6932-b720-4149-a33d-66740c6c06f2" status: 202 len: 0 microversion: 2.1 time: 0.448920 Mar 26 20:52:03.387136 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 473/1053] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 20:52:02 2022] DELETE /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments/332c6932-b720-4149-a33d-66740c6c06f2 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:52:03.401998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:03.406085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:03.429416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:03.438396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.441061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.443821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.444464 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d1aa32e-e8a2-41e7-ab23-09d8c46652d5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1281 microversion: 2.1 time: 0.356815 Mar 26 20:52:03.445459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.454712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 581/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:03 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1281 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:03.460138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:03.460751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:03.477693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.478386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:03.479341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:03.482072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.260836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:04.272395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:04.280367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ffbffac8-837d-40fd-8240-475a1fb80439 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.824498 Mar 26 20:52:04.284950 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2a1e86d-1896-4d30-bfb7-1cf5fd95cdc1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.895514 Mar 26 20:52:04.285713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 474/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:03 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:04.295406 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 582/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:03 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:04.300596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:04.301933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:04.303073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:04.308307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:04.318027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.318657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.319562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.319878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.320235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.320706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.321677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.324492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.412290 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f5ce1612-9c72-492a-8449-de71b0e3c105 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122375 Mar 26 20:52:04.413697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 475/1057] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:52:04 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:04.462942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:04.463667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:04.475147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.475863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.476903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:04.478161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:04.705646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:04.714315 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ab88f0d-b20f-42a8-a7dd-84750ba19a68 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1279 microversion: 2.1 time: 0.255333 Mar 26 20:52:04.734828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:04.749467 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04610313-875a-42a8-ad13-b2a3166da7ea tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.452626 Mar 26 20:52:04.752058 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 476/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:04 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:04.758809 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 583/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:04 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:05.023735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4a7fc8ed-be3b-4816-b834-84a2f2006c7d req-a413834d-1284-4086-b421-1c69251953d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6988895-e39c-494d-b277-f819ab920d2e", "tag": "456ea6bf-b197-4c02-a631-fb2403437d4c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:05.038458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4a7fc8ed-be3b-4816-b834-84a2f2006c7d req-a413834d-1284-4086-b421-1c69251953d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.039274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4a7fc8ed-be3b-4816-b834-84a2f2006c7d req-a413834d-1284-4086-b421-1c69251953d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.066564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4a7fc8ed-be3b-4816-b834-84a2f2006c7d req-a413834d-1284-4086-b421-1c69251953d1 service nova] Creating event network-changed:456ea6bf-b197-4c02-a631-fb2403437d4c for instance a6988895-e39c-494d-b277-f819ab920d2e on nch2-master-1 Mar 26 20:52:05.072227 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4a7fc8ed-be3b-4816-b834-84a2f2006c7d req-a413834d-1284-4086-b421-1c69251953d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052068 Mar 26 20:52:05.073793 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 477/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:05.302900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:05.303895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:05.304775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:05.305568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:05.319386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.320243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.321694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.324730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.325628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.326096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.326414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.327071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.746546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:05.755949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94f847e6-ab03-403c-94a2-5e5081c2b48c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.457602 Mar 26 20:52:05.770978 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 584/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:05 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:05.776420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:05.778285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:05.784822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.785571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.786762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.787434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.821083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb90ced0-4988-4c4f-82a5-8eb0a0cef478 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048669 Mar 26 20:52:05.822350 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 585/1062] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:52:05 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:52:05.828435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:05.830129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:05.836440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.837401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:05.838388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:05.839255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:06.164185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:06.173532 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-14007aec-2ca9-43de-9afb-1d3ffb8b93da tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.874913 Mar 26 20:52:06.185514 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 478/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:05 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:06.190900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:06.201995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:06.212398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:06.213148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:06.216023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:06.217182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:06.968228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:06.978081 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e2d8966-cce3-4d23-a063-2dba18651317 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 1.153969 Mar 26 20:52:06.979641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 586/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:05 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:06.986122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:06.987064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:06.995449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:06.996175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:06.996613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:06.997505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:06.998321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:07.008663 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ffd1bf2-bb36-4646-b230-0886bed7dbfb tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.818345 Mar 26 20:52:07.009309 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 479/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:06 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:07.191995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:07.194751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:07.207950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:07.208421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:07.209232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:07.209676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:07.375997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:07.385523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9be37e6d-a80b-4753-9121-d9603f98a5c3 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.404522 Mar 26 20:52:07.386118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 587/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:06 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:07.823362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:07.832224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de423e6d-7aaa-4881-99a6-ff6826fb9d09 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.644908 Mar 26 20:52:07.832814 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 480/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:07 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:07.997905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:07.998681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:08.007013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.013874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.014907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.015446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.026217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:08.027078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:08.036012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.037087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.038268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.039463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.451097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:08.475068 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0da41b82-902f-45ec-a034-cd0c126ae537 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.453711 Mar 26 20:52:08.475691 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 481/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:08 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:08.480843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:08.484259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:08.497590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.498427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.499762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.500742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.628610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:08.637984 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93ea5c21-48eb-45e6-9bba-a0d9850c78f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.645576 Mar 26 20:52:08.639308 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 588/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:07 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:08.814365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-82c465b0-eefb-4d84-8b17-1050331e7ea8 req-3653e12f-ce7e-4d41-8f9d-309d0f51ef2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7637a394-e609-4fcf-a3c0-06b029441efa", "tag": "63e033aa-f288-475b-a62b-a0edaecd2b6c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:08.834953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-82c465b0-eefb-4d84-8b17-1050331e7ea8 req-3653e12f-ce7e-4d41-8f9d-309d0f51ef2f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.835495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-82c465b0-eefb-4d84-8b17-1050331e7ea8 req-3653e12f-ce7e-4d41-8f9d-309d0f51ef2f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.851345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-82c465b0-eefb-4d84-8b17-1050331e7ea8 req-3653e12f-ce7e-4d41-8f9d-309d0f51ef2f service nova] Creating event network-changed:63e033aa-f288-475b-a62b-a0edaecd2b6c for instance 7637a394-e609-4fcf-a3c0-06b029441efa on nch2-master-1 Mar 26 20:52:08.858165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-82c465b0-eefb-4d84-8b17-1050331e7ea8 req-3653e12f-ce7e-4d41-8f9d-309d0f51ef2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056768 Mar 26 20:52:08.859271 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 589/1070] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:08.864622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:08.865593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:08.872360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.873126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.874216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:08.874887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:08.992987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:09.018536 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e01ea39a-bad7-401e-ac19-38bf61d65c7c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.537301 Mar 26 20:52:09.019363 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 482/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:08 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:09.348774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:09.361147 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49dddfdd-f3bd-485e-ab4b-f2ef9ae0205f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.500520 Mar 26 20:52:09.377183 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 590/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:08 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:09.492168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:09.492816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:09.504554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:09.505061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:09.508850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:09.509677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:09.655383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:09.656356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:09.669521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:09.669988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:09.670792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:09.671239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:09.975962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:09.986870 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98a0d8bc-26c1-4f4b-b616-4da2a167d7c7 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.498634 Mar 26 20:52:09.989894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 483/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:09 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:10.007854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:10.019057 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1bec31ec-6f55-440e-8c5d-744ccd267f8b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.368176 Mar 26 20:52:10.019891 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 591/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:09 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:10.041317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:10.042305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:10.060019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:10.062386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:10.063282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:10.063684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:10.407543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:10.417230 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25893f78-3c2c-426c-9de6-2e1e2db833b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.378796 Mar 26 20:52:10.418276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 484/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:10 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:10.426667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:10.436792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:10.451356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:10.452222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:10.453510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:10.454232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:10.529431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1630063267", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3cefd6de-90d8-4688-a242-74a2eb770644"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:10.644782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] validate_networks() for [('3cefd6de-90d8-4688-a242-74a2eb770644', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:10.760854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:10.769304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cef4ff6-41c2-4376-8eb3-f856c4f94f3d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.347834 Mar 26 20:52:10.770254 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 485/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:10 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:10.850244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-772810192", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:10.934007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:11.249832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:11.250258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:11.250771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:11.251352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:11.251935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:11.269070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:11.269499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:11.269963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:11.270554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:11.271131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:11.277410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.279768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.280827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.281627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.281984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.282448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.283268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.283715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.312735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Getting quotas for project d7b7b7e274924321ab663566b06fcf38. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:11.313059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Getting quotas for project d6be1f9d2cf4446c9e936785fc70de17. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:11.319275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Getting quotas for user 14c580ce88b74633832c6be6d3e08a47 and project d7b7b7e274924321ab663566b06fcf38. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:11.321338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Getting quotas for user e0d8624aaea84e50bdb942487d921f81 and project d6be1f9d2cf4446c9e936785fc70de17. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:11.335426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:11.338247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:11.338579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:11.341713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:11.400641 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a05d96b-7ced-4a49-90cf-f1d1f071c90a tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628730 Mar 26 20:52:11.401544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 486/1077] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:11.405807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f370b4bb-b746-4e12-a14d-689e5a8263e0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226967 Mar 26 20:52:11.406672 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 592/1078] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:52:11.411116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.411726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.413101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.414176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.418044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.419062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.419863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.420310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.423735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.425451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.426242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.426694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.613761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:11.636057 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e135fb6-e539-429d-affd-448cc5bee1e1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.228261 Mar 26 20:52:11.636579 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 593/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:11.661920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bc87037-cb44-47ef-9836-9b81815613ac tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.664042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bc87037-cb44-47ef-9836-9b81815613ac tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.664606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:11.674759 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0042677f-cc7d-4e0f-96ef-d13a9debd130 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.272159 Mar 26 20:52:11.686840 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 487/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:11.696658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0f26e1d7-6852-4f1e-9714-434e4ebf8a7c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.697729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0f26e1d7-6852-4f1e-9714-434e4ebf8a7c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.755679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2bc87037-cb44-47ef-9836-9b81815613ac tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:11.758612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0f26e1d7-6852-4f1e-9714-434e4ebf8a7c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:11.765876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0f26e1d7-6852-4f1e-9714-434e4ebf8a7c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1224 microversion: 2.1 time: 0.077760 Mar 26 20:52:11.767676 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bc87037-cb44-47ef-9836-9b81815613ac tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1213 microversion: 2.1 time: 0.129507 Mar 26 20:52:11.768887 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 488/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:11.769139 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 594/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:11.773739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.774508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.786509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:11.787126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:11.789723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.790173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.791159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.791595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.799027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.800439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:11.804223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:11.805679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:12.101402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:12.103340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:12.109219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-664f08b5-da74-4461-86f5-03419606e4da tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.338985 Mar 26 20:52:12.113499 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 489/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:12.127332 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f79a0775-0639-4920-93dc-3ef395fc0ff3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1543 microversion: 2.1 time: 0.344531 Mar 26 20:52:12.129143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 595/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:11 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1543 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:12.652623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:12.653857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:12.673612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:12.674444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:12.675374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:12.675954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:12.693412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:12.693998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:12.706065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:12.706532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:12.707335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:12.707780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.065357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:13.077302 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-466151d2-5dc8-4847-bcf4-620a78dfb381 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.428611 Mar 26 20:52:13.081345 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 490/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:12 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:13.086781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:13.087616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:13.095357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.096161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.097162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.097752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.135895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:13.155568 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a013f1de-9c71-401a-97d7-829038aebe6b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.466285 Mar 26 20:52:13.156221 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 596/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:12 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:13.165705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:13.176728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:13.186685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.187623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.188618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.190050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.327883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:13.352791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de3d09e8-dd3c-4f53-938b-711d0fbdb057 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1265 microversion: 2.1 time: 0.270002 Mar 26 20:52:13.381020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:13.381271 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 491/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:13 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:13.403974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de78899e-5a9b-4c65-b48b-8029e0720fdb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1284 microversion: 2.1 time: 0.244948 Mar 26 20:52:13.408430 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 597/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:13 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:13.412572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:13.422949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:13.428404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:13.446149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:13.473892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.475710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.480498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.484014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.498975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.499576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.514824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:13.518928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:13.921888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:13.933631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9379fdf-50a6-4479-9292-7074fb0c1109 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1542 microversion: 2.1 time: 0.520572 Mar 26 20:52:13.935065 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 598/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:13 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1542 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:14.063547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:14.074300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8475390e-d2b5-4b8d-9dc2-cbf662814e24 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.692088 Mar 26 20:52:14.075060 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 492/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:13 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:14.098017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:14.099401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:14.109066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.109525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.113160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.113632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.175453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:14.185358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:14.213880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.214305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.215154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.215605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.779634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:14.793030 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e2a7cd6-2e08-4527-9725-b9717a970b42 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.700146 Mar 26 20:52:14.793663 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 599/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:14 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:14.799044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1fca06b2-033e-489d-a760-f90d0e2cd3d3 req-c9b9aa6f-8dae-45bb-9220-7fbe3bfde7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6988895-e39c-494d-b277-f819ab920d2e", "name": "network-vif-plugged", "status": "completed", "tag": "456ea6bf-b197-4c02-a631-fb2403437d4c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:14.836708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1fca06b2-033e-489d-a760-f90d0e2cd3d3 req-c9b9aa6f-8dae-45bb-9220-7fbe3bfde7c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.844784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1fca06b2-033e-489d-a760-f90d0e2cd3d3 req-c9b9aa6f-8dae-45bb-9220-7fbe3bfde7c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.880920 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1fca06b2-033e-489d-a760-f90d0e2cd3d3 req-c9b9aa6f-8dae-45bb-9220-7fbe3bfde7c6 service nova] Creating event network-vif-plugged:456ea6bf-b197-4c02-a631-fb2403437d4c for instance a6988895-e39c-494d-b277-f819ab920d2e on nch2-master-1 Mar 26 20:52:14.888252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1fca06b2-033e-489d-a760-f90d0e2cd3d3 req-c9b9aa6f-8dae-45bb-9220-7fbe3bfde7c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092554 Mar 26 20:52:14.888875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 600/1092] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:14.918270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:14.930082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:14.979497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.982430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:14.990563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:14.991098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.296566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:15.309001 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9169e3b9-0c97-43a1-b136-922e9e194fff tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 1.138907 Mar 26 20:52:15.309939 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 493/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:14 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:15.314674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:15.315292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:15.346482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.346941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.347762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.348246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.723674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:15.733797 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16d0affd-6843-401f-81a5-f36598a3d60d tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1271 microversion: 2.1 time: 0.819675 Mar 26 20:52:15.737255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 601/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:14 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1271 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:15.745162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:15.750304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:15.763385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.763840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.769480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.769943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.903716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:15.912340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-62206a4e-2ee1-4d75-88d3-cd30e39a6b24 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.601274 Mar 26 20:52:15.914139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 494/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:15 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:15.928638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:15.931167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:15.938322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.939771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:15.940988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:15.941616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.216781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:16.224594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5cbf58f8-c22a-4b65-a616-d0ae48ecedb2 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1542 microversion: 2.1 time: 0.486061 Mar 26 20:52:16.232254 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 602/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:15 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1542 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:16.241775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:16.242758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:16.252427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.252992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.253896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.254716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.572920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:16.588826 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e735c7b2-db32-4200-9960-b7aa37de2e28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.354472 Mar 26 20:52:16.589355 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 603/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:16 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:16.604319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:16.605250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:16.614491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.615324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.617310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.617948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.641030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:16.670333 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9a5755d-17d5-4afd-a90f-257810ff5c40 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.750118 Mar 26 20:52:16.676273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 495/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:15 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:16.752636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:16.752799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:16.765299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.765768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:16.766608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:16.767071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.047470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:17.081917 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43f2be2d-51fa-46e4-ae23-ccc1534d918d tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1389 microversion: 2.1 time: 0.484427 Mar 26 20:52:17.082918 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 604/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:16 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1389 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:17.102618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:17.116999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:17.144360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.145153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.149564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.150081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.306159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:17.320964 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b32028f9-f51f-447d-842a-cc4792a145f2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.572638 Mar 26 20:52:17.321790 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 496/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:16 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:17.344815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-27599ba0-a069-434b-b048-580ae0269ec6 req-3455781b-2b5e-4180-b1ca-f5c245dce583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:17.371795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-27599ba0-a069-434b-b048-580ae0269ec6 req-3455781b-2b5e-4180-b1ca-f5c245dce583 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.374516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-27599ba0-a069-434b-b048-580ae0269ec6 req-3455781b-2b5e-4180-b1ca-f5c245dce583 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.419381 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-27599ba0-a069-434b-b048-580ae0269ec6 req-3455781b-2b5e-4180-b1ca-f5c245dce583 service nova] Creating event network-changed:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:52:17.426885 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-27599ba0-a069-434b-b048-580ae0269ec6 req-3455781b-2b5e-4180-b1ca-f5c245dce583 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103681 Mar 26 20:52:17.428099 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 497/1101] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:17.437140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:17.441886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:17.451892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.453096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.454242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.454981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.578667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:17.599632 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-227106d3-3bb6-44b6-990d-334f64a99862 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.515237 Mar 26 20:52:17.600608 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 605/1102] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:17 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:17.616438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:17.618078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:17.629845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.630512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.631334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.631812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.772506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:17.795260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af73ce54-b850-4b93-9b37-c2c5efa3d25a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1474 microversion: 2.1 time: 0.358914 Mar 26 20:52:17.804302 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 498/1103] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:17 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:17.826428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-unplugged", "status": "completed", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:17.842852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.843634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.862515 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] Creating event network-vif-unplugged:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:52:17.896707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] Instance 4b8f0b12-682f-4c5b-809a-508c8974e650 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:52:17.916969 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-693899e8-8666-41a3-baf1-e218ef3ff036 req-ef49b1ce-304b-44b9-892e-13214faafcfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097007 Mar 26 20:52:17.918454 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 499/1104] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:17.926777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:17.928166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:17.944065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.945403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:17.946530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:17.947546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.165724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:18.195868 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0dfc46da-a633-44a1-a04d-3314f6020d83 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.582057 Mar 26 20:52:18.198514 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 606/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:17 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:18.206882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:18.214087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:18.248859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.252024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.254221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.254751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.369511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:18.381803 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ebf67bdf-4083-4dcf-973c-71f40d958747 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.459367 Mar 26 20:52:18.384965 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 500/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:17 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:18.398034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:18.398951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:18.414940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.416056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.417243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.418675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.607271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:18.622430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6f41770-24ae-4e5a-8e1d-6bb3d188f651 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1588 microversion: 2.1 time: 0.418749 Mar 26 20:52:18.623647 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 607/1107] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:18 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1588 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:18.628365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7b076b91-7a41-42b8-b49b-c6bab725604b req-3824374c-5bf9-40cd-a410-a82c65fb3545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072aa775-939b-480a-a4e2-1680d5c0b85e", "tag": "2e11fda9-f504-44f0-83b1-a971192e7903"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:18.641752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b076b91-7a41-42b8-b49b-c6bab725604b req-3824374c-5bf9-40cd-a410-a82c65fb3545 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.643023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b076b91-7a41-42b8-b49b-c6bab725604b req-3824374c-5bf9-40cd-a410-a82c65fb3545 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.661693 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7b076b91-7a41-42b8-b49b-c6bab725604b req-3824374c-5bf9-40cd-a410-a82c65fb3545 service nova] Creating event network-changed:2e11fda9-f504-44f0-83b1-a971192e7903 for instance 072aa775-939b-480a-a4e2-1680d5c0b85e on nch1-master-1 Mar 26 20:52:18.672174 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7b076b91-7a41-42b8-b49b-c6bab725604b req-3824374c-5bf9-40cd-a410-a82c65fb3545 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046877 Mar 26 20:52:18.673138 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 608/1108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:18.681230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:18.682228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:18.695708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.696527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.698117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.698722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.810280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:18.839365 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3b6eb1a-7da7-4948-8237-2027f924a770 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.451616 Mar 26 20:52:18.840859 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 501/1109] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:18 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:18.848158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:18.848982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:18.870426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.871489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.872695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:18.873363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:18.985827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:18.993344 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e437b516-a3ed-43b1-9b21-85c1ef218a75 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.318797 Mar 26 20:52:18.994274 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 609/1110] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:18 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:18.998829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:18.999441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:19.005244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.006055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.007034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.007658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.076252 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4b461ca-9f0a-4a03-b641-61629a2b7eb4 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232401 Mar 26 20:52:19.077419 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 502/1111] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:52:18 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:19.214799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:19.215757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:19.232793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.233957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.236308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.237005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.295244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:19.306239 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3a0e7e3f-14a7-4c8a-9482-8298f3c1ca87 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1471 microversion: 2.1 time: 0.310869 Mar 26 20:52:19.321451 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 610/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:18 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:19.326867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:19.327615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:19.345853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.362060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.362060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.362060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.420598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.421390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.422672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.423318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.464566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for project 70c93c47827247b8b178018931efb9a4. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:19.472021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for user 4ef943b3272c48aa884a7ff4a7e854d0 and project 70c93c47827247b8b178018931efb9a4. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:19.620720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:19.630712 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-934196ac-c006-4a00-8ceb-3183b1f77ff0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.419947 Mar 26 20:52:19.632128 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 503/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:19 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:19.653923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:19.658748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:19.677867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.678372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.679309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.679785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.686950 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e01b6a73-9733-49a6-8651-01f0abc7819c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650/action" status: 202 len: 0 microversion: 2.1 time: 0.363299 Mar 26 20:52:19.688229 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 611/1114] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:52:19 2022] POST /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:52:19.700723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:19.701489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:19.710102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.710591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:19.711404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:19.712243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.156690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:20.169228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0210f491-1012-4860-98ed-a11aa9397a29 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.535614 Mar 26 20:52:20.170219 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 504/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:19 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:20.174978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:20.175583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:20.185425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.186166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.187349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.188116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.224508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:20.243096 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40cd3f68-42a9-4dae-95f2-447637150a2e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1470 microversion: 2.1 time: 0.547497 Mar 26 20:52:20.256322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 612/1116] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:19 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:20.256322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a535e9ef-d38b-4cfd-9c9f-88095ed1c620 req-bae1d355-37b7-48de-90e8-a44cd8b0bc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7637a394-e609-4fcf-a3c0-06b029441efa", "name": "network-vif-plugged", "status": "completed", "tag": "63e033aa-f288-475b-a62b-a0edaecd2b6c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:20.267718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a535e9ef-d38b-4cfd-9c9f-88095ed1c620 req-bae1d355-37b7-48de-90e8-a44cd8b0bc97 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.268221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a535e9ef-d38b-4cfd-9c9f-88095ed1c620 req-bae1d355-37b7-48de-90e8-a44cd8b0bc97 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.284661 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a535e9ef-d38b-4cfd-9c9f-88095ed1c620 req-bae1d355-37b7-48de-90e8-a44cd8b0bc97 service nova] Creating event network-vif-plugged:63e033aa-f288-475b-a62b-a0edaecd2b6c for instance 7637a394-e609-4fcf-a3c0-06b029441efa on nch2-master-1 Mar 26 20:52:20.290083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a535e9ef-d38b-4cfd-9c9f-88095ed1c620 req-bae1d355-37b7-48de-90e8-a44cd8b0bc97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044757 Mar 26 20:52:20.290726 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 613/1117] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:20.317128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:20.318619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:20.331764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.332550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.333570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.334193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.619470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:20.628747 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43b67c14-3b33-42ad-8d7f-3a9b7a6ef428 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.336551 Mar 26 20:52:20.629273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 614/1118] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:20 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:20.660401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:20.660401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:20.666052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.666052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.666052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:20.666052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:20.856190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:20.871764 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a5d997d5-6e91-414d-839a-7df3c86cc1cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.226318 Mar 26 20:52:20.873380 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 615/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:20 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:21.189642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:21.190613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:21.199485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.204936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.206315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.206997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.209360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:21.222575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13af3930-7f59-4d3d-b513-9ff62d1abca5 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 1.051114 Mar 26 20:52:21.223213 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 505/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:20 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:21.269181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:21.271235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:21.295561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.297610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.300254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.304883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.525879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:21.546385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6df87936-12d8-4751-a155-49e931564fec tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.362721 Mar 26 20:52:21.557610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 616/1121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:21 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:21.659320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:21.660261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:21.674568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.675487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.676757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.677402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.895954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:21.916480 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-939b7d24-d0a0-44d6-9f1f-4ccef46efa7b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.270887 Mar 26 20:52:21.917494 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 617/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:21 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:21.925394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:21.926409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:21.935043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.935684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.936845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:21.937555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:21.990579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:22.000134 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4e87eef-137b-4598-8ee3-5a2348141262 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1470 microversion: 2.1 time: 0.738843 Mar 26 20:52:22.002156 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 506/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:21 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1470 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:22.049981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ae41461a-5750-4e16-bf0e-2764964b0946 req-9a70228d-5d70-4779-adb7-f6299ed83f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6988895-e39c-494d-b277-f819ab920d2e", "tag": "456ea6bf-b197-4c02-a631-fb2403437d4c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:22.060994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ae41461a-5750-4e16-bf0e-2764964b0946 req-9a70228d-5d70-4779-adb7-f6299ed83f36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.061588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ae41461a-5750-4e16-bf0e-2764964b0946 req-9a70228d-5d70-4779-adb7-f6299ed83f36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.081417 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ae41461a-5750-4e16-bf0e-2764964b0946 req-9a70228d-5d70-4779-adb7-f6299ed83f36 service nova] Creating event network-changed:456ea6bf-b197-4c02-a631-fb2403437d4c for instance a6988895-e39c-494d-b277-f819ab920d2e on nch2-master-1 Mar 26 20:52:22.088376 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ae41461a-5750-4e16-bf0e-2764964b0946 req-9a70228d-5d70-4779-adb7-f6299ed83f36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083058 Mar 26 20:52:22.090217 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 507/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:22.095790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:22.096868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:22.104372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.105141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.106761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.107472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.244157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:22.262668 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55a6279f-90cb-46b3-9618-73d5c5df6d34 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1588 microversion: 2.1 time: 0.339461 Mar 26 20:52:22.284143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 618/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:21 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1588 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:22.289722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:22.290939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:22.300412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.301406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.302138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.302756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.455595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:22.465910 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-756bfbfb-285d-4c35-9b03-7fb3d98c87de tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1321 microversion: 2.1 time: 0.371941 Mar 26 20:52:22.467613 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 508/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:22 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:22.475800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-plugged", "status": "completed", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:22.491009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.491762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.508395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] Creating event network-vif-plugged:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:52:22.516843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] Instance 4b8f0b12-682f-4c5b-809a-508c8974e650 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:52:22.526504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3310d831-ea71-4968-908e-283981d92a5e req-3e665449-0a5b-4c3a-b2f4-b06af5da8147 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057028 Mar 26 20:52:22.528223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 509/1127] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:22.540796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:22.549963 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc981def-81eb-460b-ac6e-f6ddd5667d15 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.264557 Mar 26 20:52:22.551176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 619/1128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:22 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:22.566574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:22.567337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:22.574779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.575241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.576051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.576679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.848923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:22.862311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7db0ce2e-9c61-41b1-b73d-fe5ab66b1d31 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.300367 Mar 26 20:52:22.862903 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 510/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:22 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:22.935328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:22.936831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:22.945218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.945683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:22.946509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:22.946907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.026697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.027295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.033836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.036293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.037457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.038070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.142277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:23.151265 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06c4713d-4e55-4d9c-878a-9f05f849e9d6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.220496 Mar 26 20:52:23.163009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 620/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:22 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:23.244641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:23.253857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-95b32195-8a12-49c1-99af-8a5f2ec1b6c6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1470 microversion: 2.1 time: 0.239018 Mar 26 20:52:23.264036 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 511/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1470 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:23.483400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.484076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.490316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.490772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.491555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.492029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.566710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.567977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.574912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.575334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.576229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.576680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.642613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:23.651237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd46f851-0c3e-4adb-912d-2607b45b5807 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1502 microversion: 2.1 time: 0.172190 Mar 26 20:52:23.651985 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 621/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:23.669281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.669888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.676100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.676231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.676931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.677371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.733415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:23.740990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-505b837a-ba1c-48fb-a2a2-782bbe1b6ce2 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.178197 Mar 26 20:52:23.741575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 512/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:23.815826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:23.823493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a0ab6cd9-c358-4f33-ac00-846adb82317a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1502 microversion: 2.1 time: 0.158617 Mar 26 20:52:23.824600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 622/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:23.840701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.841129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.847798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.848518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.849311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.849924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.877143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:52:23.880436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.881076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.887502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.887975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.888740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.889175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.957428 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e2c2658a-7eb0-44ee-8b5b-c908678ecb84 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 204 len: 0 microversion: 2.1 time: 0.121104 Mar 26 20:52:23.958323 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 513/1135] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:52:23 2022] DELETE /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:52:23.967427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:23.968160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:23.974204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.974661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:23.975438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:23.975879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.037335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:24.046774 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b8267e0-6e80-4f64-9642-ac98bd526779 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.170138 Mar 26 20:52:24.047366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 623/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:24.115444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:24.123401 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac788dc1-8444-4fd3-9aa7-b0d5c58ba301 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1508 microversion: 2.1 time: 0.160741 Mar 26 20:52:24.124752 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 514/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:23 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:24.167592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:24.168372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:24.174755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.175296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.176199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.176705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.276648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:24.277531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:24.287441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.287900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.288705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.289147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.361970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:24.370481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99b370e4-2693-4176-ab96-1fcec79bceb4 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.206903 Mar 26 20:52:24.372474 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 624/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:24 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:24.459680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:24.467685 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-132a03c3-8d97-4900-ab40-b96d4c47396c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1536 microversion: 2.1 time: 0.200880 Mar 26 20:52:24.468522 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 515/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:24 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1536 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:24.757764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:24.758375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:24.764358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.764759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.765561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:24.765999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:24.903077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:24.910578 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-084248fd-4255-443b-81cd-da8e736abd82 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.156623 Mar 26 20:52:24.911202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 625/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:24 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:25.064082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:25.064697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:25.073136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.073595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.074431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.075085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.129501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1903151430", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b4f1069c-0aa3-4d88-b2ef-9a5c20f55049"}], "block_device_mapping_v2": [{"uuid": "2a3f4905-eb37-4708-be4e-acc1bdcab8e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:25.221992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:25.229833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b391e1bf-971c-4183-a5e4-a4d077c0a4b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.169756 Mar 26 20:52:25.230920 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 516/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:25 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:25.234546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] validate_networks() for [('b4f1069c-0aa3-4d88-b2ef-9a5c20f55049', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:25.236584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:25.237201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:25.243415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.243876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.244694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.245253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.490492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:25.500559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d73ad37-de07-40d1-bf3d-6aed9f92f470 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1508 microversion: 2.1 time: 0.268435 Mar 26 20:52:25.510023 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 517/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:25 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:25.510023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:25.510023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:25.515203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.515903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.516724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.517303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.684261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:25.684831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:25.685509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:25.686013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:25.686850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:25.704870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.705258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.706157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.706858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.724654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:25.732581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Getting quotas for user 2bcd816c4f3a495cbe7ce636cf0e2f8a and project cac9d686cedf4368ae6e500602e64596. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:25.774334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:25.782795 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb659bee-9e5e-41ba-a68e-1c5948356f4a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.280325 Mar 26 20:52:25.783977 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 518/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:25 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:25.788648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:25.789530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:25.793198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:25.795292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a3f4905-eb37-4708-be4e-acc1bdcab8e6',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:25.797084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.797787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.798803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.799708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.949887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-86c40e62-4cbb-42a6-b8a8-5dae88c7b570 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.824400 Mar 26 20:52:25.951817 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 626/1144] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 26 20:52:25.957726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-dc77178a-6d1e-4109-9744-1a96901cbe52 req-62a0c5dd-bdb9-4351-9e9f-c0954929ee2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "name": "network-vif-plugged", "status": "completed", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:25.968728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-dc77178a-6d1e-4109-9744-1a96901cbe52 req-62a0c5dd-bdb9-4351-9e9f-c0954929ee2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:25.969497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-dc77178a-6d1e-4109-9744-1a96901cbe52 req-62a0c5dd-bdb9-4351-9e9f-c0954929ee2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:25.985938 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-dc77178a-6d1e-4109-9744-1a96901cbe52 req-62a0c5dd-bdb9-4351-9e9f-c0954929ee2a service nova] Creating event network-vif-plugged:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:52:25.999233 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-dc77178a-6d1e-4109-9744-1a96901cbe52 req-62a0c5dd-bdb9-4351-9e9f-c0954929ee2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045950 Mar 26 20:52:26.000117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 627/1145] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:26.029738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:26.030637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:26.039468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.039944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.040884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.041340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.075000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.084266 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82cdb76f-2529-4139-9133-cd4dcf72726a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1536 microversion: 2.1 time: 0.298920 Mar 26 20:52:26.096202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 519/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:25 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1536 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:26.102366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:26.102996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:26.203952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.212975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.215583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.216979 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5aea25b4-3bd4-41d5-935f-16fe17b63659 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1104 microversion: 2.25 time: 0.119668 Mar 26 20:52:26.229490 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 520/1147] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:26 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1104 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:26.243258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.256087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:26.257617 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d02e7064-c21d-4e71-bd33-4c9cd7d99312 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.243351 Mar 26 20:52:26.259228 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 628/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:26 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:26.264561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:26.274704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.275420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.276433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.277055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.415945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0df08714-b3c3-405b-aff8-6b7fc8b4add5 req-63a6e64d-e088-4ab6-a74a-8e02de75ae33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7637a394-e609-4fcf-a3c0-06b029441efa", "name": "network-vif-deleted", "tag": "63e033aa-f288-475b-a62b-a0edaecd2b6c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:26.434939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0df08714-b3c3-405b-aff8-6b7fc8b4add5 req-63a6e64d-e088-4ab6-a74a-8e02de75ae33 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.437066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0df08714-b3c3-405b-aff8-6b7fc8b4add5 req-63a6e64d-e088-4ab6-a74a-8e02de75ae33 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.460013 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0df08714-b3c3-405b-aff8-6b7fc8b4add5 req-63a6e64d-e088-4ab6-a74a-8e02de75ae33 service nova] Creating event network-vif-deleted:63e033aa-f288-475b-a62b-a0edaecd2b6c for instance 7637a394-e609-4fcf-a3c0-06b029441efa on nch2-master-1 Mar 26 20:52:26.473581 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0df08714-b3c3-405b-aff8-6b7fc8b4add5 req-63a6e64d-e088-4ab6-a74a-8e02de75ae33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066061 Mar 26 20:52:26.477628 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 629/1149] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:26.518578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:26.519280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:26.531784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.532522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.533421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.533850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.546938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.556554 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a3e3e7d-d7f3-43cc-8e01-63d375472a7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.304214 Mar 26 20:52:26.566208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 521/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:26 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:26.634232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.642497 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a553af3e-3ccb-4fd2-86e4-e934f69f04ea tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 200 len: 1306 microversion: 2.1 time: 0.128401 Mar 26 20:52:26.643082 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 630/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:26 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:26.799827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:26.800392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:26.806305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.806761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.807539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:26.808002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:26.943405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:26.951791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c232e3e0-3792-4565-b57d-53f543f289b1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1324 microversion: 2.1 time: 0.155938 Mar 26 20:52:26.952391 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 522/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:26 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1324 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:27.102739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:27.103267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:27.109188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.109639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.110488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.110944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.235614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:27.236344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:27.245226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.248505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.249519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.251958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.297431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.306603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f068162-7d4e-4e0a-995e-c17b0f4b42f3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1536 microversion: 2.1 time: 0.207640 Mar 26 20:52:27.309502 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 631/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:27 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1536 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:27.328254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:27.330405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:27.345745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.348325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.349477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.352508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.386025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.399525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.403758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.405063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-55526085-bc6a-477c-bef6-fe483f76ec7e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1241 microversion: 2.25 time: 0.173263 Mar 26 20:52:27.408896 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 523/1154] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:27 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:27.575616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:27.576337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:27.577134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.583698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.584745 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0480b912-3342-422c-b930-75ca0ae23a1b tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.273800 Mar 26 20:52:27.585058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.586495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.587170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.589185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 632/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:27 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:27.625921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2084409400", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3719dfee-4a50-4ee6-a6eb-866a85cdf502"}], "block_device_mapping_v2": [{"uuid": "2f544925-67cf-4072-b082-f5f62fb093c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:27.699509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] validate_networks() for [('3719dfee-4a50-4ee6-a6eb-866a85cdf502', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:27.864742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:27.873607 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ccb50b80-6dcb-41d5-b15f-5339ac84b997 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.302686 Mar 26 20:52:27.891706 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 524/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:27 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:27.898882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:27.899661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:27.906509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.907275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.908340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:27.909003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:27.923876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. Mar 26 20:52:27.924852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:27.926217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1dae3ed-21c2-499f-a583-89d01203e3b3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 404 len: 111 microversion: 2.1 time: 0.032992 Mar 26 20:52:27.927314 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 525/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:27 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:52:27.939011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: .version_select at 0x7f6e593b8ee0>, body: {"keypair": {"name": "tempest-key-973693221"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:27.955184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:27.961465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:28.226820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:28.227256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:28.228274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:28.228787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:28.229317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:28.246987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.247700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.249559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.250203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.273774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:28.281191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Getting quotas for user c9bd4f2793ec48a5b31d081c269a39c2 and project cf51b08278d246e498f59455e299ba89. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:28.352793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:28.356032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f544925-67cf-4072-b082-f5f62fb093c7',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:28.374699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:28.386046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:28.402455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12152dca-a337-42e7-ac24-6a61d81219cd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.466631 Mar 26 20:52:28.403566 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 526/1158] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:52:27 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:28.408644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:28.409540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:28.415903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.417293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.418536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.419215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.587493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0d8ab878-ccc1-4be7-90ab-bf014cb5c08f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966380 Mar 26 20:52:28.588059 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 633/1159] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:28.593627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072aa775-939b-480a-a4e2-1680d5c0b85e", "name": "network-vif-plugged", "status": "completed", "tag": "2e11fda9-f504-44f0-83b1-a971192e7903"}, {"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-unplugged", "status": "completed", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:28.602823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.603240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.616149 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] Creating event network-vif-plugged:2e11fda9-f504-44f0-83b1-a971192e7903 for instance 072aa775-939b-480a-a4e2-1680d5c0b85e on nch1-master-1 Mar 26 20:52:28.616766 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] Creating event network-vif-unplugged:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:52:28.623814 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-47c28edd-1005-4084-8afb-c67276fc998a req-479da15e-3685-43f7-8b89-a3184bd30647 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034580 Mar 26 20:52:28.624571 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 634/1160] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:28.630973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:28.631674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:28.640037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.649785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.650958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.651601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.803587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:28.819183 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c78d1bd8-2a8c-4c4a-9bf9-46f73e2013a2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1520 microversion: 2.1 time: 0.410763 Mar 26 20:52:28.822740 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 527/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:28 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:28.836060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1257cd2e-9b9b-4398-8fce-aa23c11f12e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '.version_select at 0x7f6e593b8940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:28.838868 ncdv-master-1 devstack@n-api.service[141580]: WARNING oslo_db.sqlalchemy.utils [None req-1257cd2e-9b9b-4398-8fce-aa23c11f12e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:52:28.839201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:28.851291 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1257cd2e-9b9b-4398-8fce-aa23c11f12e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.025889 Mar 26 20:52:28.853696 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ce63425-13cb-4ba4-82c0-eaa67174686d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1529 microversion: 2.1 time: 0.227686 Mar 26 20:52:28.854334 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 528/1162] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:52:28 2022] GET /compute/v2.1/os-keypairs => generated 544 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:28.860708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:28.861329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:28.867552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 635/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:28 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1529 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:28.874168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e26b7c00-860b-420c-8ad4-6982c2bca79d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:28.875144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e26b7c00-860b-420c-8ad4-6982c2bca79d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:28.893883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.895566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.896445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:28.900657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:28.997509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e26b7c00-860b-420c-8ad4-6982c2bca79d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.005089 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e26b7c00-860b-420c-8ad4-6982c2bca79d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1053 microversion: 2.1 time: 0.136711 Mar 26 20:52:29.008503 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 636/1164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:28 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1053 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:29.015396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:29.016003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:29.026692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.027203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.028100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.028750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.174475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.184228 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d54df5c-17c6-4a17-b527-cb36c9c2ed5e tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1313 microversion: 2.1 time: 0.174393 Mar 26 20:52:29.184999 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 637/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:29 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:29.189889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-488b2e0f-4e3c-4ae2-a170-a255c6f2dd2f tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'create', calling method: .version_select at 0x7f6e5940d940>, body: {"pool": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:29.258770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.271758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.276926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.278187 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-488eb336-f05a-45f0-879b-386246b1f0b0 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1293 microversion: 2.25 time: 0.422509 Mar 26 20:52:29.278993 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 529/1166] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:28 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1293 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:29.283639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:29.284505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:29.291640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.292338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.293859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.294493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.575353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.583403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad4fafc3-b403-487d-9bce-3ef563c681e4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1529 microversion: 2.1 time: 0.303048 Mar 26 20:52:29.584236 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 530/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:29 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1529 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:29.590223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:29.591430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:29.598323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.599031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.600074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:29.600739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:29.850195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:29.863608 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80a1ae68-af6a-4db6-89b6-328dbf546a3d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1514 microversion: 2.1 time: 0.278127 Mar 26 20:52:29.864524 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 531/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:29 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:29.871878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1250813761", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "key_name": "tempest-key-973693221", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:29.934332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:30.809218 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-488b2e0f-4e3c-4ae2-a170-a255c6f2dd2f tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.621375 Mar 26 20:52:30.810296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 638/1169] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:52:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:30.829173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc28e2c6-a6c9-4537-98ad-d18f113f6211 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:30.830089 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:30.830089 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:30.840914 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-dc28e2c6-a6c9-4537-98ad-d18f113f6211 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] HTTP exception thrown: Flavor 61883ed4-106e-4e24-b733-cc02cba252d3 could not be found. Mar 26 20:52:30.842603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc28e2c6-a6c9-4537-98ad-d18f113f6211 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Returning 404 to user: Flavor 61883ed4-106e-4e24-b733-cc02cba252d3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:30.844364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc28e2c6-a6c9-4537-98ad-d18f113f6211 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/61883ed4-106e-4e24-b733-cc02cba252d3" status: 404 len: 109 microversion: 2.1 time: 0.025994 Mar 26 20:52:30.845294 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 639/1170] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:52:30 2022] DELETE /compute/v2.1/flavors/61883ed4-106e-4e24-b733-cc02cba252d3 => generated 109 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:52:30.850249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-619b844d-b6de-4d05-8705-e39dfa2d3192 req-a2a217e5-df7b-4cb8-96c6-a0b51c641a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68114f8-3943-44b1-854e-7e316161aa82", "tag": "f08b295e-9561-4e2a-bfda-0f96cd0ccef5"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:30.875853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-619b844d-b6de-4d05-8705-e39dfa2d3192 req-a2a217e5-df7b-4cb8-96c6-a0b51c641a0b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:30.877601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-619b844d-b6de-4d05-8705-e39dfa2d3192 req-a2a217e5-df7b-4cb8-96c6-a0b51c641a0b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:30.893743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-619b844d-b6de-4d05-8705-e39dfa2d3192 req-a2a217e5-df7b-4cb8-96c6-a0b51c641a0b service nova] Creating event network-changed:f08b295e-9561-4e2a-bfda-0f96cd0ccef5 for instance b68114f8-3943-44b1-854e-7e316161aa82 on nch2-master-1 Mar 26 20:52:30.899844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:30.901606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:30.901999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-619b844d-b6de-4d05-8705-e39dfa2d3192 req-a2a217e5-df7b-4cb8-96c6-a0b51c641a0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055115 Mar 26 20:52:30.902566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:30.902948 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 640/1171] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:30.903068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:30.903541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:30.911016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:30.911747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:30.917461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:30.920498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:30.923728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:30.924433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:30.933699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:30.934163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:30.934977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:30.935423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:30.954631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:30.961567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:30.975957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:30.978803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:31.046786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7df7d93-4a9a-43df-9b8a-bbc3ec3796e8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180747 Mar 26 20:52:31.048468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 532/1172] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:31.053933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:31.055134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:31.062274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.063177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.064749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.065448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.066440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:31.080995 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a1e6575-8a61-49ab-b4ad-fe4f9a0b8563 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1169 microversion: 2.1 time: 0.176094 Mar 26 20:52:31.084823 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 641/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:30 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:31.096903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:31.097481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:31.110803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.116796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.117847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.118297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.365986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:31.382672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:31.385165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:31.387813 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-733ac89a-be97-4cc5-b24b-eac55f77da23 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.300520 Mar 26 20:52:31.387813 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 642/1174] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:31 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:31.393074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-977e55a5-42a2-4521-a2a7-5f38c36111cc req-a748bbc6-d582-4b36-a7e2-5152bf3d2617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-plugged", "status": "completed", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:31.402042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-977e55a5-42a2-4521-a2a7-5f38c36111cc req-a748bbc6-d582-4b36-a7e2-5152bf3d2617 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.402496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-977e55a5-42a2-4521-a2a7-5f38c36111cc req-a748bbc6-d582-4b36-a7e2-5152bf3d2617 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.415597 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-977e55a5-42a2-4521-a2a7-5f38c36111cc req-a748bbc6-d582-4b36-a7e2-5152bf3d2617 service nova] Creating event network-vif-plugged:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:52:31.421874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-977e55a5-42a2-4521-a2a7-5f38c36111cc req-a748bbc6-d582-4b36-a7e2-5152bf3d2617 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Mar 26 20:52:31.423136 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 643/1175] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:31.429338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-531355586", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3cefd6de-90d8-4688-a242-74a2eb770644"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:31.493294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] validate_networks() for [('3cefd6de-90d8-4688-a242-74a2eb770644', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:31.515812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:31.524827 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2935b11-a4d7-472d-a1a3-51f46b259b02 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1462 microversion: 2.1 time: 0.474854 Mar 26 20:52:31.526251 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 533/1176] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:31 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1462 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:31.546735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:31.547655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:31.557622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.560417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.561643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.564442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.960251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:31.960810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:31.961127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:31.961532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:31.961941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:31.972061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.972845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.973713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:31.974343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:31.993210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Getting quotas for project d6be1f9d2cf4446c9e936785fc70de17. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:31.998659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Getting quotas for user e0d8624aaea84e50bdb942487d921f81 and project d6be1f9d2cf4446c9e936785fc70de17. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:32.012509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:32.015074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:32.061611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0edde546-b4e7-4a3d-aa67-de9b385b1ddb tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637360 Mar 26 20:52:32.062257 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 644/1177] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:32.067048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-471239643", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:32.121713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:32.226483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:32.235040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1dddbf54-26ef-44e2-8983-3818b1e0808c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1520 microversion: 2.1 time: 0.694896 Mar 26 20:52:32.235712 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 534/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:31 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1520 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:32.258346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.261913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:32.293479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.294595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.295616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.298129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.451895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:32.461594 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a78abb4-872a-49ee-bbaf-96ca4b6aa95e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1288 microversion: 2.1 time: 0.212795 Mar 26 20:52:32.471598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 535/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1288 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:32.473897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:32.474507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:32.475433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:32.476065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:32.476688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:32.490848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.491248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.492122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.492564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.512543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:32.518850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Getting quotas for user 4ef943b3272c48aa884a7ff4a7e854d0 and project 70c93c47827247b8b178018931efb9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:32.533839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:32.540015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Calling method '.version_select at 0x7f6e5934caf0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.546292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:32.550268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.550805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.570404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.571049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.591281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ec0ecf1-4517-4b52-968d-a9cea6e1002b tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d7b7b7e274924321ab663566b06fcf38?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414" status: 200 len: 694 microversion: 2.1 time: 0.118178 Mar 26 20:52:32.592276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 536/1180] 10.222.0.16 () {58 vars in 1411 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/os-simple-tenant-usage/d7b7b7e274924321ab663566b06fcf38?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414 => generated 694 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:32.597565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.598216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:32.604726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.605512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.606316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.606761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.617874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-660a22b7-c61e-4c6e-a395-df7c54b0f89f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553794 Mar 26 20:52:32.625163 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 645/1181] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:32.631786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.632529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:32.647157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.647622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.652330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.652755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.775394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:32.784304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5629bd7b-a91d-4758-b8cf-f2df86b88ab0 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1227 microversion: 2.1 time: 0.190826 Mar 26 20:52:32.800175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 537/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1227 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:32.806422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.809614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:32.822315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.826539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.828728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.829188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.878366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:32.887265 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f71a0a4-fbcb-441b-af45-da3da0c8def3 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.260745 Mar 26 20:52:32.889435 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 646/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:32.895257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '.version_select at 0x7f6e59441940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.905031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.905584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.924553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:32.925114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:32.945486 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06ad0d6a-d4e8-486c-9ebd-73753ce0af22 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d7b7b7e274924321ab663566b06fcf38?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414" status: 200 len: 694 microversion: 2.1 time: 0.054316 Mar 26 20:52:32.946240 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 647/1184] 10.222.0.16 () {58 vars in 1411 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/os-simple-tenant-usage/d7b7b7e274924321ab663566b06fcf38?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414 => generated 694 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:32.962825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3149479-d54d-4bbc-a3d4-0740352b6e39 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:32.963470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3149479-d54d-4bbc-a3d4-0740352b6e39 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.018845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3149479-d54d-4bbc-a3d4-0740352b6e39 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.028582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3149479-d54d-4bbc-a3d4-0740352b6e39 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1212 microversion: 2.1 time: 0.078528 Mar 26 20:52:33.029600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 648/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:33.035060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Calling method '.version_select at 0x7f6e5940aaf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.044201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.044652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.061574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.062025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.120035 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4581c4a-e312-4011-9ff0-d8030d376e57 tempest-TenantUsagesTestJSON-1147644299 tempest-TenantUsagesTestJSON-1147644299-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414&detailed=1" status: 200 len: 14245 microversion: 2.1 time: 0.089023 Mar 26 20:52:33.120888 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 649/1186] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-25T20%3A52%3A31.535414&end=2022-03-27T20%3A52%3A31.535414&detailed=1 => generated 14245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:52:33.142846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.144794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.153869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.154493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.155355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.156460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.187148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:52:33.255065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.269238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.274031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.275209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1806e001-b924-4322-94fb-9fd6628553d3 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.473540 Mar 26 20:52:33.278730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 538/1187] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:32 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:33.290592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.296525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.325264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.325792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.330124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.332622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.353443 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68ee33b2-fe47-4d80-88e4-52f47158b455 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "DELETE /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 204 len: 0 microversion: 2.1 time: 0.214752 Mar 26 20:52:33.378232 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 650/1188] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:52:33 2022] DELETE /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:52:33.394108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.400958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.411074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.415390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.416353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.416818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.636677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.649408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22ff42d1-2a84-4cfd-883f-b7bfd859a0cd tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1468 microversion: 2.1 time: 0.266525 Mar 26 20:52:33.650589 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 651/1189] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1468 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:33.656805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.657801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.665292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.666105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.668445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.669726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.756432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.764246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa0254a6-c1eb-4bd6-ace4-f57d73bb62ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1286 microversion: 2.1 time: 0.112219 Mar 26 20:52:33.774261 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 652/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:33.779521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-158511f0-8064-4fc5-9c6c-0dd0d69ac56f req-e4d4c432-e8ca-4bf8-9ebe-f11e1ab1d1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9ddccd-3d9d-4f22-a991-d9f94e62e449", "name": "network-vif-unplugged", "status": "completed", "tag": "51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:33.791383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-158511f0-8064-4fc5-9c6c-0dd0d69ac56f req-e4d4c432-e8ca-4bf8-9ebe-f11e1ab1d1d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.792736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-158511f0-8064-4fc5-9c6c-0dd0d69ac56f req-e4d4c432-e8ca-4bf8-9ebe-f11e1ab1d1d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.805874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-158511f0-8064-4fc5-9c6c-0dd0d69ac56f req-e4d4c432-e8ca-4bf8-9ebe-f11e1ab1d1d9 service nova] Creating event network-vif-unplugged:51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694 for instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 on nch1-master-1 Mar 26 20:52:33.811675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-158511f0-8064-4fc5-9c6c-0dd0d69ac56f req-e4d4c432-e8ca-4bf8-9ebe-f11e1ab1d1d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036363 Mar 26 20:52:33.812548 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 653/1191] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:33.818075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fd60066d-b166-48f5-be7a-4984fe53218c req-3ab08c09-d9f1-4f4a-8db2-14e40cc0bec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5511f470-27c0-4ddf-822f-d673e8af803c", "tag": "93403676-99cc-45f4-a873-3df0d3991850"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:33.826598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fd60066d-b166-48f5-be7a-4984fe53218c req-3ab08c09-d9f1-4f4a-8db2-14e40cc0bec9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.827468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fd60066d-b166-48f5-be7a-4984fe53218c req-3ab08c09-d9f1-4f4a-8db2-14e40cc0bec9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.838032 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fd60066d-b166-48f5-be7a-4984fe53218c req-3ab08c09-d9f1-4f4a-8db2-14e40cc0bec9 service nova] Creating event network-changed:93403676-99cc-45f4-a873-3df0d3991850 for instance 5511f470-27c0-4ddf-822f-d673e8af803c on nch2-master-1 Mar 26 20:52:33.844502 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fd60066d-b166-48f5-be7a-4984fe53218c req-3ab08c09-d9f1-4f4a-8db2-14e40cc0bec9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029282 Mar 26 20:52:33.844950 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 654/1192] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:33.849950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.850654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.857486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.857948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.858723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.859174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.932077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:33.942492 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3cd2cdf-69f5-4d46-ae32-de22a2316e9c tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1281 microversion: 2.1 time: 0.096320 Mar 26 20:52:33.952119 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 655/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:33.952119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:33.952119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:33.957243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.957703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:33.958498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:33.959082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.005150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.030300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f7633486-15dd-484a-82f9-b457dfed5f72 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1520 microversion: 2.1 time: 0.750436 Mar 26 20:52:34.046462 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 539/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1520 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:34.055263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:34.055892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:34.069261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.069731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.070533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.070977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.202749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.212312 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1d3abac0-df66-4f1c-942c-7917cec586d9 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1272 microversion: 2.1 time: 0.164421 Mar 26 20:52:34.212900 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 540/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:34 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:34.295990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.300895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:34.302372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:34.307372 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c63aed99-1d04-4f55-95a0-d1f89d46e077 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.362576 Mar 26 20:52:34.309168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 656/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:33 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:34.314426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.316053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.318495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.321382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.667172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:34.668091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:34.674436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.674809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.675625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.677674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.730833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.749568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.751569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:34.753734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d8bf58e-0b20-42c6-8fae-05c46c4d817b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.459831 Mar 26 20:52:34.754634 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 541/1197] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:34 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:34.784310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:34.785450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:34.792764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.793595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:34.794600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:34.795297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.087407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:35.098524 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-537b2d96-ca37-4843-b467-e1d9889cb736 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1468 microversion: 2.1 time: 0.435495 Mar 26 20:52:35.107372 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 657/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:34 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:35.113117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:35.113741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:35.131687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.132457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.133470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.134115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.220414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:35.230789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84d2d040-ddbf-44fb-85f8-2101797b73f1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1281 microversion: 2.1 time: 0.122150 Mar 26 20:52:35.231705 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 658/1199] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:35 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:35.236717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:35.237618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:35.250366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.251274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.252347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.252953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.643502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:35.653382 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-62f88a8e-b397-4435-8477-f21cd417410a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.875150 Mar 26 20:52:35.654219 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 542/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:34 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:35.668783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:35.669643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:35.676903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.677772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.678462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.678579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.686573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:35.695173 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a8569e9-009a-4288-b340-f5e32658a0c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1520 microversion: 2.1 time: 0.462097 Mar 26 20:52:35.706465 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 659/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:35 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:35.712145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:35.720726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:35.728222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.729058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:35.731950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:35.732712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.233843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.253112 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72e44e91-7125-4e00-87ef-496793d5a2e1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.541868 Mar 26 20:52:36.253798 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 660/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:35 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:36.267406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:36.270662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:36.282439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.283641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.285943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.290381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.411232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.427244 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1bd55518-2e18-409d-bdfc-151225700425 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.763170 Mar 26 20:52:36.428144 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 543/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:35 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:36.433151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:36.436703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:36.453612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.454076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.454884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.456027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.524476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.524952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.525467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lazy-loading 'fault' on Instance uuid 072aa775-939b-480a-a4e2-1680d5c0b85e {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:36.616662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.624715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.626340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.627551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e496360-ca98-43ab-a209-c3a82a168760 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.370606 Mar 26 20:52:36.638393 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 661/1204] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:36 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:36.642647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c580ce88b74633832c6be6d3e08a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7b7b7e274924321ab663566b06fcf38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:36.643406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:36.644139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:36.653717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.654257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.655127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.655649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.657331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8e79df7-b24c-4ed9-82c2-f0ccbaa7ba59 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 200 len: 1303 microversion: 2.1 time: 0.226203 Mar 26 20:52:36.658331 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 544/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:36 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:36.681934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-52ea4b45-a4d7-49d6-8be7-45475a858f5d req-54395d45-7fd4-4752-8849-7f87b7c25a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072aa775-939b-480a-a4e2-1680d5c0b85e", "name": "network-vif-deleted", "tag": "2e11fda9-f504-44f0-83b1-a971192e7903"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:36.711461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-52ea4b45-a4d7-49d6-8be7-45475a858f5d req-54395d45-7fd4-4752-8849-7f87b7c25a9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.712064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-52ea4b45-a4d7-49d6-8be7-45475a858f5d req-54395d45-7fd4-4752-8849-7f87b7c25a9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.727296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-52ea4b45-a4d7-49d6-8be7-45475a858f5d req-54395d45-7fd4-4752-8849-7f87b7c25a9b service nova] Creating event network-vif-deleted:2e11fda9-f504-44f0-83b1-a971192e7903 for instance 072aa775-939b-480a-a4e2-1680d5c0b85e on nch1-master-1 Mar 26 20:52:36.734056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-52ea4b45-a4d7-49d6-8be7-45475a858f5d req-54395d45-7fd4-4752-8849-7f87b7c25a9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071215 Mar 26 20:52:36.735486 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 545/1206] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:36.743511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:36.744702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:36.753295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.753881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:36.754771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:36.755305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.023975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:37.032975 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8785d23-68fb-4d42-8e95-53b47d4dfeef tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.393041 Mar 26 20:52:37.033924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 662/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:36 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:37.039495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:37.040162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:37.046203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.046665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.047566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.048048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.287892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:37.296573 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a99d403-7975-4bdf-a20a-fee8f2812859 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1520 microversion: 2.1 time: 0.261395 Mar 26 20:52:37.298550 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 663/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:37 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:37.306634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-87308714-d4ef-4b34-b584-c001c636f90b req-86895bf2-ab37-499f-9bb5-e885372d750b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5befa018-5000-4e02-941b-24ee5d09f607", "tag": "a8dae999-0d21-4f61-98cc-9514caf565ba"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:37.320679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-87308714-d4ef-4b34-b584-c001c636f90b req-86895bf2-ab37-499f-9bb5-e885372d750b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.322539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-87308714-d4ef-4b34-b584-c001c636f90b req-86895bf2-ab37-499f-9bb5-e885372d750b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.345665 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-87308714-d4ef-4b34-b584-c001c636f90b req-86895bf2-ab37-499f-9bb5-e885372d750b service nova] Creating event network-changed:a8dae999-0d21-4f61-98cc-9514caf565ba for instance 5befa018-5000-4e02-941b-24ee5d09f607 on nch1-master-1 Mar 26 20:52:37.353940 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-87308714-d4ef-4b34-b584-c001c636f90b req-86895bf2-ab37-499f-9bb5-e885372d750b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051919 Mar 26 20:52:37.355812 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 664/1209] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:37.357927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:37.362356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:37.363151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:37.370955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.372110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.373098 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa55f0e3-161d-4227-ba5e-97b96bb7cb71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.636096 Mar 26 20:52:37.373409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.373708 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 546/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:36 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:37.374581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.445328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:37.445969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:37.453550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.454306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.455274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.455868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.729514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:37.739623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dcb87367-b26c-47af-97ea-7b9cc8dcf4f6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.382319 Mar 26 20:52:37.744359 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 665/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:37 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:37.750450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-91a2f925-591e-47fe-94fb-367bbc042aee req-d01f7908-f87a-4781-b5ab-6f8e1926de3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9ddccd-3d9d-4f22-a991-d9f94e62e449", "name": "network-vif-plugged", "status": "completed", "tag": "51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:37.760247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-91a2f925-591e-47fe-94fb-367bbc042aee req-d01f7908-f87a-4781-b5ab-6f8e1926de3d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.761554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-91a2f925-591e-47fe-94fb-367bbc042aee req-d01f7908-f87a-4781-b5ab-6f8e1926de3d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.773521 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-91a2f925-591e-47fe-94fb-367bbc042aee req-d01f7908-f87a-4781-b5ab-6f8e1926de3d service nova] Creating event network-vif-plugged:51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694 for instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 on nch1-master-1 Mar 26 20:52:37.779034 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-91a2f925-591e-47fe-94fb-367bbc042aee req-d01f7908-f87a-4781-b5ab-6f8e1926de3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Mar 26 20:52:37.779662 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 666/1212] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:37.785118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:37.785832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:37.793840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.794307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.795107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:37.795557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:37.995893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.007752 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-011575f8-9f81-40bc-b49a-914dd5e4a2ac tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.566047 Mar 26 20:52:38.017406 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 547/1213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:37 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:38.017406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:38.017406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] [instance: 072aa775-939b-480a-a4e2-1680d5c0b85e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:38.028872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.034502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.034967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.035758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.036241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.037213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.038745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.039946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32f43487-ec58-468e-94a1-e8705dcb8e7b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.258931 Mar 26 20:52:38.040552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 667/1214] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:37 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:38.054921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:38.056129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:38.061647 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] HTTP exception thrown: Instance 072aa775-939b-480a-a4e2-1680d5c0b85e could not be found. Mar 26 20:52:38.062253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] Returning 404 to user: Instance 072aa775-939b-480a-a4e2-1680d5c0b85e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:38.063087 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4381954-ce37-4dde-9be9-2adfec745440 tempest-TenantUsagesTestJSON-1533560404 tempest-TenantUsagesTestJSON-1533560404-project] 10.222.0.16 "GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e" status: 404 len: 111 microversion: 2.1 time: 0.053731 Mar 26 20:52:38.079936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 548/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:38 2022] GET /compute/v2.1/servers/072aa775-939b-480a-a4e2-1680d5c0b85e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:52:38.088727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.089290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.090129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.090530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.261873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.269751 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14a28d91-13cc-49b7-9b6f-c1da84492e1b tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.223840 Mar 26 20:52:38.271460 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 668/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:38 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:38.315100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:38.315858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:38.327249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.327757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.331592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.332247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.390456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:38.391398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:38.397847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.398553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.399348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.399980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.578262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.586448 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3794ccb9-2e1a-424b-b95f-5cf31af362b2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.200716 Mar 26 20:52:38.587325 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 669/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:38 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:38.750399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:38.762820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3212556f-f983-403c-98af-98ca1ff2e813 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1520 microversion: 2.1 time: 0.451784 Mar 26 20:52:38.763425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 549/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:38 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:38.765081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:38.765386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:38.771627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.772331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.773123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.773607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.785130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6e98feb3-63fd-46a8-9e5d-fb19b374d165 req-1b747af3-6323-428c-b906-b014ec53c4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:38.794709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6e98feb3-63fd-46a8-9e5d-fb19b374d165 req-1b747af3-6323-428c-b906-b014ec53c4be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:38.795164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6e98feb3-63fd-46a8-9e5d-fb19b374d165 req-1b747af3-6323-428c-b906-b014ec53c4be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:38.809859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6e98feb3-63fd-46a8-9e5d-fb19b374d165 req-1b747af3-6323-428c-b906-b014ec53c4be service nova] Creating event network-changed:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:52:38.814945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6e98feb3-63fd-46a8-9e5d-fb19b374d165 req-1b747af3-6323-428c-b906-b014ec53c4be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 Mar 26 20:52:38.815730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 550/1219] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:39.007105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.020817 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-252e1eea-5997-4203-8de1-9bf1df7dd0cf tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.262795 Mar 26 20:52:39.022027 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 670/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:38 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:39.034827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:39.035554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:39.042214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.042677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.043481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.043946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.059590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:39.060864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:39.067213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.068067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.069038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.069677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.293791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.306063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.309036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.310494 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b8ebb68e-e105-4d55-be54-15904096f434 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.255823 Mar 26 20:52:39.312549 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 671/1221] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:39 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:39.318086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:39.319216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:39.331388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.332911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.333889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.334360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.605525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.611583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.613655 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22f9ea95-d249-443c-9bfc-96e162a314fe tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.585049 Mar 26 20:52:39.614248 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 551/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:39 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:39.625981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ea9d172c-b215-42b6-a648-955b7d536fe9 req-2353babf-9372-49f4-a426-1c14c682667d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c5308d-ab4c-477b-9792-4d069959cf60", "tag": "303d5329-41df-4a9b-a437-bbfb5a9e23bd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:39.628217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aff4d893-762f-4093-851b-21af5401dbf5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.314169 Mar 26 20:52:39.629196 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 672/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:39 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:39.634231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:39.635136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:39.641023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.641481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.642262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.642709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.654783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ea9d172c-b215-42b6-a648-955b7d536fe9 req-2353babf-9372-49f4-a426-1c14c682667d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.656376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ea9d172c-b215-42b6-a648-955b7d536fe9 req-2353babf-9372-49f4-a426-1c14c682667d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.678550 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ea9d172c-b215-42b6-a648-955b7d536fe9 req-2353babf-9372-49f4-a426-1c14c682667d service nova] Creating event network-changed:303d5329-41df-4a9b-a437-bbfb5a9e23bd for instance 29c5308d-ab4c-477b-9792-4d069959cf60 on nch2-master-1 Mar 26 20:52:39.688676 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ea9d172c-b215-42b6-a648-955b7d536fe9 req-2353babf-9372-49f4-a426-1c14c682667d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073122 Mar 26 20:52:39.690235 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 552/1224] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:39.782578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:39.785042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:39.795122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.795711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.797052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.797578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.827636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:39.835133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49028344-bd92-4f2d-a61b-66f9d97177f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.204948 Mar 26 20:52:39.835732 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 673/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:39 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:39.845228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b87a7e57-6d47-4b67-8649-59def78e32b5 req-a2327d4c-a4e3-4536-947b-1eb89341412f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68114f8-3943-44b1-854e-7e316161aa82", "name": "network-vif-plugged", "status": "completed", "tag": "f08b295e-9561-4e2a-bfda-0f96cd0ccef5"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:39.859080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b87a7e57-6d47-4b67-8649-59def78e32b5 req-a2327d4c-a4e3-4536-947b-1eb89341412f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:39.860669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b87a7e57-6d47-4b67-8649-59def78e32b5 req-a2327d4c-a4e3-4536-947b-1eb89341412f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:39.874773 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b87a7e57-6d47-4b67-8649-59def78e32b5 req-a2327d4c-a4e3-4536-947b-1eb89341412f service nova] Creating event network-vif-plugged:f08b295e-9561-4e2a-bfda-0f96cd0ccef5 for instance b68114f8-3943-44b1-854e-7e316161aa82 on nch2-master-1 Mar 26 20:52:39.881615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b87a7e57-6d47-4b67-8649-59def78e32b5 req-a2327d4c-a4e3-4536-947b-1eb89341412f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044567 Mar 26 20:52:39.882939 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 674/1226] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:40.041723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.044008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.053473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.054372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.055444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.056139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.067432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.079099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-20238e23-f71c-4939-aa55-4f85d0696afc tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1505 microversion: 2.1 time: 0.301660 Mar 26 20:52:40.080268 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 553/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:39 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:40.095675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.096515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.103101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.103786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.105482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.106152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.287740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.297511 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0057bc74-6b80-4581-b2cc-98276e0dcb74 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 200 len: 1505 microversion: 2.1 time: 0.205529 Mar 26 20:52:40.303815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.310854 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 554/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:40 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:40.313614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a634d6e7-ce0d-4b5b-b954-a9a22672b83c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.277886 Mar 26 20:52:40.314267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 675/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:40 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:40.324536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.326021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.330445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.331133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.333077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.334332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.335898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.336803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.340198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.341326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.345356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.345877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.364655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:52:40.505723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.509135 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-07543e3e-6d75-403e-b234-5aab1ff363bb tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 204 len: 0 microversion: 2.1 time: 0.189619 Mar 26 20:52:40.510148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 555/1230] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:52:40 2022] DELETE /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:52:40.520018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.523722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.525946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5724f0a3-05ff-4650-a382-cf04216f8f8c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1281 microversion: 2.25 time: 0.199481 Mar 26 20:52:40.537548 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 676/1231] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:40 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:52:40.624220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-73964934", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "29f25562-2089-4ea5-a798-18bd9113e9ac"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:40.632331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.632899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.640142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.640553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.641373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.642101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.685010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] validate_networks() for [('29f25562-2089-4ea5-a798-18bd9113e9ac', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:40.805249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:40.813646 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-102e84e5-dc91-4510-a6ef-3629c2b78fcc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.186830 Mar 26 20:52:40.814483 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 677/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:40 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:40.837749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:40.838389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:40.845014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.845477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:40.847413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:40.847413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.002539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.013209 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab56f09c-e540-42da-9170-cbf5e93a0ba6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.186287 Mar 26 20:52:41.013990 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 678/1233] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:40 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:41.019370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.020267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.029732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.030349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.031296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.031798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.100560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:41.101113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:41.101933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:41.102361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:41.102784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:41.112613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.113075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.113887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.114325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.132989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:41.138600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for user b5effd8428df4616865ee71160f53594 and project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:41.151733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:41.154177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:41.177535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.186740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9c6f026-292b-4cbf-b02f-54c4d58c8c56 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.171392 Mar 26 20:52:41.187722 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 679/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:41.210444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de4f78a8-2335-45f2-8160-0489fbdf7655 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591729 Mar 26 20:52:41.211742 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 556/1235] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:41.221226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b8a1dee-4251-46cc-8062-5b8f4f54080c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.221841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b8a1dee-4251-46cc-8062-5b8f4f54080c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.291250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b8a1dee-4251-46cc-8062-5b8f4f54080c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.299237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b8a1dee-4251-46cc-8062-5b8f4f54080c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1216 microversion: 2.1 time: 0.081819 Mar 26 20:52:41.300236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 680/1236] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:41.334227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.335269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.343118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.343577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.344393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.345125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.555404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.556219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.567634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.568451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.569550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.569993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.614110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.621575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6de16db6-628f-487b-b076-ebc013a1d37b tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.292061 Mar 26 20:52:41.622155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 557/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:41.752773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.764794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.767622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:41.769447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c84cf238-8d95-4f3a-bb18-11a452bc98b8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1477 microversion: 2.25 time: 0.218561 Mar 26 20:52:41.770229 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 681/1238] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:52:41.790771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.791628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.802249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.804458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.810884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.811630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.835458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:41.837861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:41.845190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.845951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:41.846922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:41.847367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.039957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:42.050054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5bda3f05-db67-4528-8d63-cadfae0c0adc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.219024 Mar 26 20:52:42.050719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 682/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:42.055768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.056652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.064504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.065089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid b68114f8-3943-44b1-854e-7e316161aa82 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:42.065460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.066775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.067599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.088436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a5a3729-6d85-43bf-9ae4-60a3dea2c6c0 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1970 microversion: 2.25 time: 0.302573 Mar 26 20:52:42.089541 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 558/1240] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:41 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1970 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:42.107780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.109164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.116995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.117794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.118824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.119469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.250781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:42.259050 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-102f8192-4a86-4de9-97e0-16a1b6557aa6 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.207095 Mar 26 20:52:42.259797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 683/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:42.269400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.270872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.278121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.278599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.279695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.280318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.461178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid b68114f8-3943-44b1-854e-7e316161aa82 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:42.500429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d65699f6-74e5-4a9d-b886-ca2141616b0c tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1970 microversion: 2.25 time: 0.390084 Mar 26 20:52:42.513288 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 559/1242] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1970 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:52:42.518835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.532765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:42.533131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.539200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.540001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.540618 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e57ac2e3-ec54-4d7a-a2f4-ca36b78afa80 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.278913 Mar 26 20:52:42.541043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.541505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.542286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 684/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:42.550827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b7e7cf63-c5a2-4707-afc2-f2b416dd117c req-bf49a239-be9c-42a8-8d48-348df92ad7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5511f470-27c0-4ddf-822f-d673e8af803c", "name": "network-vif-plugged", "status": "completed", "tag": "93403676-99cc-45f4-a873-3df0d3991850"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:42.574766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e7cf63-c5a2-4707-afc2-f2b416dd117c req-bf49a239-be9c-42a8-8d48-348df92ad7e2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.576100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e7cf63-c5a2-4707-afc2-f2b416dd117c req-bf49a239-be9c-42a8-8d48-348df92ad7e2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.600269 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b7e7cf63-c5a2-4707-afc2-f2b416dd117c req-bf49a239-be9c-42a8-8d48-348df92ad7e2 service nova] Creating event network-vif-plugged:93403676-99cc-45f4-a873-3df0d3991850 for instance 5511f470-27c0-4ddf-822f-d673e8af803c on nch2-master-1 Mar 26 20:52:42.612363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b7e7cf63-c5a2-4707-afc2-f2b416dd117c req-bf49a239-be9c-42a8-8d48-348df92ad7e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068468 Mar 26 20:52:42.612985 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 685/1244] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:42.621483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.622864 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:42.622864 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:52:42.627766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.627766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.630399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.632486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.666501 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcabbe87-378b-4d1e-9807-84bee66228c2 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052144 Mar 26 20:52:42.667611 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 686/1245] 10.222.0.16 () {60 vars in 1216 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:52:42.673511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:42.674381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.680999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:42.687653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.690609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.691549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.692130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.692644 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02274bc9-5ddd-4da6-9545-03218165b461 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1286 microversion: 2.1 time: 0.177845 Mar 26 20:52:42.698983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 560/1246] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:42.709647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:42.712858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:42.725946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.731553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.732736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:42.733388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:42.767773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'flavor' on Instance uuid b68114f8-3943-44b1-854e-7e316161aa82 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:42.784137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Going to try to live migrate instance to nch1-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:52:42.964489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:42.973776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74c2c5d3-1d09-4d7c-9516-926f9390f743 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1199 microversion: 2.1 time: 0.305015 Mar 26 20:52:42.978477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 687/1247] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:42 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1199 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:43.070081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:43.071126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:43.080324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:43.081126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:43.085790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:43.088759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:43.469234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:43.490114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4f742a1-5a42-40bf-b7b4-10b6243226e3 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.422070 Mar 26 20:52:43.496263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 688/1248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:43 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:43.534792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:43.537133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:43.555323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:43.556122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:43.557130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:43.558480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:43.909966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:43.937284 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d2c9d56-5107-405b-b06e-22ed523900d5 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.437410 Mar 26 20:52:43.941743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 689/1249] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:43 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:43.954224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5a41d276-b5da-44e5-8de4-c42e04ec0480 req-3d85d546-666c-473b-8e0f-358b1b5e1cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9ddccd-3d9d-4f22-a991-d9f94e62e449", "name": "network-vif-deleted", "tag": "51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:43.966105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5a41d276-b5da-44e5-8de4-c42e04ec0480 req-3d85d546-666c-473b-8e0f-358b1b5e1cb7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:43.966882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5a41d276-b5da-44e5-8de4-c42e04ec0480 req-3d85d546-666c-473b-8e0f-358b1b5e1cb7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.010894 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5a41d276-b5da-44e5-8de4-c42e04ec0480 req-3d85d546-666c-473b-8e0f-358b1b5e1cb7 service nova] Creating event network-vif-deleted:51ebf85c-7bb5-4aea-b7ff-e1e2bdd59694 for instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 on nch1-master-1 Mar 26 20:52:44.017871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5a41d276-b5da-44e5-8de4-c42e04ec0480 req-3d85d546-666c-473b-8e0f-358b1b5e1cb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074420 Mar 26 20:52:44.019408 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 690/1250] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:44.031064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:44.032199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:44.041516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.043323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.045713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.046377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.502151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:44.509881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6d10d10-592b-4608-94e3-9a9b6e1f886d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.488501 Mar 26 20:52:44.510511 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 691/1251] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:44 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:44.532415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:44.533319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:44.544462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.546779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.552955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.553420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.867481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:44.885826 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2e3d1fb-49b5-4bc2-8428-aff522e0c410 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.361338 Mar 26 20:52:44.886975 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 692/1252] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:44 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:44.892959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:44.894041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:44.904278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.904278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:44.904587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:44.905262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.226282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:45.230897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa7eefb7-42f6-4e8f-a889-454570cb51cd tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82/action" status: 202 len: 0 microversion: 2.25 time: 2.530689 Mar 26 20:52:45.231519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 561/1253] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:52:42 2022] POST /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82/action => generated 0 bytes in 2532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:52:45.238847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:45.245603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e610383-2e08-47d3-9a06-9383ac03ccd9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1382 microversion: 2.1 time: 0.357812 Mar 26 20:52:45.247433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:45.268155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 693/1254] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:44 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1382 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:45.278785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c96f7b76-6c3d-489e-8987-f1bddb52e8b8 req-d8b23db2-43a0-4b61-aaeb-d24457ba436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5befa018-5000-4e02-941b-24ee5d09f607", "name": "network-vif-plugged", "status": "completed", "tag": "a8dae999-0d21-4f61-98cc-9514caf565ba"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:45.280964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.285925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.287127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.292295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.294322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c96f7b76-6c3d-489e-8987-f1bddb52e8b8 req-d8b23db2-43a0-4b61-aaeb-d24457ba436a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.294784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c96f7b76-6c3d-489e-8987-f1bddb52e8b8 req-d8b23db2-43a0-4b61-aaeb-d24457ba436a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.325581 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c96f7b76-6c3d-489e-8987-f1bddb52e8b8 req-d8b23db2-43a0-4b61-aaeb-d24457ba436a service nova] Creating event network-vif-plugged:a8dae999-0d21-4f61-98cc-9514caf565ba for instance 5befa018-5000-4e02-941b-24ee5d09f607 on nch1-master-1 Mar 26 20:52:45.340185 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c96f7b76-6c3d-489e-8987-f1bddb52e8b8 req-d8b23db2-43a0-4b61-aaeb-d24457ba436a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070386 Mar 26 20:52:45.341360 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 694/1255] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:45.346644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:45.361148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:45.375459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.375941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.376746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.377193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.718403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:45.727368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56892ea0-ec45-4cb4-99e8-953df1a85e15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.493947 Mar 26 20:52:45.741461 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 562/1256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:45 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:45.748791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:45.749827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:45.760413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.761227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.762670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.763341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.785694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:45.793950 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f07da107-d5ca-41db-9f9f-73d45a47a682 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.451231 Mar 26 20:52:45.803051 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 695/1257] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:45 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:45.805764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cc591229-dc0f-4681-8d11-8eb1d3ad670a req-6010d790-1ffd-49e5-9eff-d7e92b23cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da132383-a7f1-43fd-8160-f3a4ad2ce4f1", "tag": "fb15c4ca-1f95-4280-be6b-6b881e010ddd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:45.828162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cc591229-dc0f-4681-8d11-8eb1d3ad670a req-6010d790-1ffd-49e5-9eff-d7e92b23cba2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.829534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cc591229-dc0f-4681-8d11-8eb1d3ad670a req-6010d790-1ffd-49e5-9eff-d7e92b23cba2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.843559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cc591229-dc0f-4681-8d11-8eb1d3ad670a req-6010d790-1ffd-49e5-9eff-d7e92b23cba2 service nova] Creating event network-changed:fb15c4ca-1f95-4280-be6b-6b881e010ddd for instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 on nch1-master-1 Mar 26 20:52:45.850908 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cc591229-dc0f-4681-8d11-8eb1d3ad670a req-6010d790-1ffd-49e5-9eff-d7e92b23cba2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055005 Mar 26 20:52:45.852469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 696/1258] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:45.858523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:45.859602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:45.867071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.867901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:45.869095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:45.869992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.012419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:46.039147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:46.042930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:46.044342 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fcffe499-fc80-415d-8655-66f56cb96e92 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.300932 Mar 26 20:52:46.044918 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 563/1259] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:45 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:46.049909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.050671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:46.056784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.057365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.058831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.059359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.219812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:46.228903 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e902002-41d3-4d7a-a077-4e13dd3d8bf4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1328 microversion: 2.1 time: 0.182080 Mar 26 20:52:46.229875 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 564/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:46.234928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.236388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:46.243240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.244198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.245319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.246027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.392864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:46.403680 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1ef3f698-7459-4416-9384-7b3fb2055192 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.172387 Mar 26 20:52:46.404543 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 565/1261] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:46.622451 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84dcf4fa-23f8-4bdd-84dc-894f7b1a334c tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1533 microversion: 2.1 time: 0.768513 Mar 26 20:52:46.623629 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 697/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:45 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1533 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:46.639967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.640930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:46.647143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.647862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.648992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.649679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.746676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.748016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:46.755942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.757174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.758634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.759241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.790637 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b1a9916-72f9-4cc0-8da5-d2b5022f5c43 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1533 microversion: 2.1 time: 0.155321 Mar 26 20:52:46.803735 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 566/1263] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1533 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:46.810914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.813062 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:52:46.813062 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:52:46.815070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.815816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.816921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.817606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.856996 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f54b3e6b-df4b-437b-b049-930d0abfc717 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050291 Mar 26 20:52:46.857801 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 567/1264] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:46.865192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:46.866041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:46.875192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.876264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:46.877180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:46.877733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.062288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:47.073407 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa9ef40f-c42c-4db6-9686-d70a8eb8d93a tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.212334 Mar 26 20:52:47.074434 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 568/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:47.082756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:47.084850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:47.100228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.101003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.102883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.103615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.140089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lazy-loading 'flavor' on Instance uuid 5511f470-27c0-4ddf-822f-d673e8af803c {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:52:47.154924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Going to try to live migrate instance to nch1-master-1 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:52:47.298829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:47.315342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60cd35b4-e32e-4fc7-bfa8-f89b450b3e6c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.573662 Mar 26 20:52:47.319416 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 698/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:46 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:47.337768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:47.341983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:47.351767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.352619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.354695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.355307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.820487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:47.829848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:47.831623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:47.833063 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a35ca1fe-4ca6-43dd-9351-1389cfd98430 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.512429 Mar 26 20:52:47.844289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 699/1267] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:47 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:47.849404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:47.850270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:47.864342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.865026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:47.865962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:47.866504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.213947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:48.231656 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f980c297-5cee-4349-9727-6f40126cc3bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1509 microversion: 2.1 time: 0.384199 Mar 26 20:52:48.232957 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 700/1268] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:47 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:48.243122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-plugged", "status": "completed", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}, {"server_uuid": "29c5308d-ab4c-477b-9792-4d069959cf60", "name": "network-vif-plugged", "status": "completed", "tag": "303d5329-41df-4a9b-a437-bbfb5a9e23bd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:48.263747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.264830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.312425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] Creating event network-vif-plugged:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:52:48.313025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] Creating event network-vif-plugged:303d5329-41df-4a9b-a437-bbfb5a9e23bd for instance 29c5308d-ab4c-477b-9792-4d069959cf60 on nch2-master-1 Mar 26 20:52:48.331393 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c959fc25-f45c-4900-a0cb-ed0038aee0fa req-f3012bc9-a5ac-4ab4-8110-e818882d9489 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094830 Mar 26 20:52:48.332591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 701/1269] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:48.345861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:48.348209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:48.355939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.357022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.357980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.359088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.752799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:48.765849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a734e1e8-b65a-4081-b300-35cee84d5767 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.431839 Mar 26 20:52:48.766448 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 702/1270] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:48 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:48.773556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:48.774218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:48.790954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.792405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.796118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.796771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.916252 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80d62378-63bd-4531-a4e1-f79029a77d7a tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c/action" status: 202 len: 0 microversion: 2.1 time: 1.840409 Mar 26 20:52:48.917661 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 569/1271] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:52:47 2022] POST /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c/action => generated 0 bytes in 1842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:52:48.929854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:48.944705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:48.956263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.956948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:48.957753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:48.958192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.139235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.154244 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1da96e8c-7806-463d-97a9-a31888a7bd00 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.383375 Mar 26 20:52:49.155037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 703/1272] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:48 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:49.170290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.172694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.183349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.188747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.189300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.190170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.192540 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-961162b6-f5ad-4b0e-adf8-fd791b7c777b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1509 microversion: 2.1 time: 0.266447 Mar 26 20:52:49.192694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.194532 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 570/1273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:48 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:49.201067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.201971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.210850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.211423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.212704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.214135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.462141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.470875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1978f03e-fc95-4a34-b637-45cf0c39e239 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1312 microversion: 2.1 time: 0.305086 Mar 26 20:52:49.471469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 704/1274] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:49 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:49.485657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.487397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.501755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.503188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.504315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.504931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.505983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.517492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.519783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.521228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e02f310-2857-4719-b0bf-4f4ff12a6bf9 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.325393 Mar 26 20:52:49.522428 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 571/1275] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:49 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:49.527755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.528802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.537048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.537876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.539189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.539942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.570897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:52:49.668562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02faa79d-7aff-45cb-8085-48ce7a0407ee tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 204 len: 0 microversion: 2.1 time: 0.144128 Mar 26 20:52:49.673560 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 572/1276] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:52:49 2022] DELETE /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:52:49.680993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.682095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.691015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.691665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.692710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.693339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.861986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:49.870519 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c30c4cfc-6c39-4f2c-bc40-6bbb1649e521 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1515 microversion: 2.1 time: 0.194938 Mar 26 20:52:49.871184 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 573/1277] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:49 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:49.875794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:49.876671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:49.882876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.883334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:49.884162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:49.884605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.038156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.046937 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c8b91d3-02d6-441c-972e-8c1d308691bd tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.174446 Mar 26 20:52:50.062144 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 574/1278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:49 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:50.116688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.126047 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6623f235-5ad5-4192-bfc4-94e97116f2fd tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.649762 Mar 26 20:52:50.137675 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 705/1279] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:49 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:50.171036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.171666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:50.179410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.180086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.181002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.181706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.375886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.384247 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b63871f1-e99b-498d-bdaa-e41a66e681d2 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1323 microversion: 2.1 time: 0.217159 Mar 26 20:52:50.394804 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 575/1280] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:50.456240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb296d7b-285d-4d9d-abdb-88a2c4200b73 tempest-FloatingIPDetailsNegativeTestJSON-1360100869 tempest-FloatingIPDetailsNegativeTestJSON-1360100869-project] Calling method '.version_select at 0x7f6e593ffb80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.489196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.491582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:50.498386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.499081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.500745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.501423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.506020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-cb296d7b-285d-4d9d-abdb-88a2c4200b73 tempest-FloatingIPDetailsNegativeTestJSON-1360100869 tempest-FloatingIPDetailsNegativeTestJSON-1360100869-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 43264308-4f8a-4240-a71f-7dbeba406617 could not be found", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:52:50.506906 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cb296d7b-285d-4d9d-abdb-88a2c4200b73 tempest-FloatingIPDetailsNegativeTestJSON-1360100869 tempest-FloatingIPDetailsNegativeTestJSON-1360100869-project] HTTP exception thrown: Floating IP not found for ID 43264308-4f8a-4240-a71f-7dbeba406617 Mar 26 20:52:50.507570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb296d7b-285d-4d9d-abdb-88a2c4200b73 tempest-FloatingIPDetailsNegativeTestJSON-1360100869 tempest-FloatingIPDetailsNegativeTestJSON-1360100869-project] Returning 404 to user: Floating IP not found for ID 43264308-4f8a-4240-a71f-7dbeba406617 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:50.508438 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb296d7b-285d-4d9d-abdb-88a2c4200b73 tempest-FloatingIPDetailsNegativeTestJSON-1360100869 tempest-FloatingIPDetailsNegativeTestJSON-1360100869-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/43264308-4f8a-4240-a71f-7dbeba406617" status: 404 len: 111 microversion: 2.1 time: 0.167945 Mar 26 20:52:50.508998 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 706/1281] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/os-floating-ips/43264308-4f8a-4240-a71f-7dbeba406617 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:52:50.540685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.541694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:50.549171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.549598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.550374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.550816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.746334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.760842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.765419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.767967 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d89b59e6-5237-4165-9727-f1f909e6e03d tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.231851 Mar 26 20:52:50.769477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 707/1282] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:50.809151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:50.819963 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbc3bf25-1ad3-4672-9a68-b2cb8dfacf9e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1460 microversion: 2.1 time: 0.335033 Mar 26 20:52:50.828874 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 576/1283] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1460 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:50.836310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.837132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:50.845692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.846158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.847754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.848974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.887501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:50.888185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:50.914170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.914632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:50.915448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:50.915898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.223642 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c790f17c-d600-4f73-85e3-7168b3fcfaa2 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1611 microversion: 2.1 time: 0.391215 Mar 26 20:52:51.233906 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 708/1284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1611 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:51.237656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:51.238297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:51.256576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.257216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.258156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.260435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.567643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:51.578591 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e77911d5-6fbb-411d-b1c6-ceb85c5aea9a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1515 microversion: 2.1 time: 0.695183 Mar 26 20:52:51.593061 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 577/1285] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:50 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:52:51.602417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:51.603045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:51.625822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.626364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.629259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.629738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.672537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:51.683947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b861ec48-5aba-4606-8b0b-e563cfae2c87 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.454479 Mar 26 20:52:51.686125 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 709/1286] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:51 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:51.704203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:51.704856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:51.715215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.722553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.723611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:51.725752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:51.911535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9cb9502357fd45fd99a17d6df3061dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06bf78b652a0421f83c99b220ce334c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:51.914332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] flavor_id is None. Assuming migration. {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 26 20:52:51.915149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 20:52:52.092355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:52.110218 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-206f3198-c10f-4c9c-ba14-6b7b6d03dfc2 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.515856 Mar 26 20:52:52.113464 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 578/1287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:51 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:52.127307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:52.137153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:52.160381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.160966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.163272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.164208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.429605 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e914221-07e9-42d2-a73b-99acde29ce65 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4/action" status: 202 len: 0 microversion: 2.1 time: 0.739095 Mar 26 20:52:52.431126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 710/1288] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:52:51 2022] POST /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:52:52.436895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-40dfd279-f82e-4df4-915d-7afea40cd81e req-29c765fa-e72c-433d-b099-23dff8612ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68114f8-3943-44b1-854e-7e316161aa82", "name": "network-vif-unplugged", "status": "completed", "tag": "f08b295e-9561-4e2a-bfda-0f96cd0ccef5"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:52.453023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-40dfd279-f82e-4df4-915d-7afea40cd81e req-29c765fa-e72c-433d-b099-23dff8612ccf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.453731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-40dfd279-f82e-4df4-915d-7afea40cd81e req-29c765fa-e72c-433d-b099-23dff8612ccf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.474889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-40dfd279-f82e-4df4-915d-7afea40cd81e req-29c765fa-e72c-433d-b099-23dff8612ccf service nova] Creating event network-vif-unplugged:f08b295e-9561-4e2a-bfda-0f96cd0ccef5 for instance b68114f8-3943-44b1-854e-7e316161aa82 on nch2-master-1 Mar 26 20:52:52.487191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-40dfd279-f82e-4df4-915d-7afea40cd81e req-29c765fa-e72c-433d-b099-23dff8612ccf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054032 Mar 26 20:52:52.488426 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 711/1289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:52.496031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:52.497331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:52.506351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.507284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.508521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.509221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.628025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:52.645541 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4be03c0-4220-4051-80af-bfe90fbd77a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 200 len: 1520 microversion: 2.1 time: 0.527457 Mar 26 20:52:52.659468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 579/1290] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:52 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:52.680505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-74783383-f95c-4d17-9f7d-9f5c5592af78 req-bececcb3-9a8a-4790-bf9e-70e0ebf04f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da132383-a7f1-43fd-8160-f3a4ad2ce4f1", "name": "network-vif-plugged", "status": "completed", "tag": "fb15c4ca-1f95-4280-be6b-6b881e010ddd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:52.700612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-74783383-f95c-4d17-9f7d-9f5c5592af78 req-bececcb3-9a8a-4790-bf9e-70e0ebf04f52 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.703848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-74783383-f95c-4d17-9f7d-9f5c5592af78 req-bececcb3-9a8a-4790-bf9e-70e0ebf04f52 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.730133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-74783383-f95c-4d17-9f7d-9f5c5592af78 req-bececcb3-9a8a-4790-bf9e-70e0ebf04f52 service nova] Creating event network-vif-plugged:fb15c4ca-1f95-4280-be6b-6b881e010ddd for instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 on nch1-master-1 Mar 26 20:52:52.741816 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-74783383-f95c-4d17-9f7d-9f5c5592af78 req-bececcb3-9a8a-4790-bf9e-70e0ebf04f52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080619 Mar 26 20:52:52.742763 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 580/1291] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:52.753891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:52.754599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:52.764144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.769308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.771735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:52.773341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:52.980262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:52.992685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:52.996374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:53.002737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f63274f-5d0e-4279-b49b-ef4ac23166d8 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.512307 Mar 26 20:52:53.004958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 712/1292] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:52 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:53.011892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:53.018670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:53.035529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.036220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:53.037191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.037796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:53.222877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:53.231320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7a19b08-e391-4897-8c08-a5d6afa43389 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 200 len: 1473 microversion: 2.1 time: 0.223149 Mar 26 20:52:53.231876 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 713/1293] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:53 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:53.248155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: .version_select at 0x7f6e5bd9a160>, body: {"addFloatingIp": {"address": "172.35.4.121"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:53.249645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:53.256237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.256980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:53.257983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.258595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:53.539269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Acquired lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:52:53.732543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:53.740605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-28257bb0-5304-419a-be6b-fdd5bf76c033 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1469 microversion: 2.1 time: 0.996663 Mar 26 20:52:53.756391 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 581/1294] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:52 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1469 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:53.763760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:53.764649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:53.778398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.779155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:53.783042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:53.783727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.099477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:54.114001 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9a88d50a-d0c7-4941-8a97-06a0d95ea4aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.355574 Mar 26 20:52:54.114860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 582/1295] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:53 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:54.128681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:54.130705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:54.156371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.159999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.161136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.167976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.455413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:54.466140 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-482ed3c9-451e-42c1-93e1-bc6bbeac1632 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.348511 Mar 26 20:52:54.470894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 583/1296] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:54 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:54.480269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:54.481063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:54.490290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.490756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.492192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.492192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.778662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:54.797312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:54.800045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:54.802980 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3450aee1-272d-4c1f-8e61-feadc65e70da tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.330391 Mar 26 20:52:54.829096 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 584/1297] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:54 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:54.859155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:54.863620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:54.879109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.879783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.880884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.881620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.919471 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. Mar 26 20:52:54.920400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:52:54.921439 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6828f62-ca72-45e7-a4d5-19f620600c59 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 404 len: 111 microversion: 2.1 time: 0.090983 Mar 26 20:52:54.922518 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 585/1298] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:54 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:52:54.944681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68114f8-3943-44b1-854e-7e316161aa82", "tag": "f08b295e-9561-4e2a-bfda-0f96cd0ccef5"}, {"server_uuid": "5befa018-5000-4e02-941b-24ee5d09f607", "name": "network-vif-deleted", "tag": "a8dae999-0d21-4f61-98cc-9514caf565ba"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:54.955518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.957359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.971718 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] Creating event network-changed:f08b295e-9561-4e2a-bfda-0f96cd0ccef5 for instance b68114f8-3943-44b1-854e-7e316161aa82 on nch2-master-1 Mar 26 20:52:54.972972 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] Creating event network-vif-deleted:a8dae999-0d21-4f61-98cc-9514caf565ba for instance 5befa018-5000-4e02-941b-24ee5d09f607 on nch1-master-1 Mar 26 20:52:54.982182 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-441eca3c-2068-46fe-af60-40ea2949bdd2 req-255875fb-9336-4573-843f-db79d2fbd81b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058201 Mar 26 20:52:54.983121 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 586/1299] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:54.988669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:54.989803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:54.997328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.998096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:54.999094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:54.999732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:55.371259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:55.390336 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1b6adab-225f-4584-9966-f8c4ea89abf6 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1469 microversion: 2.1 time: 0.405480 Mar 26 20:52:55.391563 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 587/1300] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:54 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:55.407750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-32f97a13-1863-486a-9dee-0569c70918c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '.version_select at 0x7f6e592d6b80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:55.445513 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-32f97a13-1863-486a-9dee-0569c70918c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-973693221" status: 202 len: 0 microversion: 2.1 time: 0.052754 Mar 26 20:52:55.446650 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 588/1301] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 20:52:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-973693221 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:52:55.477955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:55.478636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:55.503292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:55.503846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:55.504801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:55.505244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:55.893470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:55.903288 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-54ad5a31-06fb-4cb1-ae40-82b3cac5c06b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1316 microversion: 2.1 time: 0.438051 Mar 26 20:52:55.904308 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 589/1302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:55 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:55.919047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:55.921081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:55.928530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:55.928993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:55.930145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:55.932050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:56.037551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Building network info cache for instance {{(pid=141581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:52:56.426773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:56.437095 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d682df4-3336-404c-9ba6-b3c5ef16249c tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.522355 Mar 26 20:52:56.437681 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 590/1303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:55 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:56.448796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1292727713", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:56.508016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:52:56.973796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:52:56.974344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:52:56.974822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:52:56.975241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:52:56.975657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:52:56.993323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:56.993778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:56.995232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:56.995671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.034305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:52:57.039823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:52:57.053904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:52:57.057407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:52:57.137314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-590df1c1-ba36-4334-96fb-09f98dec4401 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698141 Mar 26 20:52:57.139122 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 591/1304] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:52:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:52:57.145763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:57.146655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:57.158849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.159754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.160949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.161816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.411217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:57.421356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:57.423267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:57.424787 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18c27a82-eb3f-420c-b260-1419fcc0991b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.284326 Mar 26 20:52:57.425890 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 592/1305] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:57 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:57.431726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:57.432633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:57.439031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.439787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.440953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.441718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.690739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:57.701661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c553b2d1-1b59-43a5-9e01-6a86c5b7e8b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.274310 Mar 26 20:52:57.713469 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 593/1306] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:57 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:57.720613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:57.721474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:57.731146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.731907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.734103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:57.734762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:57.960552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:57.972317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f46768c5-df53-42ca-8453-bb6c8456a1f7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1506 microversion: 2.1 time: 0.255241 Mar 26 20:52:57.973294 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 594/1307] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:57 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:57.978610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:57.979354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:57.992523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.000384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.002485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.003246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.085870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Updating instance_info_cache with network_info: [{"id": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd", "address": "fa:16:3e:a5:79:ac", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fa41142-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:52:58.103330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:58.111321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Releasing lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:52:58.112744 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3de40cb4-d8e7-4c8f-9019-9659a6768ade tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action" status: 202 len: 0 microversion: 2.1 time: 4.868735 Mar 26 20:52:58.113450 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 714/1308] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:52:53 2022] POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action => generated 0 bytes in 4870 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:52:58.114776 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e2494b1-a425-43d6-9388-b3b93680dc88 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1205 microversion: 2.1 time: 0.140102 Mar 26 20:52:58.126446 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 595/1309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:57 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1205 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:58.132788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:58.134052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:58.137787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-bbe5b8e3-5ff7-424c-b11c-f32f7aafa109 req-f8cd520e-f085-40ba-8d4e-e053c60c1b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:58.146707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.147948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.149160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.149911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.160327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bbe5b8e3-5ff7-424c-b11c-f32f7aafa109 req-f8cd520e-f085-40ba-8d4e-e053c60c1b44 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.161976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bbe5b8e3-5ff7-424c-b11c-f32f7aafa109 req-f8cd520e-f085-40ba-8d4e-e053c60c1b44 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.192032 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-bbe5b8e3-5ff7-424c-b11c-f32f7aafa109 req-f8cd520e-f085-40ba-8d4e-e053c60c1b44 service nova] Creating event network-changed:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:52:58.204921 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-bbe5b8e3-5ff7-424c-b11c-f32f7aafa109 req-f8cd520e-f085-40ba-8d4e-e053c60c1b44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087435 Mar 26 20:52:58.209128 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 715/1310] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:52:58.234821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:58.238777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:58.256938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.257757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.258963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.259578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.382626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:58.402215 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61ff2144-d4a0-472b-8ce3-2d282ef12571 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.274209 Mar 26 20:52:58.403299 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 596/1311] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:58 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:58.408343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: .version_select at 0x7f6e5bd9c160>, body: {"addFloatingIp": {"address": "172.35.4.121"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:58.409700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:58.416556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.417016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.417799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.418241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.484864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Acquired lock "refresh_cache-29c5308d-ab4c-477b-9792-4d069959cf60" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:52:58.764983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:58.774485 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bef6ef05-e24d-4cd0-9917-ca524d9b2075 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1506 microversion: 2.1 time: 0.562527 Mar 26 20:52:58.778215 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 716/1312] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:58 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:58.783497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:58.784584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:58.799556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.800236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:58.801144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:58.801699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.336436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:59.352956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:59.356325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:59.357947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-667b08f1-25e6-4b88-805e-63947e3e1f63 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1487 microversion: 2.25 time: 0.578430 Mar 26 20:52:59.358921 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 717/1313] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:52:58 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1487 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:52:59.364316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:59.365349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:59.374189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.375079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.376099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.376856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.815247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:52:59.824921 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38838d80-77fe-4b0d-8529-16ab27fdd31f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.464405 Mar 26 20:52:59.835389 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 718/1314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:59 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:59.853341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:52:59.856939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:59.864010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.864697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.866245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.866859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.939615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4fea2a74-6054-4f15-8270-6495a0bf8f37 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "PUT /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1078 microversion: 2.1 time: 0.102341 Mar 26 20:52:59.941065 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 719/1315] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:52:59 2022] PUT /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1078 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:52:59.946987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:52:59.948224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:52:59.954914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.955560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:52:59.956309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:52:59.956754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.063577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:00.071831 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1a8e91c-c544-401d-ba99-8d9d25aaae04 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1267 microversion: 2.1 time: 0.129325 Mar 26 20:53:00.073190 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 720/1316] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:52:59 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:00.078237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:00.079006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:00.085826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.086346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.087438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.088621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.351700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:00.363610 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2810ae0-0d69-497c-91d4-24af432df35a tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.289079 Mar 26 20:53:00.364376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 721/1317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:00 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:00.371518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:00.372358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:00.380434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.381387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.383409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.384003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.418459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:00.614220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fa655a5-9880-47ec-9eec-f1e1f15a6cec tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 204 len: 0 microversion: 2.1 time: 0.246958 Mar 26 20:53:00.624276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 722/1318] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:00 2022] DELETE /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:00.631433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:00.632525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:00.639861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.640660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.642343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.643005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.867633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:00.879354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d4f37c6-fc7d-4436-b56e-575fce750b32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1504 microversion: 2.1 time: 0.253259 Mar 26 20:53:00.880398 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 723/1319] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:00 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:00.898910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:00.901365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:00.909561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.910304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:00.911433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:00.912148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.163049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.178226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.180375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.183087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b3d515f-a282-4ac9-b712-42aaa139e062 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1477 microversion: 2.25 time: 0.295846 Mar 26 20:53:01.195601 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 724/1320] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:00 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1477 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:01.205201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:01.205601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:01.212990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.213341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.214123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.214612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.399022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.412239 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0bf49dd-3d63-46c9-8cae-f84c86f3dd57 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1713 microversion: 2.1 time: 0.216978 Mar 26 20:53:01.417515 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 725/1321] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:01 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1713 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:01.425620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:01.426894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:01.454115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.454571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.455555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.456024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.636044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.662999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d4b584f-5fb5-4848-a118-0ad623adc465 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.240554 Mar 26 20:53:01.673824 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 726/1322] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:01 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:01.685960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:01.689246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:01.698066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.698533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.699522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.700014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.846354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.neutron [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] re-assign floating IP 172.35.4.121 from instance 57e63d03-35e2-483a-9c79-1bf148fccfbb Mar 26 20:53:01.876994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:01.887875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7884c93f-1ca9-4d07-9cd7-0ffd068cb1e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1504 microversion: 2.1 time: 0.222490 Mar 26 20:53:01.888912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 727/1323] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:01 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:01.905911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:01.906520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:01.914122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.914672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Building network info cache for instance {{(pid=141580) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:53:01.914828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:01.916889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:01.917408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.085775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:02.094052 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14dbabd9-0dd7-416e-a9af-cf85945897bb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1309 microversion: 2.1 time: 0.192020 Mar 26 20:53:02.094961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 728/1324] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:01 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:02.101126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aec4b364-4ab4-4a1e-91de-13565be61300 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '.version_select at 0x7f6e5938cf70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:02.105114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aec4b364-4ab4-4a1e-91de-13565be61300 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.105794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aec4b364-4ab4-4a1e-91de-13565be61300 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.124054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aec4b364-4ab4-4a1e-91de-13565be61300 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 5313 microversion: 2.25 time: 0.027953 Mar 26 20:53:02.125117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 729/1325] 10.222.0.16 () {60 vars in 1183 bytes} [Sat Mar 26 20:53:02 2022] GET /compute/v2.1/os-migrations => generated 5313 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:02.139551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:02.140208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:02.147633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.148389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.149251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.150011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.340438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:02.349720 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1abe75f1-6f8c-47bb-a094-c7014f6a2b0f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.223459 Mar 26 20:53:02.356361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 730/1326] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:02 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:02.366140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-27931879-9e00-4b32-872d-083cfb2486ce req-8fb877ce-fbd5-4f09-a7da-462b9bdb1c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:02.375905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-27931879-9e00-4b32-872d-083cfb2486ce req-8fb877ce-fbd5-4f09-a7da-462b9bdb1c73 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.376446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-27931879-9e00-4b32-872d-083cfb2486ce req-8fb877ce-fbd5-4f09-a7da-462b9bdb1c73 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.389577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-27931879-9e00-4b32-872d-083cfb2486ce req-8fb877ce-fbd5-4f09-a7da-462b9bdb1c73 service nova] Creating event network-changed:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:53:02.397089 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-27931879-9e00-4b32-872d-083cfb2486ce req-8fb877ce-fbd5-4f09-a7da-462b9bdb1c73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044954 Mar 26 20:53:02.397918 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 731/1327] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:02.403738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:02.405364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:02.411878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.412382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.413362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.413961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.499627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:02.514912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:02.517312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:02.518004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:02.518661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:02.634779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:02.642955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.643898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.644952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.645567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.691028 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd99a1b1-f61e-48f9-a4b5-480008bff00d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "POST /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1/action" status: 202 len: 1110 microversion: 2.1 time: 0.291522 Mar 26 20:53:02.694959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 732/1328] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:02 2022] POST /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1/action => generated 1110 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 26 20:53:02.701482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:02.702630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:02.711033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.711833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:02.713678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:02.714295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:03.274736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Updating instance_info_cache with network_info: [{"id": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd", "address": "fa:16:3e:a5:79:ac", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fa41142-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:53:03.294433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Building network info cache for instance {{(pid=141580) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:53:03.607398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] Lazy-loading 'services' on Instance uuid b68114f8-3943-44b1-854e-7e316161aa82 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:03.625277 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03507ee1-5413-418d-80c8-38e1e3d5c445 tempest-LiveAutoBlockMigrationV225Test-1196014644 tempest-LiveAutoBlockMigrationV225Test-1196014644-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1970 microversion: 2.25 time: 0.929255 Mar 26 20:53:03.626155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 733/1329] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:02 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1970 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:03.631745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:03.632724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:03.639126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:03.640084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:03.641161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:03.641757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:03.880939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Updating instance_info_cache with network_info: [{"id": "303d5329-41df-4a9b-a437-bbfb5a9e23bd", "address": "fa:16:3e:72:d7:dc", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap303d5329-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:53:03.894764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Releasing lock "refresh_cache-29c5308d-ab4c-477b-9792-4d069959cf60" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:53:03.895759 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af968197-48aa-4c8f-a59f-619056e8d792 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60/action" status: 202 len: 0 microversion: 2.1 time: 5.491307 Mar 26 20:53:03.896407 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 597/1330] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:52:58 2022] POST /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60/action => generated 0 bytes in 5492 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:53:03.902261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:03.902891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:03.909110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:03.909572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:03.910391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:03.910892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.057360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:04.064875 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7152e795-e917-43b9-bebf-7198e2e02f9d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.167223 Mar 26 20:53:04.065454 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 598/1331] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:03 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:04.071647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.072366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.078298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.078764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.079555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.080030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.217471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:04.224835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e6e4bdf-5113-4879-a235-13fe2e9a638b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.158359 Mar 26 20:53:04.225408 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 599/1332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:04.229797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.230403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.236005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.236461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.237260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.237703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.283722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:04.294977 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70c276a4-5fca-496a-be9e-cf929c25687b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1713 microversion: 2.1 time: 0.666178 Mar 26 20:53:04.303463 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 734/1333] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:03 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1713 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:04.313679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78352182-bc42-486b-ad34-b5f28279cd4a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59db5550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.363426 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78352182-bc42-486b-ad34-b5f28279cd4a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470" status: 200 len: 661 microversion: 2.1 time: 0.058681 Mar 26 20:53:04.364238 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 735/1334] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:04.369320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.370259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.378164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.378922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.380149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.380596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.415440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:04.425004 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24ba5691-59ab-4698-a046-50177072879c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1309 microversion: 2.1 time: 0.198390 Mar 26 20:53:04.438493 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 600/1335] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:04.444329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.445112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.451988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.452445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.453464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.454079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.481786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:04.602714 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b87e3ba-353b-4d2f-b4f9-42d388725d71 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 204 len: 0 microversion: 2.25 time: 0.161552 Mar 26 20:53:04.604782 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 601/1336] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:53:04 2022] DELETE /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:53:04.611505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: .version_select at 0x7f6e5bd9c430>, body: {"removeFloatingIp": {"address": "172.35.4.121"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:04.638194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:04.652746 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d377c054-0bad-4c7d-bf0d-896b33d614d7 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.287188 Mar 26 20:53:04.655214 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 736/1337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:04.670450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1783c64c-a8e4-4523-9e97-0fd3035552a9 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5940a430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.743443 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1783c64c-a8e4-4523-9e97-0fd3035552a9 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470" status: 200 len: 661 microversion: 2.1 time: 0.085529 Mar 26 20:53:04.746648 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 737/1338] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470 => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:04.767780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c5308d-ab4c-477b-9792-4d069959cf60", "tag": "303d5329-41df-4a9b-a437-bbfb5a9e23bd"}, {"name": "network-changed", "server_uuid": "b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a", "tag": "67eeccc0-3a32-4de1-95bd-053cea3ae6eb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:04.788961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.789621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.795625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.802492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.802946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.803727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.804194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.818559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] Creating event network-changed:303d5329-41df-4a9b-a437-bbfb5a9e23bd for instance 29c5308d-ab4c-477b-9792-4d069959cf60 on nch2-master-1 Mar 26 20:53:04.819867 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] Creating event network-changed:67eeccc0-3a32-4de1-95bd-053cea3ae6eb for instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a on nch2-master-1 Mar 26 20:53:04.827108 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6ca00ca0-5a96-4010-bd13-97515d737ce2 req-d2207e06-d24c-4534-84d0-0f1b458fb8eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078806 Mar 26 20:53:04.828286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 738/1339] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:04.834754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:04.835651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:04.844597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.845488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:04.860037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:04.860945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.189103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.211959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.216689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.218764 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fe78f771-61f6-4437-806c-bbb165b7876b tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1483 microversion: 2.25 time: 0.388978 Mar 26 20:53:05.224230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 739/1340] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:04 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1483 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:05.233126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:05.237265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:05.244228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] HTTP exception thrown: Floating IP 172.35.4.121 is not associated with instance 57e63d03-35e2-483a-9c79-1bf148fccfbb. Mar 26 20:53:05.244751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Returning 409 to user: Floating IP 172.35.4.121 is not associated with instance 57e63d03-35e2-483a-9c79-1bf148fccfbb. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:05.246488 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-925eb281-c752-440b-bec2-c48ef0086bfd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action" status: 409 len: 146 microversion: 2.1 time: 0.640038 Mar 26 20:53:05.247091 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 602/1341] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:04 2022] POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action => generated 146 bytes in 642 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:53:05.251876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f5c8c99b-e0ad-4a12-9263-a4868cefd0d9 req-fc7ec09c-b48f-493a-8fbe-da0e21c33ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6988895-e39c-494d-b277-f819ab920d2e", "name": "network-vif-deleted", "tag": "456ea6bf-b197-4c02-a631-fb2403437d4c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:05.254121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.255813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.257462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.258740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.271094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f5c8c99b-e0ad-4a12-9263-a4868cefd0d9 req-fc7ec09c-b48f-493a-8fbe-da0e21c33ac6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.274476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f5c8c99b-e0ad-4a12-9263-a4868cefd0d9 req-fc7ec09c-b48f-493a-8fbe-da0e21c33ac6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.297984 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f5c8c99b-e0ad-4a12-9263-a4868cefd0d9 req-fc7ec09c-b48f-493a-8fbe-da0e21c33ac6 service nova] Creating event network-vif-deleted:456ea6bf-b197-4c02-a631-fb2403437d4c for instance a6988895-e39c-494d-b277-f819ab920d2e on nch2-master-1 Mar 26 20:53:05.305973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f5c8c99b-e0ad-4a12-9263-a4868cefd0d9 req-fc7ec09c-b48f-493a-8fbe-da0e21c33ac6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057368 Mar 26 20:53:05.312892 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 603/1342] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:05.319438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:05.320411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:05.334216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.335024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.336228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.336858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.506814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.515609 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e879cd52-0150-4a10-91d5-784cb4d51b2b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.290137 Mar 26 20:53:05.527206 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 740/1343] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:05 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:05.536368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: .version_select at 0x7f6e5bd9a430>, body: {"removeFloatingIp": {"address": "172.35.4.121"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:05.629879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.646420 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f776cb2-982e-4552-bbbd-23289217f1ce tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.331686 Mar 26 20:53:05.647803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 604/1344] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:05 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:05.668272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:05.669257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:05.678756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.679240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.680368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.680883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.730470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.731089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.732544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lazy-loading 'fault' on Instance uuid a6988895-e39c-494d-b277-f819ab920d2e {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:05.746940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:05.754576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.755420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.756407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.757590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.855729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f730effcbf03473fbdb527fa499ec181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71abac018054ac59df8204f06278c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:05.863361 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67e44136-cbf8-4216-ab5e-d44e76be2e88 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 200 len: 1353 microversion: 2.1 time: 0.202784 Mar 26 20:53:05.873773 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 605/1345] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:05 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 1353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:05.880870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:05.881890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:05.889715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.890606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:05.891624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:05.892345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.162725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:06.169036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Acquired lock "refresh_cache-29c5308d-ab4c-477b-9792-4d069959cf60" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:53:06.175017 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3ad940e8-7c86-4d0d-bd66-597ce5fe97c8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1309 microversion: 2.1 time: 0.299360 Mar 26 20:53:06.179250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 606/1346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:05 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:06.187013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:06.194113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:06.231171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.232455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.234418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.235169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.558293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:06.565997 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25abb503-842d-4a34-a3f4-908884c3c507 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.382766 Mar 26 20:53:06.567309 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 607/1347] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:06 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:06.572527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:06.573882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:06.585456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.586545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.588279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.589336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.771083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:06.779141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:06.780732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:06.781986 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15e913f2-e093-4357-8000-9cea8b1826e5 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 200 len: 1483 microversion: 2.25 time: 0.213739 Mar 26 20:53:06.791958 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 608/1348] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:06 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 1483 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:06.791958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d85d96d2-a8ba-40e9-b6c4-1bab24dedf99 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e591d5dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:06.839653 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d85d96d2-a8ba-40e9-b6c4-1bab24dedf99 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0" status: 200 len: 662 microversion: 2.1 time: 0.055594 Mar 26 20:53:06.840440 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 609/1349] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:06 2022] GET /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:06.845623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:06.846884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:06.861721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.862420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:06.863405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:06.864201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.042442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:07.050962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e6f98fab-ee9b-4b73-85d7-867996c4ca3b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.208926 Mar 26 20:53:07.051710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 610/1350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:06 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:07.056952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.057909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:07.064523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.065092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.065975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.066850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.227514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:07.236527 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73c8c5a9-463b-439b-bb1f-1356899db88e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.183552 Mar 26 20:53:07.237415 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 611/1351] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:07 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:07.242599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8dd2ac03-bc62-4927-9576-af060265593c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59234b80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.295565 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8dd2ac03-bc62-4927-9576-af060265593c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0" status: 200 len: 662 microversion: 2.1 time: 0.056710 Mar 26 20:53:07.302564 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 612/1352] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:07 2022] GET /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:07.308932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.309687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:07.317873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.318445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.319335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.319882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.344745 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. Mar 26 20:53:07.345313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:07.346372 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-258698ec-7a1f-4afa-a364-6393ee2579d1 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 404 len: 111 microversion: 2.1 time: 0.042702 Mar 26 20:53:07.348981 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 613/1353] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:07 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:07.355226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.356016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:07.363998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.364535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.365680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.366132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.600969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Building network info cache for instance {{(pid=141581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:53:07.850257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:07.858661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17084748-260d-40fc-814e-0913c6e00b50 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1309 microversion: 2.1 time: 0.508509 Mar 26 20:53:07.870928 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 614/1354] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:07 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:07.876357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6b94570f-bd3c-43cf-bc09-169c59629646 req-343940ba-cf14-4b2b-9397-996e36d483e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68114f8-3943-44b1-854e-7e316161aa82", "name": "network-vif-deleted", "tag": "f08b295e-9561-4e2a-bfda-0f96cd0ccef5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:07.887260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6b94570f-bd3c-43cf-bc09-169c59629646 req-343940ba-cf14-4b2b-9397-996e36d483e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.888350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6b94570f-bd3c-43cf-bc09-169c59629646 req-343940ba-cf14-4b2b-9397-996e36d483e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.901368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6b94570f-bd3c-43cf-bc09-169c59629646 req-343940ba-cf14-4b2b-9397-996e36d483e1 service nova] Creating event network-vif-deleted:f08b295e-9561-4e2a-bfda-0f96cd0ccef5 for instance b68114f8-3943-44b1-854e-7e316161aa82 on nch1-master-1 Mar 26 20:53:07.908961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6b94570f-bd3c-43cf-bc09-169c59629646 req-343940ba-cf14-4b2b-9397-996e36d483e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036038 Mar 26 20:53:07.911401 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 615/1355] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:07.918861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.919687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:07.927193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.927895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.929009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.929662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.952390 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. Mar 26 20:53:07.953313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:07.954269 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99552bcd-7fd6-4786-ba61-7a0d29dbaed8 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 404 len: 111 microversion: 2.1 time: 0.041269 Mar 26 20:53:07.955043 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 616/1356] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:07 2022] DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:07.960251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:07.961189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:07.972481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.972984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:07.973803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:07.974252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.154461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:08.166559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c90a2d2-d3a0-4cc2-a1b8-aa910157c83d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.209924 Mar 26 20:53:08.167823 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 617/1357] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:07 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:08.173482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.174170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: b68114f8-3943-44b1-854e-7e316161aa82] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:08.181604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.182066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.182861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.183308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.200715 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] HTTP exception thrown: Instance b68114f8-3943-44b1-854e-7e316161aa82 could not be found. Mar 26 20:53:08.201393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Returning 404 to user: Instance b68114f8-3943-44b1-854e-7e316161aa82 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:08.202233 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52bfdf62-4689-4418-b9bb-2d62d8a91b06 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82" status: 404 len: 111 microversion: 2.25 time: 0.033589 Mar 26 20:53:08.202789 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 618/1358] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/servers/b68114f8-3943-44b1-854e-7e316161aa82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:08.213637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.215371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:08.235945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.237037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.238951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.240289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.268771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. Mar 26 20:53:08.269395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:08.270283 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f1d8841-b7da-4a29-b87d-3406611c0050 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 404 len: 111 microversion: 2.1 time: 0.066580 Mar 26 20:53:08.271216 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 619/1359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:08.279621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.280315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:08.291777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.292230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.293675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.294162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.489552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:08.503239 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c62267b9-451c-4c83-bbfb-01f00852aa15 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.229190 Mar 26 20:53:08.503973 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 620/1360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:08.510991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.511417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:08.522143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.527275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.528287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.537327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.802536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:08.811823 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-117e1641-4a67-482d-8847-cb34ab66267f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.306285 Mar 26 20:53:08.812355 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 621/1361] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:08.817431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca7d7b4f-e3d5-4445-a7ed-d208039e59bf tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '.version_select at 0x7f6e5924bf70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.842104 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca7d7b4f-e3d5-4445-a7ed-d208039e59bf tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724354145" status: 202 len: 0 microversion: 2.1 time: 0.028180 Mar 26 20:53:08.858758 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 622/1362] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 20:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724354145 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:08.871063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4754e45d-892f-4a01-a35b-b36f0e224e15 req-c82503da-c5fa-4e72-b34f-ecdd984e1e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a", "name": "network-vif-plugged", "status": "completed", "tag": "67eeccc0-3a32-4de1-95bd-053cea3ae6eb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:08.886578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4754e45d-892f-4a01-a35b-b36f0e224e15 req-c82503da-c5fa-4e72-b34f-ecdd984e1e83 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.889118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4754e45d-892f-4a01-a35b-b36f0e224e15 req-c82503da-c5fa-4e72-b34f-ecdd984e1e83 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.896143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Updating instance_info_cache with network_info: [{"id": "303d5329-41df-4a9b-a437-bbfb5a9e23bd", "address": "fa:16:3e:72:d7:dc", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap303d5329-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:53:08.907579 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4754e45d-892f-4a01-a35b-b36f0e224e15 req-c82503da-c5fa-4e72-b34f-ecdd984e1e83 service nova] Creating event network-vif-plugged:67eeccc0-3a32-4de1-95bd-053cea3ae6eb for instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a on nch2-master-1 Mar 26 20:53:08.916426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4754e45d-892f-4a01-a35b-b36f0e224e15 req-c82503da-c5fa-4e72-b34f-ecdd984e1e83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053296 Mar 26 20:53:08.917824 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 623/1363] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:08.919822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Releasing lock "refresh_cache-29c5308d-ab4c-477b-9792-4d069959cf60" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:53:08.921320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef7d1441-3c5f-4f2b-a7ae-9454f8d4c092 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60/action" status: 202 len: 0 microversion: 2.1 time: 3.392948 Mar 26 20:53:08.922320 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 741/1364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:05 2022] POST /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60/action => generated 0 bytes in 3394 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:53:08.932744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.935716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:08.939069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b47f7e8e-f4c6-4d20-91b0-7c492ca322fd tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5924b550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:08.987122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.989138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:08.995051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:08.996460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.014091 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b47f7e8e-f4c6-4d20-91b0-7c492ca322fd tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843" status: 200 len: 662 microversion: 2.1 time: 0.094362 Mar 26 20:53:09.015373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 624/1365] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:09.035892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:09.038581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:09.053245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.054224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.055740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.057521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.143582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:09.271753 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da5199a3-9ed9-4ea5-8dce-d96f3274fadc tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 204 len: 0 microversion: 2.1 time: 0.254382 Mar 26 20:53:09.281522 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 625/1366] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:09 2022] DELETE /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:09.286463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4f9165a-3266-483c-bf5e-fd1e97d28cbf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5924b280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:09.347116 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4f9165a-3266-483c-bf5e-fd1e97d28cbf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843" status: 200 len: 662 microversion: 2.1 time: 0.066410 Mar 26 20:53:09.347699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 626/1367] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:09 2022] GET /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843 => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:09.364037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:09.364785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:09.374436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.374899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.375704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.383492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.386986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:09.408719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d804e75-b9c9-4f2e-815c-5813866b68a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1309 microversion: 2.1 time: 0.485189 Mar 26 20:53:09.423619 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 742/1368] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:08 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1309 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:09.430852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.121"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:09.432265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:09.446762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.447985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.453056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.453997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.484974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Acquired lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:53:09.735170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:09.746576 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d35b8c1f-639a-4ae4-91d3-8c03222d4db6 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.397788 Mar 26 20:53:09.756476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 627/1369] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:09 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:09.767541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:09.768104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:09.779880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.780373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.781159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:09.781597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:09.828469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:09.959361 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-45d28b41-dce4-4ad6-80a3-071a88c7003c tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 204 len: 0 microversion: 2.25 time: 0.201409 Mar 26 20:53:09.964095 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 628/1370] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:53:09 2022] DELETE /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:53:09.969828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1503192566", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:10.027444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:10.212129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:10.212580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:10.213069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:10.213486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:10.213904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:10.222613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.223062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.223866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.224340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.242313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Getting quotas for project 739cffc409bf4c9b831ae68701acafb1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:10.248158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Getting quotas for user 493cfcb9e1b744aaba45b2a48c7306f4 and project 739cffc409bf4c9b831ae68701acafb1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:10.261080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:10.263488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:10.305763 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08d78339-bf98-4da9-8788-9f21bafd5488 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.340321 Mar 26 20:53:10.306495 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 629/1371] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:10.311068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:10.311687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:10.319103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.320251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.320375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.320735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.469375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:10.477676 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4a4c9b60-3415-4fc2-9127-9d48998f533e tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.170187 Mar 26 20:53:10.478919 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 630/1372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:10 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:10.483733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:10.484377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:10.490459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.490919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.491705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.492184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.649909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:10.662564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15bab7b5-6bc0-4e74-b426-c00b687a7a32 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.182074 Mar 26 20:53:10.663544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 631/1373] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:10 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:10.669700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c5308d-ab4c-477b-9792-4d069959cf60", "tag": "303d5329-41df-4a9b-a437-bbfb5a9e23bd"}, {"server_uuid": "5511f470-27c0-4ddf-822f-d673e8af803c", "name": "network-vif-unplugged", "status": "completed", "tag": "93403676-99cc-45f4-a873-3df0d3991850"}, {"name": "network-changed", "server_uuid": "5511f470-27c0-4ddf-822f-d673e8af803c", "tag": "93403676-99cc-45f4-a873-3df0d3991850"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:10.682255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.683338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.700518 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Creating event network-changed:303d5329-41df-4a9b-a437-bbfb5a9e23bd for instance 29c5308d-ab4c-477b-9792-4d069959cf60 on nch2-master-1 Mar 26 20:53:10.701075 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Creating event network-vif-unplugged:93403676-99cc-45f4-a873-3df0d3991850 for instance 5511f470-27c0-4ddf-822f-d673e8af803c on nch2-master-1 Mar 26 20:53:10.701650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] Creating event network-changed:93403676-99cc-45f4-a873-3df0d3991850 for instance 5511f470-27c0-4ddf-822f-d673e8af803c on nch2-master-1 Mar 26 20:53:10.708834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ebc7debf-a33f-41c1-a4c0-9bb30548f7c8 req-db8ca112-b2ad-4d70-a36f-bcc11133011d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.043786 Mar 26 20:53:10.709894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 632/1374] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:10.715844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:10.717392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:10.724330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.725675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.726970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:10.727765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:10.959842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:10.969621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:10.971135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:10.972584 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7e0a5f5-9e6d-4591-a5b5-df864543a012 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1564 microversion: 2.25 time: 0.261540 Mar 26 20:53:10.973324 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 633/1375] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:10 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1564 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:10.988512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d83ce515-5f84-4e23-9926-49a75f1f6ab7 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:10.989377 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:10.989377 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:11.018366 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d83ce515-5f84-4e23-9926-49a75f1f6ab7 tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1908811229" status: 202 len: 0 microversion: 2.1 time: 0.033593 Mar 26 20:53:11.018977 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 634/1376] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:53:10 2022] DELETE /compute/v2.1/flavors/1908811229 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:11.028284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1486724937", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:11.084352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:11.379651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:11.380129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:11.381277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:11.381858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:11.382635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:11.395143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.395862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:11.397011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.397466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:11.414855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Getting quotas for project 739cffc409bf4c9b831ae68701acafb1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:11.420399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Getting quotas for user 493cfcb9e1b744aaba45b2a48c7306f4 and project 739cffc409bf4c9b831ae68701acafb1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:11.433487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:11.435789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:11.495147 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aad5b071-8c84-4e55-aa0c-55b529d59413 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471842 Mar 26 20:53:11.500368 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 635/1377] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:11.507233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:11.508594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:11.518266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.518824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:11.519598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.520776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:11.828223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:11.845830 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d473db19-3bb9-407d-b91b-e8aacd51f07c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1489 microversion: 2.1 time: 0.337554 Mar 26 20:53:11.846919 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 636/1378] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:11 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1489 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:11.854749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:11.855626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:11.871112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.871674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:11.872619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:11.875380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.505611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:12.514446 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1fe81879-c5d4-4221-a51b-514bf53e5cf1 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.666303 Mar 26 20:53:12.519427 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 637/1379] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:11 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:12.528255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e67998c-6267-4b6a-99af-342ee4b0ddaa tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:12.552553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e67998c-6267-4b6a-99af-342ee4b0ddaa tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.031704 Mar 26 20:53:12.553378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 638/1380] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:12 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:12.561043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:12.562001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:12.572835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.573615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.574484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.575053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.799855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:12.808934 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3be3bfad-7a6b-40b1-8a7a-21380a8509b7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.254311 Mar 26 20:53:12.809526 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 639/1381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:12 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:12.818133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:12.818963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:12.826217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.826685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.827672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.828280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.923573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:12.932587 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e55b504d-c165-45d7-9a11-2c167c168047 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1278 microversion: 2.1 time: 0.121963 Mar 26 20:53:12.945756 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 640/1382] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:12 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:12.952676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:12.954142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:12.964135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.964913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:12.966761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:12.967461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:13.344619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:13.359732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Building network info cache for instance {{(pid=141581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:53:13.369550 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4515176b-f755-49b7-a2e8-cf6051bde3e7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.409706 Mar 26 20:53:13.372392 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 641/1383] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:12 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:13.390128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:13.396104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:13.420051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:13.424816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:13.428233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:13.428934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:13.493444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:13.494354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:13.495008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lazy-loading 'fault' on Instance uuid e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:13.654972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:13.667174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:13.669101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:13.670517 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ba244bb-5ba0-4725-87b9-8c921f68ebaf tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 200 len: 1351 microversion: 2.25 time: 0.296139 Mar 26 20:53:13.691446 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 642/1384] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:13 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 1351 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:13.699047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1292727713", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:13.772835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:14.579809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:14.580867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:14.581807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:14.582589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:14.584815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:14.623345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:14.631608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:14.634369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:14.636240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:14.672550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:14.683808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:14.698633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:14.702894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:14.761906 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed7fccdc-de55-428d-8702-629185e019c7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069253 Mar 26 20:53:14.762558 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 643/1385] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:14.770807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac1446ac-0466-4281-b8e4-5d8e4655189e tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:14.772957 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:14.772957 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:14.808179 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac1446ac-0466-4281-b8e4-5d8e4655189e tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/409083189" status: 202 len: 0 microversion: 2.1 time: 0.043831 Mar 26 20:53:14.808706 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 644/1386] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:53:14 2022] DELETE /compute/v2.1/flavors/409083189 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:14.817652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-72621bdf-6c22-4f1c-b262-8bedd22d32ba req-3a876aa5-0965-4870-95c1-cb30e7e1d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20", "name": "network-vif-deleted", "tag": "d6806923-920b-4eab-b4f5-2134464682ab"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:14.836085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-72621bdf-6c22-4f1c-b262-8bedd22d32ba req-3a876aa5-0965-4870-95c1-cb30e7e1d9f6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:14.840536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-72621bdf-6c22-4f1c-b262-8bedd22d32ba req-3a876aa5-0965-4870-95c1-cb30e7e1d9f6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:14.869605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-72621bdf-6c22-4f1c-b262-8bedd22d32ba req-3a876aa5-0965-4870-95c1-cb30e7e1d9f6 service nova] Creating event network-vif-deleted:d6806923-920b-4eab-b4f5-2134464682ab for instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 on nch1-master-1 Mar 26 20:53:14.880045 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-72621bdf-6c22-4f1c-b262-8bedd22d32ba req-3a876aa5-0965-4870-95c1-cb30e7e1d9f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069416 Mar 26 20:53:14.883318 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 645/1387] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:14.896155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:14.897303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:14.905111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:14.905680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:14.906509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:14.907024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.305591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:15.319640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Updating instance_info_cache with network_info: [{"id": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd", "address": "fa:16:3e:a5:79:ac", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fa41142-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:53:15.335711 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8796044d-c950-4606-873c-2dee0b49b542 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.450523 Mar 26 20:53:15.336805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 646/1388] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:14 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:15.340769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Releasing lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:53:15.342157 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5953e619-f355-4b7f-b3c7-7dcddf472f39 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action" status: 202 len: 0 microversion: 2.1 time: 5.917198 Mar 26 20:53:15.342771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 743/1389] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:09 2022] POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action => generated 0 bytes in 5918 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:53:15.343769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:15.344893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:15.354349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.355206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.356136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:15.356363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.357092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.357468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:15.365029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.366133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.367192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.368999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.721524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:15.731616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-79791d61-5592-42c3-bd22-d240014a25d8 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.393677 Mar 26 20:53:15.744958 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 647/1390] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:15 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:15.756334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:15.757583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:15.777599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.778581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.779686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.780480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.941729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:15.955302 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74d514ab-1ec8-4eb7-844e-1c80967ed7d7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1318 microversion: 2.1 time: 0.610020 Mar 26 20:53:15.956178 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 744/1391] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:15 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:15.961817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:15.962792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:15.972860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.973890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.976693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:15.977622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:15.997937 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] HTTP exception thrown: Instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 could not be found. Mar 26 20:53:15.998699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Returning 404 to user: Instance e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:15.999660 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e02c3466-aed0-4107-8977-3482ddf78153 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20" status: 404 len: 111 microversion: 2.25 time: 0.042222 Mar 26 20:53:16.000811 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 745/1392] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:15 2022] GET /compute/v2.1/servers/e2f54cb0-6c54-4fdf-81a5-1797c6ee3a20 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:16.007834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.008878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:16.020513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.021313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.023040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.024557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.181062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:16.210046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:16.220928 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-999691cc-494d-4b9a-9fed-6948f567194d tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.472901 Mar 26 20:53:16.221810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 648/1393] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:15 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:16.234785 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd774f00-5ec5-4566-a96c-a0c541ba2d01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1261 microversion: 2.1 time: 0.202656 Mar 26 20:53:16.237002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88ab212c-4055-43f8-84be-a0b993a8793a tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.238394 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 746/1394] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:16 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:16.255257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-490355b9-837e-4552-b75c-8c87aac0c0a9 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '.version_select at 0x7f6e594f54c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.284396 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88ab212c-4055-43f8-84be-a0b993a8793a tempest-ServersWithSpecificFlavorTestJSON-810075525 tempest-ServersWithSpecificFlavorTestJSON-810075525-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060189 Mar 26 20:53:16.285025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 649/1395] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:16.307911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b2f94694-7a14-4437-aa81-f3b9f0ea577c req-794ba690-989b-45bc-8011-1fdfd08d6a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d23ce7-becf-4a04-bf7e-36f8c0329a53", "tag": "2b326ee0-26a1-418e-8493-4f045fa716a8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:16.343048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b2f94694-7a14-4437-aa81-f3b9f0ea577c req-794ba690-989b-45bc-8011-1fdfd08d6a04 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.348743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b2f94694-7a14-4437-aa81-f3b9f0ea577c req-794ba690-989b-45bc-8011-1fdfd08d6a04 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.379525 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b2f94694-7a14-4437-aa81-f3b9f0ea577c req-794ba690-989b-45bc-8011-1fdfd08d6a04 service nova] Creating event network-changed:2b326ee0-26a1-418e-8493-4f045fa716a8 for instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 on nch2-master-1 Mar 26 20:53:16.387296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b2f94694-7a14-4437-aa81-f3b9f0ea577c req-794ba690-989b-45bc-8011-1fdfd08d6a04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086123 Mar 26 20:53:16.388315 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 650/1396] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:16.394060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.396570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:16.406078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.407250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.408566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.409327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.454954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:16.593506 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19f1bafb-3d13-4d1c-b8a9-82d8b3d84403 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 204 len: 0 microversion: 2.25 time: 0.203336 Mar 26 20:53:16.594902 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 651/1397] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:53:16 2022] DELETE /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:53:16.602068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.602719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:16.610300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.610837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.611621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.612106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.628323 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. Mar 26 20:53:16.628921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:16.629971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-146f8f65-de58-4a21-9426-97d14680ea1b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 404 len: 111 microversion: 2.1 time: 0.033766 Mar 26 20:53:16.630587 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 652/1398] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:16 2022] DELETE /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:16.635824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.636452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:16.642487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.642940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.643727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.644200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.774004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-490355b9-837e-4552-b75c-8c87aac0c0a9 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/70fe7cc5-68de-404f-9a0a-c111d630399d" status: 200 len: 184 microversion: 2.1 time: 0.532435 Mar 26 20:53:16.781057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 747/1399] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:53:16 2022] GET /compute/v2.1/os-floating-ips/70fe7cc5-68de-404f-9a0a-c111d630399d => generated 184 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:16.786767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:16.787587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:16.796635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.797037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:16.798019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:16.798658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.038261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:17.050177 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e00290f9-94d5-4d4d-bc4b-b68f38ff3d3f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1392 microversion: 2.1 time: 0.418529 Mar 26 20:53:17.051044 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 653/1400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:16 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:17.072696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:17.073544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: a6988895-e39c-494d-b277-f819ab920d2e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:17.080008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.081247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.082517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.083228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.102976 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. Mar 26 20:53:17.103879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance a6988895-e39c-494d-b277-f819ab920d2e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:17.104989 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4694961-33cc-4c27-888a-3d4b8fbc2866 tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e" status: 404 len: 111 microversion: 2.1 time: 0.038190 Mar 26 20:53:17.106012 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 654/1401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:17 2022] GET /compute/v2.1/servers/a6988895-e39c-494d-b277-f819ab920d2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:17.112311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:17.113208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:17.123412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.124138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.125511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.126151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.247306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:17.257032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:17.260006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:17.261699 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84f58efe-2dfe-4b74-8465-d53f2a0f22dc tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1549 microversion: 2.25 time: 0.479207 Mar 26 20:53:17.262525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 748/1402] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:16 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1549 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:17.269788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.121"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:17.525691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:17.532337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.532805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.533609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:17.534056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:17.979258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:17.994590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e31de2f0-aa07-42dc-a52f-d7e8e2eff8f1 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.886714 Mar 26 20:53:18.006436 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 655/1403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:17 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:18.013473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c5308d-ab4c-477b-9792-4d069959cf60", "name": "network-vif-deleted", "tag": "303d5329-41df-4a9b-a437-bbfb5a9e23bd"}, {"name": "network-changed", "server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}, {"name": "network-changed", "server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:18.024809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.026014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.047072 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Creating event network-vif-deleted:303d5329-41df-4a9b-a437-bbfb5a9e23bd for instance 29c5308d-ab4c-477b-9792-4d069959cf60 on nch2-master-1 Mar 26 20:53:18.048514 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Creating event network-changed:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:53:18.049395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] Creating event network-changed:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:53:18.067157 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-57aa4e99-fd3b-43ec-bcb2-c7cf96f5d527 req-3d9c8ef6-2003-4324-b545-b50204702bfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.057672 Mar 26 20:53:18.068280 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 656/1404] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:18.075329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:18.078678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:18.088404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.089404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.090444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.091188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.266061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Acquired lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:53:18.610151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:18.621385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5b7504a-b362-4700-9663-c284b70e30b1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1318 microversion: 2.1 time: 0.551559 Mar 26 20:53:18.622372 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 657/1405] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:18 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:18.637314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:18.637955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:18.644779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.644779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.645664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.646206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.662944 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. Mar 26 20:53:18.663678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:18.665436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8215b6bc-16d2-40ae-8c36-0fa318321b8c tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 404 len: 111 microversion: 2.1 time: 0.031605 Mar 26 20:53:18.666244 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 658/1406] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:18 2022] DELETE /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:18.671566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:18.672551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:18.681759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.682498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:18.683496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:18.684080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:19.256855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:19.278616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d5cfe1f4-d48e-4835-bc8e-c7d58658e52e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.610841 Mar 26 20:53:19.279450 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 659/1407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:18 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:19.294479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:19.295555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:19.301751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:19.302367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:19.303151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:19.303784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:19.390242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Building network info cache for instance {{(pid=141581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:53:19.632044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:19.641109 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ea48e61-953a-43d1-bee0-8e36f249890f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.351264 Mar 26 20:53:19.645138 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 660/1408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:19 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:19.679270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:19.680242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:19.694619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:19.695134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:19.696616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:19.706668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.015694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.031786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46fd7775-a7d1-41f2-bc64-a9bc484ba672 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1382 microversion: 2.1 time: 0.375645 Mar 26 20:53:20.032410 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 661/1409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:19 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1382 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:20.042872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.045163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.054754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.055473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.056553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.057405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.137646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.139878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.141233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lazy-loading 'fault' on Instance uuid e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:20.245170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.258091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.260233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.261439 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a89a496-dd83-47f1-a7bc-a0147dcfa1c2 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 200 len: 1352 microversion: 2.25 time: 0.223564 Mar 26 20:53:20.269403 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 662/1410] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 1352 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:20.274259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.276919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] [instance: b6b31b55-e687-4df8-8057-fdf7bffce5fa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.301150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.301919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.303119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.303740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.329811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] HTTP exception thrown: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. Mar 26 20:53:20.330499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] Returning 404 to user: Instance b6b31b55-e687-4df8-8057-fdf7bffce5fa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:20.331353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ae47be1-74a0-4280-a05c-ad64de43ac7b tempest-ServersWithSpecificFlavorTestJSON-1481277091 tempest-ServersWithSpecificFlavorTestJSON-1481277091-project] 10.222.0.16 "GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa" status: 404 len: 111 microversion: 2.1 time: 0.060948 Mar 26 20:53:20.331973 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 663/1411] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/b6b31b55-e687-4df8-8057-fdf7bffce5fa => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:20.339166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.339793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.368370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.373291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.374809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.376625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.568414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Updating instance_info_cache with network_info: [{"id": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd", "address": "fa:16:3e:a5:79:ac", "network": {"id": "3cefd6de-90d8-4688-a242-74a2eb770644", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1328734632-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d6be1f9d2cf4446c9e936785fc70de17", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fa41142-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:53:20.593192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Releasing lock "refresh_cache-57e63d03-35e2-483a-9c79-1bf148fccfbb" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:53:20.594758 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b909a4c3-2b79-4ddb-bfe9-f6e9f38a4963 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action" status: 202 len: 0 microversion: 2.1 time: 3.330714 Mar 26 20:53:20.596140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 749/1412] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:17 2022] POST /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb/action => generated 0 bytes in 3332 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:53:20.605657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c8af036a-356f-43b3-9332-0f2abf40137a req-a5db9676-f596-4547-8099-c6e8c424e154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84a2e73-0c4f-4855-a4b0-1dfe9af6db24", "name": "network-vif-deleted", "tag": "ae943f51-447b-434d-a20b-ea825ed34c1a"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:20.617877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c8af036a-356f-43b3-9332-0f2abf40137a req-a5db9676-f596-4547-8099-c6e8c424e154 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.618695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c8af036a-356f-43b3-9332-0f2abf40137a req-a5db9676-f596-4547-8099-c6e8c424e154 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.638744 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c8af036a-356f-43b3-9332-0f2abf40137a req-a5db9676-f596-4547-8099-c6e8c424e154 service nova] Creating event network-vif-deleted:ae943f51-447b-434d-a20b-ea825ed34c1a for instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 on nch1-master-1 Mar 26 20:53:20.645068 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c8af036a-356f-43b3-9332-0f2abf40137a req-a5db9676-f596-4547-8099-c6e8c424e154 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046154 Mar 26 20:53:20.645914 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 750/1413] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:20.651476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.652216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.658696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.659367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.660442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.660747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.830846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.839207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:20.841363 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca1b6602-39af-4cde-ac9b-297f868c4db4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.507641 Mar 26 20:53:20.842412 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 664/1414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:20.848172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46eed38b-e095-49af-9684-b04282f56b31 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '.version_select at 0x7f6e5924b310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.861141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46eed38b-e095-49af-9684-b04282f56b31 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.861141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46eed38b-e095-49af-9684-b04282f56b31 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.861308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0512bb85-c327-4be1-8e51-78801f30a043 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1318 microversion: 2.1 time: 0.212535 Mar 26 20:53:20.861308 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 751/1415] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:20.875229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d0c39f3d-6474-48ad-8def-143d55300843 req-91bc35ea-6192-439e-86f2-bab76b578a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:20.879791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46eed38b-e095-49af-9684-b04282f56b31 tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3509 microversion: 2.1 time: 0.036148 Mar 26 20:53:20.881240 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 665/1416] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/os-migrations => generated 3509 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:20.892904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d0c39f3d-6474-48ad-8def-143d55300843 req-91bc35ea-6192-439e-86f2-bab76b578a91 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.893597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d0c39f3d-6474-48ad-8def-143d55300843 req-91bc35ea-6192-439e-86f2-bab76b578a91 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.894767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.895479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.902348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.903151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.904383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.905159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.912266 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d0c39f3d-6474-48ad-8def-143d55300843 req-91bc35ea-6192-439e-86f2-bab76b578a91 service nova] Creating event network-changed:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:53:20.920515 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d0c39f3d-6474-48ad-8def-143d55300843 req-91bc35ea-6192-439e-86f2-bab76b578a91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048091 Mar 26 20:53:20.921776 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 752/1417] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:20.933479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.934120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.941706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.942360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.943290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.943814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.961395 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] HTTP exception thrown: Instance 29c5308d-ab4c-477b-9792-4d069959cf60 could not be found. Mar 26 20:53:20.962567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Returning 404 to user: Instance 29c5308d-ab4c-477b-9792-4d069959cf60 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:20.963861 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9211ece0-652c-4333-955e-be6be68ec7fa tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 404 len: 111 microversion: 2.1 time: 0.040016 Mar 26 20:53:20.964903 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 753/1418] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:20 2022] DELETE /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:20.974057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:20.975031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:20.988115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.988586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:20.989398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:20.989844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.239964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:21.253078 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-379bddad-0cd0-467c-95e5-e90db15dcab7 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.370127 Mar 26 20:53:21.254234 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 666/1419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:21.260342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:21.261035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:21.272675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.273633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.276328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.277951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.684941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:21.697890 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e20080f8-760d-4cd9-8dc5-18eb52cc2cc5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.729945 Mar 26 20:53:21.700188 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 754/1420] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:20 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:21.705815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:21.706885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 29c5308d-ab4c-477b-9792-4d069959cf60] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:21.714828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.715745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.716824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.718075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.738083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] HTTP exception thrown: Instance 29c5308d-ab4c-477b-9792-4d069959cf60 could not be found. Mar 26 20:53:21.739828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Returning 404 to user: Instance 29c5308d-ab4c-477b-9792-4d069959cf60 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:21.740763 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebb25d4b-e066-4e59-8957-597ef262c885 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60" status: 404 len: 111 microversion: 2.1 time: 0.039295 Mar 26 20:53:21.741383 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 755/1421] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:21 2022] GET /compute/v2.1/servers/29c5308d-ab4c-477b-9792-4d069959cf60 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:21.747510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:21.748393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e84a2e73-0c4f-4855-a4b0-1dfe9af6db24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:21.757727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.758339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.759155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.760157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.776327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] HTTP exception thrown: Instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 could not be found. Mar 26 20:53:21.777548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Returning 404 to user: Instance e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:21.777936 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-639f5b90-e480-479d-bca5-f74f8b16aabe tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24" status: 404 len: 111 microversion: 2.25 time: 0.035496 Mar 26 20:53:21.778834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 756/1422] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:21 2022] GET /compute/v2.1/servers/e84a2e73-0c4f-4855-a4b0-1dfe9af6db24 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:21.783746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-456ee9db-bb6b-4783-9941-f67800fa92e7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '.version_select at 0x7f6e594df700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:21.936066 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8743d8a2-d81e-4f87-a825-6509fe415e3f tempest-LiveMigrationTest-1397668550 tempest-LiveMigrationTest-1397668550-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1533 microversion: 2.1 time: 0.678281 Mar 26 20:53:21.936841 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 667/1423] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:21 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1533 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:21.943430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:21.944474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:21.954959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.955838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.957134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:21.957929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:21.992250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:22.153904 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e125f8b-89f9-409f-94c1-b3a4a5904b1e tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 204 len: 0 microversion: 2.25 time: 0.214097 Mar 26 20:53:22.155747 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 668/1424] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:53:21 2022] DELETE /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:53:22.164632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:22.165614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:22.177260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.177927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.179700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.182190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.476070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:22.498089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3a18558-f187-4145-956a-e76c772ce708 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.340759 Mar 26 20:53:22.499018 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 669/1425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:22 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:22.503753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:22.504641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:22.513803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.513803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.513803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.513803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.848906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:22.871748 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-64545302-dd44-4c1b-b603-43a5029c7133 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1318 microversion: 2.1 time: 0.371520 Mar 26 20:53:22.880303 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 670/1426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:22 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:22.894520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:22.895456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:22.906051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.906758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.907752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.908230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.929865 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-456ee9db-bb6b-4783-9941-f67800fa92e7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/70fe7cc5-68de-404f-9a0a-c111d630399d" status: 202 len: 0 microversion: 2.1 time: 1.149789 Mar 26 20:53:22.932064 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 757/1427] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:53:21 2022] DELETE /compute/v2.1/os-floating-ips/70fe7cc5-68de-404f-9a0a-c111d630399d => generated 0 bytes in 1152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:22.937967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:22.938982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:22.952372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.953099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.954061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:22.956650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:22.964067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:23.065754 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-099f32c4-e33e-432c-b05a-4bab7a1bced9 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 204 len: 0 microversion: 2.1 time: 0.183724 Mar 26 20:53:23.068155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 671/1428] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:22 2022] DELETE /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:23.076878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.077597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:23.084600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.085087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.085837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.086275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.319539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.329163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.330814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bcd816c4f3a495cbe7ce636cf0e2f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac9d686cedf4368ae6e500602e64596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.332620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bc78a8c4-63de-42a9-9a81-b77e05dcfe64 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 200 len: 1563 microversion: 2.25 time: 0.399438 Mar 26 20:53:23.345157 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 758/1429] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:22 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 1563 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:23.352374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-967be97e-f8e4-4980-b6ec-60176dae930b req-1413c1be-6d07-4032-a127-08cebe20ab18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d23ce7-becf-4a04-bf7e-36f8c0329a53", "name": "network-vif-plugged", "status": "completed", "tag": "2b326ee0-26a1-418e-8493-4f045fa716a8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:23.352548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.362572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-967be97e-f8e4-4980-b6ec-60176dae930b req-1413c1be-6d07-4032-a127-08cebe20ab18 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.363287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-967be97e-f8e4-4980-b6ec-60176dae930b req-1413c1be-6d07-4032-a127-08cebe20ab18 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.365445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-952df56d-2e0e-4a2e-9793-d1c346003d3c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.295726 Mar 26 20:53:23.378027 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 672/1430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:23 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:23.389758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c291518c-d539-4bf5-81f7-78a7303b695b req-d899bd00-e745-4c5c-8722-80368928e3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdb010a-69af-469c-baa2-e3ef4c4694d8", "tag": "1de64d43-e5c1-4912-bce7-2fb0a645bc07"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:23.395574 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-967be97e-f8e4-4980-b6ec-60176dae930b req-1413c1be-6d07-4032-a127-08cebe20ab18 service nova] Creating event network-vif-plugged:2b326ee0-26a1-418e-8493-4f045fa716a8 for instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 on nch2-master-1 Mar 26 20:53:23.424953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-967be97e-f8e4-4980-b6ec-60176dae930b req-1413c1be-6d07-4032-a127-08cebe20ab18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079202 Mar 26 20:53:23.429411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c291518c-d539-4bf5-81f7-78a7303b695b req-d899bd00-e745-4c5c-8722-80368928e3ee service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.434125 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 759/1431] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:23.434899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c291518c-d539-4bf5-81f7-78a7303b695b req-d899bd00-e745-4c5c-8722-80368928e3ee service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.443211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.444918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:23.452213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.452918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.453766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.454433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.461942 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c291518c-d539-4bf5-81f7-78a7303b695b req-d899bd00-e745-4c5c-8722-80368928e3ee service nova] Creating event network-changed:1de64d43-e5c1-4912-bce7-2fb0a645bc07 for instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 on nch1-master-1 Mar 26 20:53:23.474463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c291518c-d539-4bf5-81f7-78a7303b695b req-d899bd00-e745-4c5c-8722-80368928e3ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094322 Mar 26 20:53:23.475726 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 673/1432] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:23.485667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.496084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:23.503768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.504602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.505603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.506207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.549020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:23.682226 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12df7752-b188-4718-a9d1-eba16ced68a1 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 204 len: 0 microversion: 2.1 time: 0.204513 Mar 26 20:53:23.683559 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 674/1433] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:23 2022] DELETE /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:23.692636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.693714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:23.704047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.704778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.706055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.706665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.810498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.827159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-170ad759-c414-4276-97e4-01a475e08b58 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.389651 Mar 26 20:53:23.827991 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 760/1434] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:23 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:23.837331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d73a47a0-6acc-45d8-a7f2-6d17fd1147da req-950f8c7e-bd71-4f81-b460-f8996cf00366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d38e4f-c583-4136-8c24-99e1f3d95bf7", "name": "network-vif-deleted", "tag": "20d1d1b1-7ff8-4820-b9ce-973be1edd28e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:23.850017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d73a47a0-6acc-45d8-a7f2-6d17fd1147da req-950f8c7e-bd71-4f81-b460-f8996cf00366 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.859613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d73a47a0-6acc-45d8-a7f2-6d17fd1147da req-950f8c7e-bd71-4f81-b460-f8996cf00366 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.880139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d73a47a0-6acc-45d8-a7f2-6d17fd1147da req-950f8c7e-bd71-4f81-b460-f8996cf00366 service nova] Creating event network-vif-deleted:20d1d1b1-7ff8-4820-b9ce-973be1edd28e for instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 on nch1-master-1 Mar 26 20:53:23.886452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d73a47a0-6acc-45d8-a7f2-6d17fd1147da req-950f8c7e-bd71-4f81-b460-f8996cf00366 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055630 Mar 26 20:53:23.888187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 761/1435] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:23.894599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.895863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:23.903314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.904163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.905189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:23.906020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:23.961379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:23.971142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3efffa8-f08b-4c5c-9d9b-038f317e8368 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1388 microversion: 2.1 time: 0.284633 Mar 26 20:53:23.982243 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 675/1436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:23 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1388 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:23.989376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:23.990096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:24.001542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.002531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.003553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.004671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.321818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:24.330789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10120311-2cf2-4edf-bb51-7b655a36c0ed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.441104 Mar 26 20:53:24.342007 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 762/1437] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:23 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:24.347213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:24.348192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:24.363585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.364381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.365399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.366060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.427702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:24.438797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41107379-4b54-4414-9f57-49cf3f8d8765 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1526 microversion: 2.1 time: 0.454392 Mar 26 20:53:24.440302 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 676/1438] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:23 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:24.448586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:24.449575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] [instance: e5d38e4f-c583-4136-8c24-99e1f3d95bf7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:24.460808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.461658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.464935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.468797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.487889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] HTTP exception thrown: Instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 could not be found. Mar 26 20:53:24.488575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] Returning 404 to user: Instance e5d38e4f-c583-4136-8c24-99e1f3d95bf7 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:24.489278 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90687f87-5bcb-4945-a1d1-b5d7ef8ed258 tempest-LiveAutoBlockMigrationV225Test-521486661 tempest-LiveAutoBlockMigrationV225Test-521486661-project] 10.222.0.16 "GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7" status: 404 len: 111 microversion: 2.25 time: 0.047732 Mar 26 20:53:24.493386 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 677/1439] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:53:24 2022] GET /compute/v2.1/servers/e5d38e4f-c583-4136-8c24-99e1f3d95bf7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:24.498123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:24.498744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:24.504908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.505790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.506155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.506605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.637328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:24.695035 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f84eeff5-2c2f-4bed-bf88-2b66fb6b77cb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1318 microversion: 2.1 time: 0.351197 Mar 26 20:53:24.697880 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 763/1440] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:24 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:24.844636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:24.846802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:24.855587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.856523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:24.857500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:24.858244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.163706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:25.178427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b48b84f3-6960-46b2-8274-f37cb0d4cbad tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.337858 Mar 26 20:53:25.197877 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 764/1441] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:24 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:25.222899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:25.228862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:25.244733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.245467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.246578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.247451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.260136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:25.277997 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0bed0961-6404-447a-99c2-cbc5ed8d955e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.782744 Mar 26 20:53:25.278797 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 678/1442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:24 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:25.348190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:25.348915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:25.356772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.357235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.358025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.359909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.411154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:25.425967 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b1b26c2-682a-41cc-92ab-40538f2298b0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 200 len: 1346 microversion: 2.1 time: 0.226399 Mar 26 20:53:25.426564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 765/1443] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:25 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 1346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:25.460734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:25.461634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:25.473008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.474961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.476312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.477147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.778303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:25.781447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:25.792778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43971628-afff-4d15-aca8-2103f09bb3dd tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1526 microversion: 2.1 time: 0.337844 Mar 26 20:53:25.793520 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 766/1444] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:25 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:25.801256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4fafab89-013b-45ed-94a6-e0e46321f8e7 req-f1d2db00-3327-4f31-992b-498c6ac9afd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-plugged", "status": "completed", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:25.804722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1afe6bb8-99e6-4b67-86e5-8af7d3bd8cb4 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.449486 Mar 26 20:53:25.805701 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 679/1445] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:25 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:25.813212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9a552281-bae8-49bf-bfe1-b1d9c1860fed req-358d2f69-39c8-4300-ad4f-bdc19be1c482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5511f470-27c0-4ddf-822f-d673e8af803c", "name": "network-vif-deleted", "tag": "93403676-99cc-45f4-a873-3df0d3991850"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:25.822085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4fafab89-013b-45ed-94a6-e0e46321f8e7 req-f1d2db00-3327-4f31-992b-498c6ac9afd7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.822455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4fafab89-013b-45ed-94a6-e0e46321f8e7 req-f1d2db00-3327-4f31-992b-498c6ac9afd7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.831449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a552281-bae8-49bf-bfe1-b1d9c1860fed req-358d2f69-39c8-4300-ad4f-bdc19be1c482 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.832211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a552281-bae8-49bf-bfe1-b1d9c1860fed req-358d2f69-39c8-4300-ad4f-bdc19be1c482 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.850683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9a552281-bae8-49bf-bfe1-b1d9c1860fed req-358d2f69-39c8-4300-ad4f-bdc19be1c482 service nova] Creating event network-vif-deleted:93403676-99cc-45f4-a873-3df0d3991850 for instance 5511f470-27c0-4ddf-822f-d673e8af803c on nch1-master-1 Mar 26 20:53:25.860700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9a552281-bae8-49bf-bfe1-b1d9c1860fed req-358d2f69-39c8-4300-ad4f-bdc19be1c482 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050802 Mar 26 20:53:25.861895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 680/1446] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:25.863025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4fafab89-013b-45ed-94a6-e0e46321f8e7 req-f1d2db00-3327-4f31-992b-498c6ac9afd7 service nova] Creating event network-vif-plugged:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:53:25.873533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:25.873675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4fafab89-013b-45ed-94a6-e0e46321f8e7 req-f1d2db00-3327-4f31-992b-498c6ac9afd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078979 Mar 26 20:53:25.874694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:25.877712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 767/1447] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:25.897196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.898788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:25.913317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:25.914348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.203816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:26.209977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:26.223528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.224119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.225021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.225355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.395176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:26.407911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb461a16-948a-4b48-bf96-82c6fc4d607c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1468 microversion: 2.1 time: 0.543745 Mar 26 20:53:26.409177 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 681/1448] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:25 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:26.428555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:26.429285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:26.440158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.440628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.450903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.451545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.724927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:26.742261 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-561e6aa2-8d8c-42c2-bb98-56964ffc2eae tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.547072 Mar 26 20:53:26.753335 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 768/1449] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:26 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:26.763995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:26.764829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:26.766048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:26.773583 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1dff9fc7-8a0b-4d85-892a-b5050b716563 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.361339 Mar 26 20:53:26.774180 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 682/1450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:26 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:26.777309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.779994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.781055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.781764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:26.782390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 5511f470-27c0-4ddf-822f-d673e8af803c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:26.783845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.807294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.807755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.808600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.809051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.833079 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] HTTP exception thrown: Instance 5511f470-27c0-4ddf-822f-d673e8af803c could not be found. Mar 26 20:53:26.833704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Returning 404 to user: Instance 5511f470-27c0-4ddf-822f-d673e8af803c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:26.834552 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b64f5ab6-07e7-4cdf-b2b7-c73ddef1bdfa tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c" status: 404 len: 111 microversion: 2.1 time: 0.059458 Mar 26 20:53:26.840252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 683/1451] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:26 2022] GET /compute/v2.1/servers/5511f470-27c0-4ddf-822f-d673e8af803c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:26.854872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a6cf24fd-ee4a-4fe7-ae87-983daaf2e872 req-aef442b9-5e1c-4e26-9ac4-b0366605e4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e63d03-35e2-483a-9c79-1bf148fccfbb", "name": "network-vif-deleted", "tag": "6fa41142-bff0-4477-bc27-c57a3d2eb5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:26.891089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a6cf24fd-ee4a-4fe7-ae87-983daaf2e872 req-aef442b9-5e1c-4e26-9ac4-b0366605e4f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.891558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a6cf24fd-ee4a-4fe7-ae87-983daaf2e872 req-aef442b9-5e1c-4e26-9ac4-b0366605e4f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.907086 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a6cf24fd-ee4a-4fe7-ae87-983daaf2e872 req-aef442b9-5e1c-4e26-9ac4-b0366605e4f9 service nova] Creating event network-vif-deleted:6fa41142-bff0-4477-bc27-c57a3d2eb5fd for instance 57e63d03-35e2-483a-9c79-1bf148fccfbb on nch1-master-1 Mar 26 20:53:26.926260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a6cf24fd-ee4a-4fe7-ae87-983daaf2e872 req-aef442b9-5e1c-4e26-9ac4-b0366605e4f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082120 Mar 26 20:53:26.927185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 684/1452] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:26.933072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:26.933790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:26.941393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.942282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:26.943155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:26.943698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.027201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:27.036857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b5dfa105-fd03-47fc-8ad7-764580977b6c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1318 microversion: 2.1 time: 0.282016 Mar 26 20:53:27.038256 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 769/1453] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:26 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:27.041276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.041927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.042560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lazy-loading 'fault' on Instance uuid 57e63d03-35e2-483a-9c79-1bf148fccfbb {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:27.058405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:27.058997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:27.074553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.075845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.076910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.078883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.136820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d8624aaea84e50bdb942487d921f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6be1f9d2cf4446c9e936785fc70de17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:27.144788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44823996-6abe-46bb-a9c3-290404a22e5d tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 200 len: 1314 microversion: 2.1 time: 0.216378 Mar 26 20:53:27.148820 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 685/1454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:26 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:27.303239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:27.314363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99c6e490-5cdb-4dfe-ba20-b4b3e2e5e1d7 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.270787 Mar 26 20:53:27.325464 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 770/1455] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:27 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:27.760819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:27.761497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:27.768750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.769592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.770508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.771078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.792136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:27.792816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:27.811773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.813672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.817311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:27.818339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:27.977586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:28.008138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df155652-e0e7-4b78-991b-1b1f451f96bd tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.250965 Mar 26 20:53:28.018482 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 686/1456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:27 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:28.024642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c65a178c-061b-49ae-a31b-efd1990ba4a7 req-6aac14a4-5901-482d-8a7a-8b07ddc2ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdb010a-69af-469c-baa2-e3ef4c4694d8", "name": "network-vif-plugged", "status": "completed", "tag": "1de64d43-e5c1-4912-bce7-2fb0a645bc07"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:28.048221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c65a178c-061b-49ae-a31b-efd1990ba4a7 req-6aac14a4-5901-482d-8a7a-8b07ddc2ad1c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.049428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c65a178c-061b-49ae-a31b-efd1990ba4a7 req-6aac14a4-5901-482d-8a7a-8b07ddc2ad1c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.070525 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c65a178c-061b-49ae-a31b-efd1990ba4a7 req-6aac14a4-5901-482d-8a7a-8b07ddc2ad1c service nova] Creating event network-vif-plugged:1de64d43-e5c1-4912-bce7-2fb0a645bc07 for instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 on nch1-master-1 Mar 26 20:53:28.077205 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c65a178c-061b-49ae-a31b-efd1990ba4a7 req-6aac14a4-5901-482d-8a7a-8b07ddc2ad1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057464 Mar 26 20:53:28.078978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 687/1457] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:28.085902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:28.086847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:28.094555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.095391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.096634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.097550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.161971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:28.171385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90bc62f7-a1d6-4a77-ba4a-8952fbb9fc5c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.383997 Mar 26 20:53:28.174736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 771/1458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:27 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:28.182300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:28.183350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] [instance: 57e63d03-35e2-483a-9c79-1bf148fccfbb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:28.202552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.206981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.210713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.211200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.234887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] HTTP exception thrown: Instance 57e63d03-35e2-483a-9c79-1bf148fccfbb could not be found. Mar 26 20:53:28.235753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] Returning 404 to user: Instance 57e63d03-35e2-483a-9c79-1bf148fccfbb could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:28.236795 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d4a934c-3bf9-4d82-b941-ea7ab35cebb7 tempest-FloatingIPsAssociationTestJSON-1066627911 tempest-FloatingIPsAssociationTestJSON-1066627911-project] 10.222.0.16 "GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb" status: 404 len: 111 microversion: 2.1 time: 0.060158 Mar 26 20:53:28.238107 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 772/1459] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:28 2022] GET /compute/v2.1/servers/57e63d03-35e2-483a-9c79-1bf148fccfbb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:28.299017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:28.308622 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b13914ca-c8e3-4748-9580-51d8614b7e78 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1468 microversion: 2.1 time: 0.228200 Mar 26 20:53:28.309662 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 688/1460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:28 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:28.325327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-565144137"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:28.326420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:28.334856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:28.335222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.335684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.336457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:28.336619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.336915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.347443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.348039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.349003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:28.350093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:28.525898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:28.544249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-62a3f310-921f-4533-948f-17d01d14f92c tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1474 microversion: 2.1 time: 0.215785 Mar 26 20:53:28.548611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 689/1461] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:28 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1474 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:28.695379 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33ddf168-ccba-4827-bc94-d034a56db632 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "POST /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de/action" status: 202 len: 0 microversion: 2.1 time: 0.374145 Mar 26 20:53:28.696385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 773/1462] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:28 2022] POST /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:53:28.708253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4d744e7-86b2-4171-9b47-9095790235a5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e593975e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:28.784336 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4d744e7-86b2-4171-9b47-9095790235a5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.082215 Mar 26 20:53:28.788286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 690/1463] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:28 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:29.036237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.037646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:29.044726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.045415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.046442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.046832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.193258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.193893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:29.208872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.209339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.210778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.211728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.388030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:29.396414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5006523d-f2ed-41d2-8966-8e022de638b8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.207684 Mar 26 20:53:29.406133 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 691/1464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:29 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:29.411082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.411590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:29.417984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.418900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.420009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.420741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.450559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:29.450698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:29.462661 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6902ca5e-67aa-4160-afe0-803bb7a9e870 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1309 microversion: 2.1 time: 0.431584 Mar 26 20:53:29.464057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 774/1465] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:29 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:29.543547 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4efbed7-9b3d-46b5-aa67-f41e26f029ee tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 204 len: 0 microversion: 2.1 time: 0.135637 Mar 26 20:53:29.545297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 692/1466] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:29 2022] DELETE /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:29.553742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.555382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:29.563518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.564549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:29.564750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.565458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.566370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.567139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.571871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.572639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.573329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:29.573778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:29.742428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:29.750921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6fada43-786e-4490-8699-f80c1d342863 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1473 microversion: 2.1 time: 0.191493 Mar 26 20:53:29.751762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 693/1467] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:29 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:29.798470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ab54426-d708-4d11-8124-f7ed05dc4be7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5943e160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:29.855008 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ab54426-d708-4d11-8124-f7ed05dc4be7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.061397 Mar 26 20:53:29.855606 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 694/1468] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:29 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:30.149564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:30.159065 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e8e6e60-2859-4c2c-92e9-330258d1b216 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1501 microversion: 2.1 time: 0.609219 Mar 26 20:53:30.160022 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 775/1469] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:29 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1501 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:30.401526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4bd1733-d7b4-4633-9455-b033429a422e tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] Calling method '.version_select at 0x7f6e59397b80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:30.402440 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:30.402440 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:30.413961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4bd1733-d7b4-4633-9455-b033429a422e tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.143709 Mar 26 20:53:30.414879 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 695/1470] 10.222.0.16 () {60 vars in 1225 bytes} [Sat Mar 26 20:53:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:53:30.422121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:30.423397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:30.429909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.435119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7828e055-ff2b-4d30-a824-e337f701ec74 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59234d30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:30.435771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.436981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.437495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.440771 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:30.440771 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:30.574642 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7828e055-ff2b-4d30-a824-e337f701ec74 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.147917 Mar 26 20:53:30.581057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 696/1471] 10.222.0.16 () {62 vars in 1246 bytes} [Sat Mar 26 20:53:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:53:30.584016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:30.584708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:30.590746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.591271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.592174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.592703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.822686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:30.830983 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8bb84412-bf69-40db-9212-7a7ba5caeee5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1490 microversion: 2.1 time: 0.253515 Mar 26 20:53:30.831837 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 697/1472] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:30 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1490 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:30.836838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3aa48ed-d9f5-44ed-afc2-3861c9b8f4e0 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] Calling method '.version_select at 0x7f6e59234dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:30.838229 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:30.838229 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:30.848734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3aa48ed-d9f5-44ed-afc2-3861c9b8f4e0 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015726 Mar 26 20:53:30.849391 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 698/1473] 10.222.0.16 () {60 vars in 1225 bytes} [Sat Mar 26 20:53:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:53:30.855207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8f76a7ae-3993-4628-b20b-28583a46113b req-1985f47b-7fc3-4ff9-ab55-dfb91d607d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e17aad-e4e4-48db-a406-de8c22855a57", "name": "network-vif-deleted", "tag": "c7df1940-2f47-4d41-b48f-8078b14b9cc2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:30.865588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f76a7ae-3993-4628-b20b-28583a46113b req-1985f47b-7fc3-4ff9-ab55-dfb91d607d8b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.866037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f76a7ae-3993-4628-b20b-28583a46113b req-1985f47b-7fc3-4ff9-ab55-dfb91d607d8b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.883734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8f76a7ae-3993-4628-b20b-28583a46113b req-1985f47b-7fc3-4ff9-ab55-dfb91d607d8b service nova] Creating event network-vif-deleted:c7df1940-2f47-4d41-b48f-8078b14b9cc2 for instance d2e17aad-e4e4-48db-a406-de8c22855a57 on nch1-master-1 Mar 26 20:53:30.889445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8f76a7ae-3993-4628-b20b-28583a46113b req-1985f47b-7fc3-4ff9-ab55-dfb91d607d8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038500 Mar 26 20:53:30.890441 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 699/1474] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:30.898106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:30.898838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:30.908561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.909144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:30.910208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:30.911377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.000381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:31.014240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-668aa327-0a43-4b98-bb4b-47b11cab11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.603704 Mar 26 20:53:31.014839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 776/1475] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:30 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.020797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:31.021736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:31.032753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.033226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.034117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.034570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.070044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:31.078091 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24325f3c-6f18-4589-89d0-58ebc58aacaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1473 microversion: 2.1 time: 0.185325 Mar 26 20:53:31.078668 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 700/1476] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:30 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.087457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88758449-0cb2-46d8-bd7f-ca1b416a8063 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5943ec10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:31.087457 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:31.087457 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:31.150694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88758449-0cb2-46d8-bd7f-ca1b416a8063 tempest-QuotaClassesAdmin257Test-1468537208 tempest-QuotaClassesAdmin257Test-1468537208-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.068163 Mar 26 20:53:31.151473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 701/1477] 10.222.0.16 () {62 vars in 1246 bytes} [Sat Mar 26 20:53:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:53:31.163581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24533e61-a305-463c-8fe4-938ce91030a1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5943eee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:31.214166 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24533e61-a305-463c-8fe4-938ce91030a1 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.061386 Mar 26 20:53:31.214941 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 702/1478] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:31 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.225270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-unplugged", "status": "completed", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:31.234060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.234515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.251965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] Creating event network-vif-unplugged:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch1-master-1 Mar 26 20:53:31.258072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:53:31.276544 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3dcac77b-bffc-49f0-a7b3-c4cc1be287f5 req-0228ee77-ba77-44ec-a340-61d9f80f1812 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059080 Mar 26 20:53:31.278693 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 703/1479] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:31.285077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:31.285784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:31.294858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.295538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.296866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.297743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.374065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.374532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.375610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lazy-loading 'fault' on Instance uuid d2e17aad-e4e4-48db-a406-de8c22855a57 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:31.468942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:31.478591 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ca6a8c3-d104-4fed-9f6f-114bb7c63f76 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 200 len: 1301 microversion: 2.1 time: 0.198464 Mar 26 20:53:31.483058 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 704/1480] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:31 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 1301 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.636212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:31.650705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-124e05f4-6b6c-478f-9bfd-059fdcf3cebb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1489 microversion: 2.1 time: 0.634492 Mar 26 20:53:31.651723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 777/1481] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:31 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1489 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.668630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:31.669398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:31.677281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.677743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.678541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.678989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.907418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:31.923326 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2366ee83-31a7-4c40-858d-0c098d1f659b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1490 microversion: 2.1 time: 0.258806 Mar 26 20:53:31.924856 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 705/1482] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:31 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1490 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:31.944410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:31.945112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:31.963787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.964316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:31.965151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:31.965596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.008108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:32.030927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.031621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:32.040314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.044117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.045000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.045469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.174673 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39757a86-fef5-432c-a2a3-5e2a3520960e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 204 len: 0 microversion: 2.1 time: 0.234325 Mar 26 20:53:32.180006 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 778/1483] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:31 2022] DELETE /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:32.194628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.196140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:32.212069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.212742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.214620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.216227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.438756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:32.448513 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0b0fb351-7572-48f4-ab63-466f52dc5eca tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 0.420497 Mar 26 20:53:32.458276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 706/1484] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:32 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:32.458276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.459961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:32.467111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.468116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.469380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.470172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.697676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:32.711614 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6c18aa75-b338-4ab2-9c11-414a4f4a6b78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1496 microversion: 2.1 time: 0.260025 Mar 26 20:53:32.715417 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 707/1485] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:32 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1496 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:32.724427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b1cbe984-5d0e-451d-9d2f-9b106e8ac25d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e593f4ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.788697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b1cbe984-5d0e-451d-9d2f-9b106e8ac25d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.071408 Mar 26 20:53:32.789290 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 708/1486] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:32 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:32.798979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.803079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: d2e17aad-e4e4-48db-a406-de8c22855a57] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:32.824591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.825065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.830036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.831056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.858014 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] HTTP exception thrown: Instance d2e17aad-e4e4-48db-a406-de8c22855a57 could not be found. Mar 26 20:53:32.859587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Returning 404 to user: Instance d2e17aad-e4e4-48db-a406-de8c22855a57 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:32.860736 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-168a53f8-1ac1-471e-805f-6fce6a4a0c97 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57" status: 404 len: 111 microversion: 2.1 time: 0.070354 Mar 26 20:53:32.861906 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 709/1487] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:32 2022] GET /compute/v2.1/servers/d2e17aad-e4e4-48db-a406-de8c22855a57 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:32.872874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:32.873758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:32.881538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.882267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.883349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:32.884365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:32.928181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:33.085415 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1422eec8-bfdd-4030-b4d1-343499d1e8f0 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 204 len: 0 microversion: 2.1 time: 0.218719 Mar 26 20:53:33.086285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 710/1488] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:32 2022] DELETE /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:53:33.101822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:33.102885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:33.112510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.113350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.114383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.115336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.201459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:33.213558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ba0456e-576a-43c1-9a95-a2bc84b8636f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1473 microversion: 2.1 time: 1.029255 Mar 26 20:53:33.216620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 779/1489] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:32 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1473 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:33.334829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:33.356122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.361318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.370950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:33.382056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef391c91-23f7-41f5-8a33-8a84c2dd9e42 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1485 microversion: 2.1 time: 0.290162 Mar 26 20:53:33.382651 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 711/1490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:33 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1485 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:33.399949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] Creating event network-changed:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch1-master-1 Mar 26 20:53:33.408250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:53:33.432900 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b983f7fa-1199-45c0-8224-d4e0a9ba32e8 req-b03b99f5-88bb-410d-8820-07940f7f659b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106896 Mar 26 20:53:33.434065 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 780/1491] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:33.467701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:33.468354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:33.477799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.480861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.481690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.487907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.733683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:33.734331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:33.756874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.757643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:33.758648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:33.760203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:34.599518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:34.612696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1ded4ac2-2921-4fd8-a753-a8e332275950 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1515 microversion: 2.1 time: 1.149957 Mar 26 20:53:34.623633 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 712/1492] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:33 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1515 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:34.642300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-973d7a14-647f-4d31-9cb2-74562da99204 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e593a1c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:34.723101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-973d7a14-647f-4d31-9cb2-74562da99204 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.106939 Mar 26 20:53:34.723847 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 713/1493] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:34 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:34.737058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:34.737696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:34.773838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:34.774653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:34.776291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:34.776990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:34.962461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:34.975731 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2da3edd-93ee-4a30-915c-c28300657ced tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1496 microversion: 2.1 time: 1.247551 Mar 26 20:53:34.985060 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 781/1494] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:33 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1496 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:35.003486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:35.007382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:35.035579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:35.044480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:35.045704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:35.052587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:35.403771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:35.411289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca611bda-e7d4-42d6-bf30-0d540874c603 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1473 microversion: 2.1 time: 0.686554 Mar 26 20:53:35.424839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 714/1495] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:34 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:35.588186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:35.596666 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9bee6267-176b-42ce-ba09-2f733f55561d tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 200 len: 1443 microversion: 2.1 time: 0.609488 Mar 26 20:53:35.604357 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 782/1496] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:34 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 1443 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:35.630859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:35.631478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:35.641790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:35.642584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:35.647449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:35.648174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:35.737436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-534bbf1e-65b1-46e1-a8f4-e67536865709 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59441940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:35.849455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-534bbf1e-65b1-46e1-a8f4-e67536865709 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.116264 Mar 26 20:53:35.850264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 783/1497] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:35 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:35.916911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d9297a64-e539-4065-a655-b572160b1581 req-df8bc071-9f2f-496c-81d4-effcea4f2748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff44aab-d15a-47cd-a2d7-217166bc5e87", "name": "network-vif-deleted", "tag": "3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:35.936104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d9297a64-e539-4065-a655-b572160b1581 req-df8bc071-9f2f-496c-81d4-effcea4f2748 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:35.936624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d9297a64-e539-4065-a655-b572160b1581 req-df8bc071-9f2f-496c-81d4-effcea4f2748 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:35.970472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d9297a64-e539-4065-a655-b572160b1581 req-df8bc071-9f2f-496c-81d4-effcea4f2748 service nova] Creating event network-vif-deleted:3a424d5c-848e-4f7a-ae8b-4bdcbb58ad54 for instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 on nch2-master-1 Mar 26 20:53:35.984425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d9297a64-e539-4065-a655-b572160b1581 req-df8bc071-9f2f-496c-81d4-effcea4f2748 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071978 Mar 26 20:53:35.999785 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 784/1498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:36.006674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:36.007697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:36.030995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:36.040759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:36.051471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:36.053648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:36.765221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:36.773340 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa497581-b539-43cd-ad18-ff829a166451 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1496 microversion: 2.1 time: 0.772003 Mar 26 20:53:36.778894 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 785/1499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:36 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1496 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:36.785353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a6892ef1-d0f7-4a3c-9195-31fc1129b45d req-355af330-e576-4b69-a4a3-8de8fb770434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-plugged", "status": "completed", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:36.810585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a6892ef1-d0f7-4a3c-9195-31fc1129b45d req-355af330-e576-4b69-a4a3-8de8fb770434 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:36.811334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a6892ef1-d0f7-4a3c-9195-31fc1129b45d req-355af330-e576-4b69-a4a3-8de8fb770434 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:36.841740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a6892ef1-d0f7-4a3c-9195-31fc1129b45d req-355af330-e576-4b69-a4a3-8de8fb770434 service nova] Creating event network-vif-plugged:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:53:36.847254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a6892ef1-d0f7-4a3c-9195-31fc1129b45d req-355af330-e576-4b69-a4a3-8de8fb770434 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066724 Mar 26 20:53:36.848685 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 786/1500] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:37.010931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:37.027569 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-202bbc9b-b5db-415e-bcff-2ad8090f49d4 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1521 microversion: 2.1 time: 1.396430 Mar 26 20:53:37.031070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 715/1501] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:35 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1521 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:37.082678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.084515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:37.107298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.107667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.111776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.115118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.126439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Action: 'update', calling method: .version_select at 0x7f6e594ea8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:37.128008 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:37.128008 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:37.129465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.129923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.159970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.161191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.189977 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] HTTP exception thrown: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. Mar 26 20:53:37.193609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Returning 404 to user: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:37.199979 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b6db45ab-fa50-4258-8e3d-dee8702dfb5d tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000" status: 404 len: 110 microversion: 2.53 time: 0.348543 Mar 26 20:53:37.208685 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 787/1502] 10.222.0.16 () {62 vars in 1308 bytes} [Sat Mar 26 20:53:36 2022] PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000 => generated 110 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:37.226077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.232131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 3ff44aab-d15a-47cd-a2d7-217166bc5e87] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:37.247242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.248195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.249518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.250334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.278470 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] HTTP exception thrown: Instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 could not be found. Mar 26 20:53:37.279335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Returning 404 to user: Instance 3ff44aab-d15a-47cd-a2d7-217166bc5e87 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:37.280549 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1bb97c1-71f0-4892-babb-7e2f89d3578f tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87" status: 404 len: 111 microversion: 2.1 time: 0.070401 Mar 26 20:53:37.281309 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 788/1503] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/servers/3ff44aab-d15a-47cd-a2d7-217166bc5e87 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:37.302639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19d0a1a9-9ab7-4a4b-883c-add3085c81e0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e595f40d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.387897 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19d0a1a9-9ab7-4a4b-883c-add3085c81e0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.102460 Mar 26 20:53:37.388506 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 789/1504] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:37.400285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Action: 'update', calling method: .version_select at 0x7f6e59db5310>, body: {"status": "disabled"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:37.401918 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:37.401918 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:37.405364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.406092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.417689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.421705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.434160 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] HTTP exception thrown: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. Mar 26 20:53:37.435018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Returning 404 to user: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:37.436487 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36a66329-46ff-4e90-8a6a-44ee08741839 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000" status: 404 len: 110 microversion: 2.53 time: 0.046701 Mar 26 20:53:37.437286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 790/1505] 10.222.0.16 () {62 vars in 1308 bytes} [Sat Mar 26 20:53:37 2022] PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:37.448992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.450654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:37.459800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.462268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.463418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.464191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.503620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:37.635374 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7837ff57-09bb-411c-9beb-669387887087 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 204 len: 0 microversion: 2.1 time: 0.195941 Mar 26 20:53:37.636232 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 791/1506] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:37 2022] DELETE /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:37.644971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Action: 'update', calling method: .version_select at 0x7f6e595f4700>, body: {"status": "enabled"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:37.650827 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:37.650827 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:37.658469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.659064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.670145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.672149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.684968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] HTTP exception thrown: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. Mar 26 20:53:37.686037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Returning 404 to user: Service aa322674-b38a-4427-94e7-eaef14cf4000 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:37.687985 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15bc92a4-cbb4-4c10-aa11-e7a6b164f0c6 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000" status: 404 len: 110 microversion: 2.53 time: 0.049645 Mar 26 20:53:37.695213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 792/1507] 10.222.0.16 () {62 vars in 1308 bytes} [Sat Mar 26 20:53:37 2022] PUT /compute/v2.1/os-services/aa322674-b38a-4427-94e7-eaef14cf4000 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:37.701088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.702156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:37.711057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.711963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.717638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.719032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.788258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:37.798994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8653b07-2d1d-4b05-9b60-d14265fefa11 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1471 microversion: 2.1 time: 0.765664 Mar 26 20:53:37.800739 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 716/1508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1471 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:37.812534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.816778 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:37.816778 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:53:37.818865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.822063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.824544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.825883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.890025 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8657159-8fcb-4032-bff0-755b404f828b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.086765 Mar 26 20:53:37.891203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 717/1509] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:37.901481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:37.902382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:37.917136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.919231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.921693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.923363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.996668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:37.997383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:37.998016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lazy-loading 'fault' on Instance uuid dbdb010a-69af-469c-baa2-e3ef4c4694d8 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:53:38.038309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:38.048042 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b725352-cc08-4f25-8d7c-1580ff470d96 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1500 microversion: 2.1 time: 0.351409 Mar 26 20:53:38.049145 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 793/1510] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1500 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.056142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-bd0f3633-9a72-4fea-aec1-8d06e0f96c01 req-72ab6099-b114-46be-a7ab-92b1dacfd42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdb010a-69af-469c-baa2-e3ef4c4694d8", "name": "network-vif-deleted", "tag": "1de64d43-e5c1-4912-bce7-2fb0a645bc07"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:38.064957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bd0f3633-9a72-4fea-aec1-8d06e0f96c01 req-72ab6099-b114-46be-a7ab-92b1dacfd42d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.065402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bd0f3633-9a72-4fea-aec1-8d06e0f96c01 req-72ab6099-b114-46be-a7ab-92b1dacfd42d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.079753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:38.080278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-bd0f3633-9a72-4fea-aec1-8d06e0f96c01 req-72ab6099-b114-46be-a7ab-92b1dacfd42d service nova] Creating event network-vif-deleted:1de64d43-e5c1-4912-bce7-2fb0a645bc07 for instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 on nch1-master-1 Mar 26 20:53:38.085064 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-bd0f3633-9a72-4fea-aec1-8d06e0f96c01 req-72ab6099-b114-46be-a7ab-92b1dacfd42d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034675 Mar 26 20:53:38.086012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 794/1511] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:38.087382 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f69da7d-cede-4208-93f7-1e2479b8c068 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 200 len: 1299 microversion: 2.1 time: 0.194995 Mar 26 20:53:38.092463 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 718/1512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:37 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.099189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.104435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.106489 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.106489 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.108509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.109015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:38.109366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.110362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.111129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.123300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.123761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.124581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.125027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.140354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a852b0e9-fb88-4479-8b1b-4475b7b90965 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.052907 Mar 26 20:53:38.149837 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 795/1513] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:38.158049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.159223 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.159223 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.160473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.160927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.173345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.176400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.217537 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b6c454e-71a9-494e-89cc-2eb6f4916786 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.063102 Mar 26 20:53:38.218677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 796/1514] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:53:38.230701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.231998 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.231998 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.233217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.233678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.234974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.234974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.288759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84ba3061-5672-44f0-9d08-d4550fd3ce97 tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.063138 Mar 26 20:53:38.291197 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 797/1515] 10.222.0.16 () {60 vars in 1236 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.301804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.303643 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.303643 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.305649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.307066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.308857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.309643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.359408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04ffe1c6-e32b-421d-a296-dcb02a723c3b tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.061312 Mar 26 20:53:38.361382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 798/1516] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:53:38.380533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.382859 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.382859 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.385741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.386455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.387541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.388699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.439325 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0bafe61f-6513-4c5a-b4c8-06ebd55e1bce tempest-ServicesAdminNegativeV253TestJSON-1530849387 tempest-ServicesAdminNegativeV253TestJSON-1530849387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.070588 Mar 26 20:53:38.450981 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 799/1517] 10.222.0.16 () {60 vars in 1238 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.455637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-698ead1f-e007-44a3-b850-343c426fe2db tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59dad430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.558648 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-698ead1f-e007-44a3-b850-343c426fe2db tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.112477 Mar 26 20:53:38.559834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 800/1518] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.804700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-667f990b-1d32-4054-981b-3f8a21e857cd tempest-ServicesAdminNegativeV253TestJSON-38714093 tempest-ServicesAdminNegativeV253TestJSON-38714093-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.808643 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:38.808643 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:38.810551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-667f990b-1d32-4054-981b-3f8a21e857cd tempest-ServicesAdminNegativeV253TestJSON-38714093 tempest-ServicesAdminNegativeV253TestJSON-38714093-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3eb4893093f84e1da21b867505d1f75e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694d75f444f945149291f9eff6970f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:38.811724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-667f990b-1d32-4054-981b-3f8a21e857cd tempest-ServicesAdminNegativeV253TestJSON-38714093 tempest-ServicesAdminNegativeV253TestJSON-38714093-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:38.813291 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-667f990b-1d32-4054-981b-3f8a21e857cd tempest-ServicesAdminNegativeV253TestJSON-38714093 tempest-ServicesAdminNegativeV253TestJSON-38714093-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.243928 Mar 26 20:53:38.814896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 801/1519] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:53:38.829025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:38.830410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:38.844001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.845354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.846484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.847445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:38.924987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:38.941820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-365fcb4e-985a-437e-bf47-2a1bc6dd07c8 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1521 microversion: 2.1 time: 0.846350 Mar 26 20:53:38.943059 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 719/1520] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1521 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:38.966755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4cf89d0f-fa21-4298-bd1a-6ed7745d962c req-7ab4bbc7-fcf9-4812-be31-f2e40ef95c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da132383-a7f1-43fd-8160-f3a4ad2ce4f1", "name": "network-vif-unplugged", "status": "completed", "tag": "fb15c4ca-1f95-4280-be6b-6b881e010ddd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:38.980959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4cf89d0f-fa21-4298-bd1a-6ed7745d962c req-7ab4bbc7-fcf9-4812-be31-f2e40ef95c68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:38.981691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4cf89d0f-fa21-4298-bd1a-6ed7745d962c req-7ab4bbc7-fcf9-4812-be31-f2e40ef95c68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.000575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4cf89d0f-fa21-4298-bd1a-6ed7745d962c req-7ab4bbc7-fcf9-4812-be31-f2e40ef95c68 service nova] Creating event network-vif-unplugged:fb15c4ca-1f95-4280-be6b-6b881e010ddd for instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 on nch1-master-1 Mar 26 20:53:39.006255 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4cf89d0f-fa21-4298-bd1a-6ed7745d962c req-7ab4bbc7-fcf9-4812-be31-f2e40ef95c68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057849 Mar 26 20:53:39.009341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 720/1521] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:39.070730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:39.071876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:39.085051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.089548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.090559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.092830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.301323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:39.312853 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8049ac03-9e1c-4986-8ab2-b08d0c2e301a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1468 microversion: 2.1 time: 0.496416 Mar 26 20:53:39.325700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 802/1522] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:38 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:39.351120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:39.352249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:39.364752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.365207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.377558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.379301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.415367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. Mar 26 20:53:39.429292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:39.431193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-096be93e-9cc1-4b13-93e8-2c4940ee48ab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 404 len: 111 microversion: 2.1 time: 0.104095 Mar 26 20:53:39.438546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 803/1523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:39 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:39.458464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:39.460190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:39.479626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.481700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.483390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.487782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.719857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bee377fa-1694-4a2c-89de-8a4e4863a44b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "POST /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4/action" status: 202 len: 0 microversion: 2.1 time: 0.277611 Mar 26 20:53:39.725287 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 804/1524] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:39 2022] POST /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:39.747987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:39.748409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:39.762544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.762544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.762544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:39.763251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:39.815569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:39.947684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:39.953149 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2227ce2c-a4b5-457f-bcca-c394a1f82e01 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 204 len: 0 microversion: 2.1 time: 0.227550 Mar 26 20:53:39.961435 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 805/1525] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:39 2022] DELETE /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:39.984140 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-54e8f183-4eab-4f64-a318-710c6b2b3382 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1500 microversion: 2.1 time: 0.921506 Mar 26 20:53:39.984984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-340ae8c4-c186-4653-8020-2b2f03e81e27 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5940d550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:39.997784 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 721/1526] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:39 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1500 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:40.028714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:40.029411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:40.055455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.055455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.060932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.063612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.086807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-340ae8c4-c186-4653-8020-2b2f03e81e27 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.122282 Mar 26 20:53:40.087770 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 806/1527] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:39 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:40.099036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:40.099970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:40.116273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.116824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.118027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.118483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.350752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:40.363364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e4066e9-3942-4b14-8a5e-99d7c148d087 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1521 microversion: 2.1 time: 0.272988 Mar 26 20:53:40.375196 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 807/1528] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:40 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:40.375196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:40.375196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:40.379954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.380468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.381262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:40.381751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:40.703388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:40.713754 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba465380-39df-414d-9fad-04b4f405c596 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1495 microversion: 2.1 time: 0.347961 Mar 26 20:53:40.714838 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 808/1529] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:40 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1495 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:40.821901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:40.834792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03741767-3084-4f10-bc1a-8c05f3a73855 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.835987 Mar 26 20:53:40.835989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 722/1530] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:39 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:41.007054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:41.008007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:41.021100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.021935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.027206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.027862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.114241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d972325-da95-4cd4-80d5-1026f4070e26 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59445c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:41.197213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bd4f2793ec48a5b31d081c269a39c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf51b08278d246e498f59455e299ba89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:41.215806 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-be2f6ca4-e78a-4e07-8097-8f706914f8e5 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 200 len: 1458 microversion: 2.1 time: 0.212594 Mar 26 20:53:41.219284 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 809/1531] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:41 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 1458 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:41.226709 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d972325-da95-4cd4-80d5-1026f4070e26 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.125952 Mar 26 20:53:41.232264 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 723/1532] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:41 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:41.289812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a9166c54-dc43-4de8-91f7-8d25845b159f req-9e894b9a-8f03-4959-8812-cba83e385a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dea79e-7497-4064-8dbe-d3e455bf2830", "name": "network-vif-deleted", "tag": "29aa9240-7fae-4127-aa8a-eca7df73d597"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:41.345442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a9166c54-dc43-4de8-91f7-8d25845b159f req-9e894b9a-8f03-4959-8812-cba83e385a2c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.346688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a9166c54-dc43-4de8-91f7-8d25845b159f req-9e894b9a-8f03-4959-8812-cba83e385a2c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.384373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:41.385459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:41.404026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.404885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.408508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a9166c54-dc43-4de8-91f7-8d25845b159f req-9e894b9a-8f03-4959-8812-cba83e385a2c service nova] Creating event network-vif-deleted:29aa9240-7fae-4127-aa8a-eca7df73d597 for instance 13dea79e-7497-4064-8dbe-d3e455bf2830 on nch2-master-1 Mar 26 20:53:41.411621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.412351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.423211 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a9166c54-dc43-4de8-91f7-8d25845b159f req-9e894b9a-8f03-4959-8812-cba83e385a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138026 Mar 26 20:53:41.426934 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 810/1533] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:41.731933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:41.732656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:41.743946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.745105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:41.745909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:41.746358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.023687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:42.035487 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df8c983b-3611-49ef-9eb6-5235ac2412c4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1495 microversion: 2.1 time: 0.307899 Mar 26 20:53:42.039127 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 811/1534] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:41 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1495 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:42.058274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:42.059298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:42.073755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:42.076743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.077810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:42.080837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.367638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:42.394524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ceac313a-9b03-4f32-95da-a4b6707233b6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1521 microversion: 2.1 time: 1.013988 Mar 26 20:53:42.397787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 724/1535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:41 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1521 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:42.417186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b0e792a4-4b7c-47b4-b80e-2d6e8a0ab727 req-aff0380b-0a40-4528-aec7-624890039fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da132383-a7f1-43fd-8160-f3a4ad2ce4f1", "name": "network-vif-plugged", "status": "completed", "tag": "fb15c4ca-1f95-4280-be6b-6b881e010ddd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:42.451500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b0e792a4-4b7c-47b4-b80e-2d6e8a0ab727 req-aff0380b-0a40-4528-aec7-624890039fa2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:42.455167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b0e792a4-4b7c-47b4-b80e-2d6e8a0ab727 req-aff0380b-0a40-4528-aec7-624890039fa2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.502802 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b0e792a4-4b7c-47b4-b80e-2d6e8a0ab727 req-aff0380b-0a40-4528-aec7-624890039fa2 service nova] Creating event network-vif-plugged:fb15c4ca-1f95-4280-be6b-6b881e010ddd for instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 on nch1-master-1 Mar 26 20:53:42.528973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b0e792a4-4b7c-47b4-b80e-2d6e8a0ab727 req-aff0380b-0a40-4528-aec7-624890039fa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128665 Mar 26 20:53:42.529846 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 725/1536] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:42.535108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:42.535817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] [instance: 13dea79e-7497-4064-8dbe-d3e455bf2830] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:42.546965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:42.547419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.558758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:42.559495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:42.607826 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] HTTP exception thrown: Instance 13dea79e-7497-4064-8dbe-d3e455bf2830 could not be found. Mar 26 20:53:42.610978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] Returning 404 to user: Instance 13dea79e-7497-4064-8dbe-d3e455bf2830 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:42.613143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d1ee5ed-f10d-44a5-bdd6-5d2a9cf2c830 tempest-LiveMigrationTest-1414077140 tempest-LiveMigrationTest-1414077140-project] 10.222.0.16 "GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830" status: 404 len: 111 microversion: 2.1 time: 0.082143 Mar 26 20:53:42.619356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 726/1537] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:42 2022] GET /compute/v2.1/servers/13dea79e-7497-4064-8dbe-d3e455bf2830 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:42.648384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e53b39b9-2855-4a8c-9578-47af4ed690d8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59445700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:42.719258 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e53b39b9-2855-4a8c-9578-47af4ed690d8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.098425 Mar 26 20:53:42.725066 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 727/1538] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:42 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:43.056075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:43.068534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:43.086462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:43.087277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:43.089353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:43.089978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:43.139417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:43.147949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b004fdd6-811c-4e33-8b42-052a2f4c1fed tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 1.107109 Mar 26 20:53:43.160113 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 812/1539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:42 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:43.418291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:43.419589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:43.433231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:43.434218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:43.435337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:43.436314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:43.773610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:43.784186 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d2f556c-ffd5-42fb-a434-274e775284a6 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 200 len: 1495 microversion: 2.1 time: 0.732588 Mar 26 20:53:43.812869 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 728/1540] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:43 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 1495 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:43.821255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c842d9a2-29c4-4128-9609-d04eab29a9f2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e593971f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:43.936800 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c842d9a2-29c4-4128-9609-d04eab29a9f2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.122484 Mar 26 20:53:43.937761 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 729/1541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:43 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:43.951251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3a6692dd-303c-4281-a0ad-f5da9360347a req-14490d60-303b-4ea5-922b-ec8095512655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a", "name": "network-vif-deleted", "tag": "67eeccc0-3a32-4de1-95bd-053cea3ae6eb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:43.977295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3a6692dd-303c-4281-a0ad-f5da9360347a req-14490d60-303b-4ea5-922b-ec8095512655 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:43.977959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3a6692dd-303c-4281-a0ad-f5da9360347a req-14490d60-303b-4ea5-922b-ec8095512655 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.005392 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3a6692dd-303c-4281-a0ad-f5da9360347a req-14490d60-303b-4ea5-922b-ec8095512655 service nova] Creating event network-vif-deleted:67eeccc0-3a32-4de1-95bd-053cea3ae6eb for instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a on nch2-master-1 Mar 26 20:53:44.028749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3a6692dd-303c-4281-a0ad-f5da9360347a req-14490d60-303b-4ea5-922b-ec8095512655 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083558 Mar 26 20:53:44.030200 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 730/1542] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:44.106580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:44.116844 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-214c79b3-bc27-46fa-bbd6-72850caac2aa tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1521 microversion: 2.1 time: 0.703246 Mar 26 20:53:44.122662 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 813/1543] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:43 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1521 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:44.168739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:44.169453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:44.179319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:44.179783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.180613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:44.181056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.546449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-plugged", "status": "completed", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:44.568428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:44.578708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:44.581502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.582485 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-391c1497-0e6a-4d2a-a1d9-0810b033d198 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.417935 Mar 26 20:53:44.587320 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 731/1544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:44 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:44.616635 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] Creating event network-vif-plugged:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch1-master-1 Mar 26 20:53:44.642691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:53:44.666460 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1385a1e8-1b58-474b-b3d2-c276600cccf4 req-85bbb51b-d04e-470d-82c1-df247529b047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121935 Mar 26 20:53:44.674800 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 814/1545] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:53:44.807021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:44.807641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:44.826697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:44.827143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.827972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:44.828438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:44.867700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. Mar 26 20:53:44.869683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:53:44.871523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9591f76-1dd3-4f65-9e22-2367b1304cfc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 404 len: 111 microversion: 2.1 time: 0.068237 Mar 26 20:53:44.872591 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 732/1546] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:44 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:44.952735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f814be5a-a9ed-4972-b070-804a86bd50fb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5940aca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:45.036599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1334583647", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:45.045212 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f814be5a-a9ed-4972-b070-804a86bd50fb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.098815 Mar 26 20:53:45.046273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 815/1547] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:44 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:45.136440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:45.137200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:45.147763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:45.160337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:45.162551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:45.164024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:45.165603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:45.622080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:45.636072 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3a9ac9d1-0bbf-47bc-894c-73b727d96644 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1506 microversion: 2.1 time: 0.503718 Mar 26 20:53:45.648323 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 816/1548] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:45 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:45.657132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:45.657760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:45.672837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:45.673508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:45.676403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:45.678461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:46.063165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:46.078149 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a625de9-8466-46d1-919d-b42f45c36342 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.426467 Mar 26 20:53:46.080041 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 817/1549] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:45 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:46.091493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:46.092780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:46.108542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:46.109747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:46.112277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:46.126296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:46.657222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:46.670044 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aaf01540-0d1d-4333-9bb5-0b0f4394b1a1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 200 len: 1506 microversion: 2.1 time: 0.588569 Mar 26 20:53:46.670681 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 818/1550] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:46 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 1506 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:46.686431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5dce3dcb-0a6c-4f89-afde-d6e999fe72a5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596faf70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:46.740942 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5dce3dcb-0a6c-4f89-afde-d6e999fe72a5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.058381 Mar 26 20:53:46.741528 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 819/1551] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:46 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:46.881047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:46.881527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:46.881951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:46.882369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:46.882793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:46.905780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:46.906259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:46.908023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:46.908655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:46.980618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:46.998185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:47.036429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:47.040366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:47.080429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-039c4c2a-3110-4047-a84e-05401d06c230 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1520256731", "id": 1450358988, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:47.083008 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:47.083008 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:47.118412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-039c4c2a-3110-4047-a84e-05401d06c230 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.375323 Mar 26 20:53:47.123624 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 820/1552] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:46 2022] POST /compute/v2.1/flavors => generated 431 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:47.135447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:47.136316 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-739b5bc5-64d1-4e39-9d11-8e5618918617 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.099317 Mar 26 20:53:47.137358 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 733/1553] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:47.138002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:47.148831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:47.149775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:47.162225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:47.162884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:47.163856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:47.164657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:47.165404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:47.166617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:47.170240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:47.173848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:47.239491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:53:47.422775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25a3e6fd-da9d-4667-8824-9d679b8d11be tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 204 len: 0 microversion: 2.1 time: 0.297326 Mar 26 20:53:47.427280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 821/1554] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:53:47 2022] DELETE /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:53:47.448988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-726c51f7-77e1-47fa-9267-b02ae459b0ef tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bfa5dcec6e7d4a3ca5830d410cd40004"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:47.452753 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:47.452753 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:48.182726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:48.217883 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c576685a-2e24-4655-bbc4-a02aec3a2c0f tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 1.079217 Mar 26 20:53:48.235947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 734/1555] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:47 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:48.239408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5502f749-8aa5-4211-a3b8-c251c17acd05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:48.242075 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-726c51f7-77e1-47fa-9267-b02ae459b0ef tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1450358988/action" status: 200 len: 97 microversion: 2.1 time: 0.810431 Mar 26 20:53:48.242696 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 822/1556] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:53:47 2022] POST /compute/v2.1/flavors/1450358988/action => generated 97 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:53:48.253816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5502f749-8aa5-4211-a3b8-c251c17acd05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:48.273074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-unplugged", "status": "completed", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:48.316850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:48.319633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:48.374161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] Creating event network-vif-unplugged:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:53:48.385125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:53:48.531307 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5305a962-4a8c-4c38-b157-d88193a6b0b9 req-88b69869-ceaf-4346-bd27-82a7f88d4b50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.279855 Mar 26 20:53:48.532381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5502f749-8aa5-4211-a3b8-c251c17acd05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:48.534599 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 823/1557] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:48.540340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-66475600", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "29f25562-2089-4ea5-a798-18bd9113e9ac"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:48.545484 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5502f749-8aa5-4211-a3b8-c251c17acd05 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1209 microversion: 2.1 time: 0.316856 Mar 26 20:53:48.571140 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 735/1558] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:48 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1209 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:48.589428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc260eca-10a2-4f70-9657-baf4fc5b440a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e594ba160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:48.723827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] validate_networks() for [('29f25562-2089-4ea5-a798-18bd9113e9ac', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:48.736813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc260eca-10a2-4f70-9657-baf4fc5b440a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.161774 Mar 26 20:53:48.737404 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 736/1559] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:48 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:49.145506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b550c6b5-536e-4ed4-9c61-8794224b250c tempest-FlavorsAccessTestJSON-1665735900 tempest-FlavorsAccessTestJSON-1665735900-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:49.208143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b550c6b5-536e-4ed4-9c61-8794224b250c tempest-FlavorsAccessTestJSON-1665735900 tempest-FlavorsAccessTestJSON-1665735900-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.464809 Mar 26 20:53:49.209435 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 737/1560] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:48 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:49.429180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2087257320", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "1feff2b0-9fab-4f19-a5da-16e9d6f7dbac"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:49.571776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] validate_networks() for [('1feff2b0-9fab-4f19-a5da-16e9d6f7dbac', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:53:50.049357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:50.050287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:50.050955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:50.054634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:50.055280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:50.069805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:50.083558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:50.084829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:50.085460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:50.141490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:50.157047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Getting quotas for user b5effd8428df4616865ee71160f53594 and project 473aa792ab1045a9bc717a9a66f15afd. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:50.202371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:50.218082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:50.392987 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-549bc8ae-0f26-4463-b3b7-1cb6338b4317 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854190 Mar 26 20:53:50.398760 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 824/1561] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:50.425456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-261a8870-0b54-4247-ac78-86af04f2c03d tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bfa5dcec6e7d4a3ca5830d410cd40004"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:50.437495 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:50.437495 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:50.855813 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-261a8870-0b54-4247-ac78-86af04f2c03d tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1450358988/action" status: 200 len: 21 microversion: 2.1 time: 0.455572 Mar 26 20:53:50.861589 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 825/1562] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Mar 26 20:53:50 2022] POST /compute/v2.1/flavors/1450358988/action => generated 21 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:53:50.874282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:50.874905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:50.890980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:50.891674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:50.893916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:50.902873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:51.555438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:51.569713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd768b73-9622-4edc-8ce8-73b00e8b0734 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.703024 Mar 26 20:53:51.574250 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 826/1563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:50 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:51.600104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:51.600941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:51.624657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:51.632978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:51.635513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:51.636194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:51.949429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:51.957957 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a97ee4e-a19e-46a8-b992-9b085c16049d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1267 microversion: 2.1 time: 0.371088 Mar 26 20:53:51.960623 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 827/1564] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:51 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:51.972871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-904cf5c3-25ae-42a9-9a93-f28050d891b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59529940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:52.069781 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-904cf5c3-25ae-42a9-9a93-f28050d891b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.107354 Mar 26 20:53:52.070625 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 828/1565] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:51 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:52.077679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:52.078419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:52.085287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.086615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.088960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.090069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.191860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:52.204150 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd37f804-371b-423c-80a1-cdf996c3a513 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1268 microversion: 2.1 time: 0.132244 Mar 26 20:53:52.205342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 829/1566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:52 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:52.220363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:52.235677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.236212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.253111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] Creating event network-changed:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:53:52.272560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 20:53:52.301798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e3c235af-223b-49a0-9a4b-444177588d2d req-0bd4f71e-07e3-4ea3-92c8-3dc6334783c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094848 Mar 26 20:53:52.303198 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 830/1567] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:52.318241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f8c076c-3646-4148-94fd-056da262383f tempest-FlavorsAccessTestJSON-1665735900 tempest-FlavorsAccessTestJSON-1665735900-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:52.353008 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f8c076c-3646-4148-94fd-056da262383f tempest-FlavorsAccessTestJSON-1665735900 tempest-FlavorsAccessTestJSON-1665735900-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047231 Mar 26 20:53:52.354433 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 831/1568] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:52.366491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1309a22f-9791-4ba5-9d8b-61852d2fb721 req-17ffc926-fcc1-4b51-af3f-8f5516ad99ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da132383-a7f1-43fd-8160-f3a4ad2ce4f1", "name": "network-vif-deleted", "tag": "fb15c4ca-1f95-4280-be6b-6b881e010ddd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:52.390244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1309a22f-9791-4ba5-9d8b-61852d2fb721 req-17ffc926-fcc1-4b51-af3f-8f5516ad99ae service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.390986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1309a22f-9791-4ba5-9d8b-61852d2fb721 req-17ffc926-fcc1-4b51-af3f-8f5516ad99ae service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.419199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1309a22f-9791-4ba5-9d8b-61852d2fb721 req-17ffc926-fcc1-4b51-af3f-8f5516ad99ae service nova] Creating event network-vif-deleted:fb15c4ca-1f95-4280-be6b-6b881e010ddd for instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 on nch1-master-1 Mar 26 20:53:52.440148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1309a22f-9791-4ba5-9d8b-61852d2fb721 req-17ffc926-fcc1-4b51-af3f-8f5516ad99ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083083 Mar 26 20:53:52.440775 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 832/1569] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:52.714251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-547d6e6c-6b09-4290-bf2a-1481b03d1360 tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] Calling method '.version_select at 0x7f6e595f44c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:52.935877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:53:52.937261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:53:52.937928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:53:52.938766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:53:52.940400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:53:52.958745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.959681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.962356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:52.963634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:52.997784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Getting quotas for project f93125ac1a714e3ca18236ff7794ca6c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:53:53.005238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Getting quotas for user c99375ab58bf4a24adf07b75d7e6caf2 and project f93125ac1a714e3ca18236ff7794ca6c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:53:53.020998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Going to run 3 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:53:53.024476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:53.109174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=3eeeea44-b9a8-488c-a395-c322e1ff64f1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:53.190832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=718e1c55-f44b-4e3f-8ee9-3071f9e29591,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:53:53.267353 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-547d6e6c-6b09-4290-bf2a-1481b03d1360 tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4667 microversion: 2.1 time: 0.817387 Mar 26 20:53:53.268355 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 833/1570] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:53:52 2022] GET /compute/v2.1/os-networks => generated 4667 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:53.273181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8d4a0cb-7d11-4f22-8323-93dda089c757 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:53.274447 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:53.274447 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:53.317476 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8d4a0cb-7d11-4f22-8323-93dda089c757 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1450358988" status: 202 len: 0 microversion: 2.1 time: 0.047733 Mar 26 20:53:53.321922 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 834/1571] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:53:53 2022] DELETE /compute/v2.1/flavors/1450358988 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:53:53.334859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:53.338810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:53.357079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:53.357934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:53.358978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:53.363655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:53.388679 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c464fa01-668d-4fb9-8285-3aabd7531840 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.177045 Mar 26 20:53:53.391414 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 738/1572] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:53:53.397280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:53.401725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:53.418619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:53.419471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:53.424645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:53.425999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:54.087332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:54.097060 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ae12336-eb2d-4a9c-a220-2c5a23192bb5 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.773238 Mar 26 20:53:54.103371 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 835/1573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:53 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.108240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1b57b23-db17-44a4-b382-ff4931b2ba1b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e595d5670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.210161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1b57b23-db17-44a4-b382-ff4931b2ba1b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.105620 Mar 26 20:53:54.211211 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 836/1574] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.223304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.225142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:54.232261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:54.233036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:54.234084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:54.234965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:54.333585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:54.372289 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-824a12c3-35c3-4b0f-be96-6c053ce4ea05 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1274 microversion: 2.1 time: 0.149924 Mar 26 20:53:54.374546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 837/1575] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.402417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68d1469e-e37e-4b84-8d87-f3d71b898ac5 tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] Calling method '.version_select at 0x7f6e59dadd30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.481170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:54.491697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8c6a343-6487-4a58-b081-1eb82ffa3f78 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 1.098688 Mar 26 20:53:54.492352 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 739/1576] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:53 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.514339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2d0c5aa-6309-46b5-8e4f-dfbfabca82d4 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.555510 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2d0c5aa-6309-46b5-8e4f-dfbfabca82d4 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051295 Mar 26 20:53:54.556162 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 740/1577] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.561269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.578138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:54.578853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:53:54.660879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:54.662298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:54.665155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:54.667639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:54.686688 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68d1469e-e37e-4b84-8d87-f3d71b898ac5 tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/339cc6ca-e602-48a0-984b-bc0e7f2b3b82" status: 200 len: 652 microversion: 2.1 time: 0.307862 Mar 26 20:53:54.687716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 838/1578] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/os-networks/339cc6ca-e602-48a0-984b-bc0e7f2b3b82 => generated 652 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:54.694779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-13cb03c0-a97d-4a37-b858-fdb872652cd6 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-126572749", "id": 1032616831, "os-flavor-access:is_public": "False"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:54.696870 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:54.696870 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:54.729493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-13cb03c0-a97d-4a37-b858-fdb872652cd6 tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.039412 Mar 26 20:53:54.731330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 839/1579] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:53:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:54.740212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d46143f-c7ed-47e8-b82c-f95244e54b8a tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] Calling method '.version_select at 0x7f6e596fa430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.891680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d46143f-c7ed-47e8-b82c-f95244e54b8a tempest-NetworksTest-1067123696 tempest-NetworksTest-1067123696-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4667 microversion: 2.1 time: 0.158144 Mar 26 20:53:54.892692 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 840/1580] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/os-networks => generated 4667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:54.902589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad3975c4-a8e7-44a7-b809-7e5d55e4f19c tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.904655 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:54.904655 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:54.935508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad3975c4-a8e7-44a7-b809-7e5d55e4f19c tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1032616831/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.039989 Mar 26 20:53:54.937190 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 841/1581] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/flavors/1032616831/os-flavor-access => generated 21 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:53:54.944664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:53:54.950752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74abd729-d858-432e-9c6f-5e631f2b90ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:54.952812 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:53:54.952812 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:53:54.994897 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74abd729-d858-432e-9c6f-5e631f2b90ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1032616831" status: 202 len: 0 microversion: 2.1 time: 0.051842 Mar 26 20:53:54.996101 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 842/1582] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:53:54 2022] DELETE /compute/v2.1/flavors/1032616831 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:53:55.004648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3fb05ea4-63ba-43a3-8d07-c1b21af98efe tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:55.046570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3fb05ea4-63ba-43a3-8d07-c1b21af98efe tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044730 Mar 26 20:53:55.047174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 843/1583] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:55.115190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:55.116758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:55.133313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:55.137955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:55.142812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:55.144554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:55.176361 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3df35312-851a-4bb1-b007-af9c1cd5fc49 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.616529 Mar 26 20:53:55.177670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 741/1584] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:53:54 2022] GET /compute/v2.1/servers => generated 1018 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:55.188952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:55.194909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:55.213534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:55.213999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:55.214805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:55.215250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:55.771522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:55.800462 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-39630e6a-7920-42ab-a161-ab0893ff30a3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1227 microversion: 2.1 time: 0.597119 Mar 26 20:53:55.803450 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 742/1585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:55 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1227 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:55.819529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7bc9c91-afd9-48c2-b764-f72beebbe1ae tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e594baee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:55.954957 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f7bc9c91-afd9-48c2-b764-f72beebbe1ae tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1454 microversion: 2.1 time: 0.149748 Mar 26 20:53:55.963014 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 743/1586] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:55 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:55.984911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:55.986180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:56.004554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:56.005027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:56.005840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:56.037006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:56.064224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:56.077097 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7371d1bb-e992-4149-8089-5c9baa942edb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1467 microversion: 2.1 time: 0.966161 Mar 26 20:53:56.078412 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 844/1587] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:55 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1467 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:56.093087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:56.102935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:56.117237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:56.118746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:56.120530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:56.124049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.427333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:57.449676 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad43bf8a-5dc3-4bf0-847f-1ff095ba676a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 1.368868 Mar 26 20:53:57.464477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 845/1588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:56 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:57.472680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:57.474813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:57.486868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.487753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.488837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.490713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.697991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:57.705889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-daf173fa-c134-438e-9e4e-f680fcc76d1e tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 1.741265 Mar 26 20:53:57.706629 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 744/1589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:55 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:57.713973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2b544bd-773a-4278-ac67-7b26de383332 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e594993a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:57.778983 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2b544bd-773a-4278-ac67-7b26de383332 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1463 microversion: 2.1 time: 0.071029 Mar 26 20:53:57.779713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 745/1590] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:57 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1463 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:57.784564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:57.793535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:57.801351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.802081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.803185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.803875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.809666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:57.825043 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-928b5200-dd40-4081-83b4-f6fe5ccbca82 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1281 microversion: 2.1 time: 0.359178 Mar 26 20:53:57.832273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 846/1591] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:57 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1281 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:57.837034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b30c5dc3-f620-4e88-a932-94b80e2a0044 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e597cae50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:57.902229 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b30c5dc3-f620-4e88-a932-94b80e2a0044 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 200 len: 1463 microversion: 2.1 time: 0.068845 Mar 26 20:53:57.911840 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 847/1592] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:57 2022] GET /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:57.922568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:57.924269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:57.930712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.932523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:57.933530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:57.934125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:58.560756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:58.570643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:58.573888 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d489858e-6183-4b2e-8087-5e0b4f215927 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1468 microversion: 2.1 time: 0.654305 Mar 26 20:53:58.575034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 848/1593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:57 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1468 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:53:58.589413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:58.590713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:58.595165 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf6b4b23-9769-478c-ab5e-1f0633d4d1db tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1460 microversion: 2.1 time: 0.813404 Mar 26 20:53:58.600285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 746/1594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:57 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1460 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:58.603107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:58.604224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:58.605024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:58.605469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:58.612865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1344230774"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:58.614257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:58.634212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:58.634719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:58.635709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:58.637434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:59.305993 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3105289b-5e6a-4769-86d7-33d819c66891 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "POST /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53/action" status: 202 len: 0 microversion: 2.1 time: 0.704160 Mar 26 20:53:59.312523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 747/1595] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:53:58 2022] POST /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:53:59.318941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:59.323608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:59.339857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:59.340627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:59.342542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:59.343197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:59.860140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:53:59.869846 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9768343-fa43-4ab8-b090-15b8fa997c69 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 1.293250 Mar 26 20:53:59.870514 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 849/1596] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:58 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:53:59.895300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b7e2423f-5e28-4cec-b3bf-7026cddeb5c3 req-f05ecbb1-83b8-436d-8092-80c5f6c4286e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-plugged", "status": "completed", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:53:59.911266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e2423f-5e28-4cec-b3bf-7026cddeb5c3 req-f05ecbb1-83b8-436d-8092-80c5f6c4286e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:53:59.911721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e2423f-5e28-4cec-b3bf-7026cddeb5c3 req-f05ecbb1-83b8-436d-8092-80c5f6c4286e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:53:59.939629 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b7e2423f-5e28-4cec-b3bf-7026cddeb5c3 req-f05ecbb1-83b8-436d-8092-80c5f6c4286e service nova] Creating event network-vif-plugged:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:53:59.948138 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b7e2423f-5e28-4cec-b3bf-7026cddeb5c3 req-f05ecbb1-83b8-436d-8092-80c5f6c4286e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074775 Mar 26 20:53:59.954714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 850/1597] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:53:59.963934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:53:59.964969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:53:59.997555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.000683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.002230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.006786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.420247 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66e39a68-3c9d-417e-b311-5de9e5f87678 tempest-MigrationsAdminTest-1543386851 tempest-MigrationsAdminTest-1543386851-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1611 microversion: 2.1 time: 1.105863 Mar 26 20:54:00.440335 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 748/1598] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:59 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1611 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:00.448220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:00.448905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:00.456705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.457458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.458271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.458722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.519890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:00.532719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4908c03-2a24-4d64-8616-79570300273a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.575458 Mar 26 20:54:00.533461 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 851/1599] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:53:59 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:00.540074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-872b4203-e1e5-4f2a-b7a8-e8587e0c23a6 req-1036e599-4c00-49c2-91cd-a5c513dc2395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c229227-fa31-44f3-97ad-c652071af283", "tag": "d1f9f2eb-0ee1-479e-b5c0-022814a80bd6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:00.551886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-872b4203-e1e5-4f2a-b7a8-e8587e0c23a6 req-1036e599-4c00-49c2-91cd-a5c513dc2395 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.555632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-872b4203-e1e5-4f2a-b7a8-e8587e0c23a6 req-1036e599-4c00-49c2-91cd-a5c513dc2395 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.578151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-872b4203-e1e5-4f2a-b7a8-e8587e0c23a6 req-1036e599-4c00-49c2-91cd-a5c513dc2395 service nova] Creating event network-changed:d1f9f2eb-0ee1-479e-b5c0-022814a80bd6 for instance 7c229227-fa31-44f3-97ad-c652071af283 on nch1-master-1 Mar 26 20:54:00.588390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-872b4203-e1e5-4f2a-b7a8-e8587e0c23a6 req-1036e599-4c00-49c2-91cd-a5c513dc2395 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052968 Mar 26 20:54:00.590894 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 852/1600] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:00.597773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1c4db781-1663-4497-b012-50d708de830c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e594df790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:00.602118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:00.615395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03f18c08-2bfc-4c94-9f52-cdb077c6fcae tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1281 microversion: 2.1 time: 0.173841 Mar 26 20:54:00.626810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 749/1601] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:00 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:00.633029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b499081a-31aa-47d2-9890-6701b8eee99f req-29ca1a2a-9bac-4c33-bf55-153859286b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225fcdcd-e3c0-4d87-85bd-529e40d06a7a", "tag": "3d7f6ab7-23ad-4cd6-ab3f-08db1644f474"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:00.644244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b499081a-31aa-47d2-9890-6701b8eee99f req-29ca1a2a-9bac-4c33-bf55-153859286b3c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.644946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b499081a-31aa-47d2-9890-6701b8eee99f req-29ca1a2a-9bac-4c33-bf55-153859286b3c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.650489 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1c4db781-1663-4497-b012-50d708de830c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.058142 Mar 26 20:54:00.651648 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 853/1602] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:00 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:00.658312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:00.659130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:00.663573 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b499081a-31aa-47d2-9890-6701b8eee99f req-29ca1a2a-9bac-4c33-bf55-153859286b3c service nova] Creating event network-changed:3d7f6ab7-23ad-4cd6-ab3f-08db1644f474 for instance 225fcdcd-e3c0-4d87-85bd-529e40d06a7a on nch2-master-1 Mar 26 20:54:00.670734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.671014 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b499081a-31aa-47d2-9890-6701b8eee99f req-29ca1a2a-9bac-4c33-bf55-153859286b3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042690 Mar 26 20:54:00.672066 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 750/1603] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:00.672803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.673954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.674532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.712601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:00.850752 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d3541bf-46f3-4ecb-9b22-dd27b7455317 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 204 len: 0 microversion: 2.1 time: 0.195901 Mar 26 20:54:00.854866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 854/1604] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:00 2022] DELETE /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:00.863458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:00.865230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:00.873005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.873605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.874519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.875088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.903530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:00.904964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:00.948972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.949437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:00.950281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:00.950750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:01.374481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:01.388309 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a1a6bdf-3c58-4ba7-9a04-e30d4f713b64 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.499910 Mar 26 20:54:01.391447 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 855/1605] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:00 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:01.553673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:01.554575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:01.572920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:01.573677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:01.574765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:01.576367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:01.694936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:01.703340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c10a2925-efaf-485a-b438-663a0b0a437a tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1466 microversion: 2.1 time: 0.845151 Mar 26 20:54:01.703954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 751/1606] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:00 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1466 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:01.716739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:01.720805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:01.741140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:01.744569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:01.744569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:01.744569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:01.856339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:01.867509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18a74901-1665-40b4-8966-302cc9b94310 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1281 microversion: 2.1 time: 0.155109 Mar 26 20:54:01.868463 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 752/1607] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:01 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:01.885326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f47cf1c-aa6d-4b98-ac48-ba3c8f9ecb38 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59544700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:01.959053 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f47cf1c-aa6d-4b98-ac48-ba3c8f9ecb38 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.089468 Mar 26 20:54:01.959646 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 753/1608] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:01 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:01.970452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-10103476-9a94-45cd-952a-064f55da5546 req-3baca6b1-131d-4c8b-8107-e17f85e2f4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-unplugged", "status": "completed", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:02.001157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-10103476-9a94-45cd-952a-064f55da5546 req-3baca6b1-131d-4c8b-8107-e17f85e2f4f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:02.001631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-10103476-9a94-45cd-952a-064f55da5546 req-3baca6b1-131d-4c8b-8107-e17f85e2f4f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:02.015796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-10103476-9a94-45cd-952a-064f55da5546 req-3baca6b1-131d-4c8b-8107-e17f85e2f4f1 service nova] Creating event network-vif-unplugged:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:54:02.016223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:02.026552 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0daac35b-cf29-46d8-be26-4139d0381df6 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.478908 Mar 26 20:54:02.036317 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 856/1609] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:01 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:02.039655 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-10103476-9a94-45cd-952a-064f55da5546 req-3baca6b1-131d-4c8b-8107-e17f85e2f4f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072688 Mar 26 20:54:02.041068 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 754/1610] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:02.407484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:02.408823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:02.433821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:02.434306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:02.435065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:02.435507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:02.723333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:02.724491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:02.739546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:02.741434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:02.747860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:02.748373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:03.102341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:03.116973 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6209e6a8-133d-4968-b86c-b2422fd2400d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.714086 Mar 26 20:54:03.127353 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 857/1611] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:02 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:03.133385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:03.135378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:03.148222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:03.154107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:03.155507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:03.156219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:03.658105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:03.666558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c61eb380-c630-40a4-93a0-259390d44d46 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.537225 Mar 26 20:54:03.680751 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 858/1612] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:03 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:03.687162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-343996b9-5591-4ad7-b605-2426a0e100a0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596f6310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:03.758158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-343996b9-5591-4ad7-b605-2426a0e100a0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.075344 Mar 26 20:54:03.759058 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 859/1613] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:03 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:03.770068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:03.771023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:03.778470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:03.779143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:03.780197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:03.780843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:03.861914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:03.873566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-71db97de-9b2d-4b76-83ce-b58196fef798 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 200 len: 1466 microversion: 2.1 time: 1.156796 Mar 26 20:54:03.875744 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 755/1614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:02 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 1466 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:04.316278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-488087324", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:04.402212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:04.410099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24d30c55-2591-406c-9448-1b6c20ee0c67 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.643882 Mar 26 20:54:04.420327 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 860/1615] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:03 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:04.438041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:04.523195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b389f5c5-ec47-46d2-913a-626cf3f6dc84 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e5940a310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:04.679595 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b389f5c5-ec47-46d2-913a-626cf3f6dc84 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80" status: 200 len: 371 microversion: 2.1 time: 0.257591 Mar 26 20:54:04.684037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 861/1616] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:54:04 2022] GET /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80 => generated 371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:04.703166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9c518e60-1e82-409b-aa8f-0e0363c654d1 req-62d525ea-bf65-49a6-a620-93ad8566865e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a5c445a-5ff4-4412-9ce4-f340cb5e58c4", "name": "network-vif-deleted", "tag": "988b452a-5ed3-47d7-8ebe-f1dfe42561e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:04.735947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9c518e60-1e82-409b-aa8f-0e0363c654d1 req-62d525ea-bf65-49a6-a620-93ad8566865e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:04.738867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9c518e60-1e82-409b-aa8f-0e0363c654d1 req-62d525ea-bf65-49a6-a620-93ad8566865e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:04.768578 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9c518e60-1e82-409b-aa8f-0e0363c654d1 req-62d525ea-bf65-49a6-a620-93ad8566865e service nova] Creating event network-vif-deleted:988b452a-5ed3-47d7-8ebe-f1dfe42561e6 for instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 on nch2-master-1 Mar 26 20:54:04.780409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9c518e60-1e82-409b-aa8f-0e0363c654d1 req-62d525ea-bf65-49a6-a620-93ad8566865e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094034 Mar 26 20:54:04.784164 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 862/1617] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:04.796346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:04.797360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:04.814665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:04.816058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:04.818561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:04.819251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.170601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:05.184674 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61c25f18-368a-495d-bf00-a9e3b139c582 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.398792 Mar 26 20:54:05.186026 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 863/1618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:04 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:05.214638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Action: 'update', calling method: .version_select at 0x7f6e595d5d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:05.244382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:05.244940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:05.245282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:05.245873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:05.246295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:05.263262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.264153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.266442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.267107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.289185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.289879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.291335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.292193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.313053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Getting quotas for project 1de3ee23ad854cd3aed820396ed8bd53. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:05.326393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Getting quotas for user b1109e52939e48759e11f26461e05a5a and project 1de3ee23ad854cd3aed820396ed8bd53. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:05.361417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:05.363763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:05.378759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3021ef29-ddd2-4842-b129-5bfd232ed39a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80" status: 200 len: 328 microversion: 2.1 time: 0.187800 Mar 26 20:54:05.387882 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 864/1619] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:54:05 2022] PUT /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80 => generated 328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:05.396551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:05.399035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:05.409002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.410703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.412449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.413228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.458429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f10a97b0-ad4b-4b31-a7f3-08a670d14be9 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580852 Mar 26 20:54:05.459838 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 756/1620] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:05.577349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02a3edf0-b1aa-428c-957b-66c1eb727bf5 tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Action: 'create', calling method: .version_select at 0x7f6e594d3790>, body: {"pool": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:05.694194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:05.705123 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6bd0f0be-5115-435b-b96b-1029b5ba670a tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.315282 Mar 26 20:54:05.705964 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 865/1621] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:05 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:05.722065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec0bc8d9-3648-42ee-9b86-a17e5564594c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59afd820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:05.842319 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec0bc8d9-3648-42ee-9b86-a17e5564594c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.123713 Mar 26 20:54:05.842706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 866/1622] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:05 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:05.868489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:05.874741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:05.898590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.899831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:05.915958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:05.917342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.004391 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] HTTP exception thrown: Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 could not be found. Mar 26 20:54:06.007147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Returning 404 to user: Instance 4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:06.008362 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7371f03b-05ec-446f-94ce-3ea5eb123d20 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4" status: 404 len: 111 microversion: 2.1 time: 0.164505 Mar 26 20:54:06.009132 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 867/1623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:05 2022] GET /compute/v2.1/servers/4a5c445a-5ff4-4412-9ce4-f340cb5e58c4 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:06.021713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c38aba7-355e-4e27-a9b4-cde8144e5d5c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:06.096311 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c38aba7-355e-4e27-a9b4-cde8144e5d5c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80" status: 202 len: 0 microversion: 2.1 time: 0.082515 Mar 26 20:54:06.101190 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 868/1624] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:54:06 2022] DELETE /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:54:06.111551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:06.112214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:06.129739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.131098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.132184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.132951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.446251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:06.454835 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-687aab97-ff18-4b39-953d-786bf5525337 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.351760 Mar 26 20:54:06.456336 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 869/1625] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:06 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:06.461936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:06.462811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:06.469947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.470576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.471542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.472208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.533050 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 20:54:06.533495 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 20:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 (ip 10.222.0.16) !!! Mar 26 20:54:06.568041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:06.576466 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b559a2e0-6bd6-4129-b821-f254a98e7319 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1222 microversion: 2.1 time: 0.118121 Mar 26 20:54:06.582318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 870/1626] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:06 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:06.590397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d2982f81-4ab0-4dac-aa84-6fff323feb44 req-d3b999ae-f2bf-4f95-8420-621ec2dec8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e1c55-f44b-4e3f-8ee9-3071f9e29591", "tag": "b3d629b9-e0f1-4758-9c2f-6a5d7008cb39"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:06.604940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d2982f81-4ab0-4dac-aa84-6fff323feb44 req-d3b999ae-f2bf-4f95-8420-621ec2dec8a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.605641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d2982f81-4ab0-4dac-aa84-6fff323feb44 req-d3b999ae-f2bf-4f95-8420-621ec2dec8a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.628743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d2982f81-4ab0-4dac-aa84-6fff323feb44 req-d3b999ae-f2bf-4f95-8420-621ec2dec8a4 service nova] Creating event network-changed:b3d629b9-e0f1-4758-9c2f-6a5d7008cb39 for instance 718e1c55-f44b-4e3f-8ee9-3071f9e29591 on nch2-master-1 Mar 26 20:54:06.634947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d2982f81-4ab0-4dac-aa84-6fff323feb44 req-d3b999ae-f2bf-4f95-8420-621ec2dec8a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050920 Mar 26 20:54:06.636179 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 871/1627] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:06.641880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ec971091-2413-427a-8bd2-f7b86b826a45 req-d791a295-dfb4-4b7c-907f-bf4599a979de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d23ce7-becf-4a04-bf7e-36f8c0329a53", "name": "network-vif-plugged", "status": "completed", "tag": "2b326ee0-26a1-418e-8493-4f045fa716a8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:06.651797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec971091-2413-427a-8bd2-f7b86b826a45 req-d791a295-dfb4-4b7c-907f-bf4599a979de service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.652487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec971091-2413-427a-8bd2-f7b86b826a45 req-d791a295-dfb4-4b7c-907f-bf4599a979de service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.666357 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ec971091-2413-427a-8bd2-f7b86b826a45 req-d791a295-dfb4-4b7c-907f-bf4599a979de service nova] Creating event network-vif-plugged:2b326ee0-26a1-418e-8493-4f045fa716a8 for instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 on nch2-master-1 Mar 26 20:54:06.672980 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ec971091-2413-427a-8bd2-f7b86b826a45 req-d791a295-dfb4-4b7c-907f-bf4599a979de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035224 Mar 26 20:54:06.673983 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 872/1628] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:06.680103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:06.680760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:06.689209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.689729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.690530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:06.691113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:06.744458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:06.917159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2d66fb1-2035-414f-8721-2fd6b2583696 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 204 len: 0 microversion: 2.1 time: 0.241646 Mar 26 20:54:06.919134 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 873/1629] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:06 2022] DELETE /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:06.939809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8109c4f4-aa16-4e4d-90dc-8416622ccc5e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e5940d670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:07.054025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8109c4f4-aa16-4e4d-90dc-8416622ccc5e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80" status: 200 len: 371 microversion: 2.1 time: 0.121642 Mar 26 20:54:07.056009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 874/1630] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:54:06 2022] GET /compute/v2.1/os-quota-sets/aa8a62109f93435083b317c2eac1be80 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:07.062069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:07.062982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:07.070733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.071412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.072712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.073324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.439203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:07.459112 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59c530be-a683-40af-9ccf-84c4b531b08e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.401349 Mar 26 20:54:07.460546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 875/1631] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:07 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:07.477221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:07.477903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:07.489144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.489940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.491642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.492289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.675513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:07.683701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d872a497-8fb9-4cd0-8844-e6ca1fa83839 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.221296 Mar 26 20:54:07.695178 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 876/1632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:07 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:07.699961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0624e46a-db4e-4f4a-b1b6-2c6d58fe7df8 req-65423661-33e7-4628-906c-b5f27f3ce065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eeeea44-b9a8-488c-a395-c322e1ff64f1", "tag": "97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:07.708310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0624e46a-db4e-4f4a-b1b6-2c6d58fe7df8 req-65423661-33e7-4628-906c-b5f27f3ce065 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.708647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0624e46a-db4e-4f4a-b1b6-2c6d58fe7df8 req-65423661-33e7-4628-906c-b5f27f3ce065 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.721970 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0624e46a-db4e-4f4a-b1b6-2c6d58fe7df8 req-65423661-33e7-4628-906c-b5f27f3ce065 service nova] Creating event network-changed:97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d for instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 on nch2-master-1 Mar 26 20:54:07.729108 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0624e46a-db4e-4f4a-b1b6-2c6d58fe7df8 req-65423661-33e7-4628-906c-b5f27f3ce065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032431 Mar 26 20:54:07.732843 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 877/1633] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:07.763222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3de4a4b-e4e1-48c4-8b0f-bd96436c2907 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59e0a5e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:07.834814 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3de4a4b-e4e1-48c4-8b0f-bd96436c2907 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.100284 Mar 26 20:54:07.842188 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 878/1634] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:07 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:07.847621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:07.852473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:07.863694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.864509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:07.865675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:07.866386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:08.335653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:08.350807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a32905c3-d5a0-46e6-a0d7-10b31234e6fb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1535 microversion: 2.1 time: 0.507068 Mar 26 20:54:08.360668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 879/1635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:07 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1535 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:08.364767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-09d8a467-2188-4838-88a2-8ae4091ae68c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e59a47940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:08.758616 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-09d8a467-2188-4838-88a2-8ae4091ae68c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.400302 Mar 26 20:54:08.761236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 880/1636] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:54:08 2022] GET /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7/defaults => generated 371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:08.780397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:08.785101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:08.798186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:08.799821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:08.802961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:08.804647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.175193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:09.189427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ef4fcad-dea6-448d-8798-da6cd63cb46b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.426382 Mar 26 20:54:09.190497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 881/1637] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:08 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:09.195331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:09.196242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:09.204205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.206221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.207124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.209057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.363325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:09.379036 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ec51af3-f38e-4372-beab-a6795dfb215b tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1276 microversion: 2.1 time: 0.187307 Mar 26 20:54:09.380403 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 882/1638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:09 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:09.387808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:09.388703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:09.395622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.396561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.398842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.399593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.646496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:09.656540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1c14572-08f8-43d7-ab21-5b5f40232734 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.273978 Mar 26 20:54:09.657325 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 883/1639] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:09 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:09.671757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5740fbd1-be33-4901-829c-2522ec6cd988 req-f0a10586-b97f-4b9e-8557-50a114f8a520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34c1c94-0613-4ece-b62f-7a089bb82bf5", "tag": "b23662ab-35ef-424a-a830-2cdfa6ba7902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:09.710827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5740fbd1-be33-4901-829c-2522ec6cd988 req-f0a10586-b97f-4b9e-8557-50a114f8a520 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.711224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5740fbd1-be33-4901-829c-2522ec6cd988 req-f0a10586-b97f-4b9e-8557-50a114f8a520 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.732047 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5740fbd1-be33-4901-829c-2522ec6cd988 req-f0a10586-b97f-4b9e-8557-50a114f8a520 service nova] Creating event network-changed:b23662ab-35ef-424a-a830-2cdfa6ba7902 for instance f34c1c94-0613-4ece-b62f-7a089bb82bf5 on nch1-master-1 Mar 26 20:54:09.739798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5740fbd1-be33-4901-829c-2522ec6cd988 req-f0a10586-b97f-4b9e-8557-50a114f8a520 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081143 Mar 26 20:54:09.740494 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 884/1640] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:09.746816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:09.747516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:09.756336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.757033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:09.758028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:09.758628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:10.918517 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02a3edf0-b1aa-428c-957b-66c1eb727bf5 tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.457256 Mar 26 20:54:10.919853 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 757/1641] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:54:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:10.926241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b7a6c01-9b55-4a9a-ac36-9292b5931aec tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59652a60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:11.051356 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7b7a6c01-9b55-4a9a-ac36-9292b5931aec tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.129909 Mar 26 20:54:11.053569 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 758/1642] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:10 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:11.071683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Action: 'update', calling method: .version_select at 0x7f6e595d0040>, body: {"quota_set": {"ram": "5120"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:11.185325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:11.217767 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b00588d2-832e-4c7c-b6e1-a7297e6e4bfd tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 1.475012 Mar 26 20:54:11.220984 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 885/1643] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:09 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:11.294380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:11.296778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:11.303983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.305582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.307575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.309076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.345070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.345632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.348521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.352065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.491424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5bb5aaa1-22bf-4123-86d0-79ad4e874e73 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3" status: 200 len: 328 microversion: 2.1 time: 0.434797 Mar 26 20:54:11.495780 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 759/1644] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:54:11 2022] PUT /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3 => generated 328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:11.506818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b55d957e-d5ec-46a3-adee-fef93df27416 req-543fee0c-0d6b-4448-9070-76c1d19e9198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225fcdcd-e3c0-4d87-85bd-529e40d06a7a", "name": "network-vif-plugged", "status": "completed", "tag": "3d7f6ab7-23ad-4cd6-ab3f-08db1644f474"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:11.527323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b55d957e-d5ec-46a3-adee-fef93df27416 req-543fee0c-0d6b-4448-9070-76c1d19e9198 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.530947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b55d957e-d5ec-46a3-adee-fef93df27416 req-543fee0c-0d6b-4448-9070-76c1d19e9198 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.559697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b55d957e-d5ec-46a3-adee-fef93df27416 req-543fee0c-0d6b-4448-9070-76c1d19e9198 service nova] Creating event network-vif-plugged:3d7f6ab7-23ad-4cd6-ab3f-08db1644f474 for instance 225fcdcd-e3c0-4d87-85bd-529e40d06a7a on nch2-master-1 Mar 26 20:54:11.570553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b55d957e-d5ec-46a3-adee-fef93df27416 req-543fee0c-0d6b-4448-9070-76c1d19e9198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073317 Mar 26 20:54:11.573382 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 760/1645] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:11.598520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:11.602066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:11.627413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.629111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.630193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.633021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.662455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:11.671431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44f9f4ed-27da-4c2e-99aa-52edd0b8fbaf tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 200 len: 1364 microversion: 2.1 time: 0.440572 Mar 26 20:54:11.672047 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 886/1646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:11 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 1364 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:11.693099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:11.693975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:11.716239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.718282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:11.719270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:11.719873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.170028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:12.196499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88d619d2-410b-41b6-8987-480bd004da20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.511595 Mar 26 20:54:12.207769 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 887/1647] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:11 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:12.209285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:12.224268 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46c8a736-f072-4f6a-b909-82d8f1b1cd26 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1316 microversion: 2.1 time: 0.636006 Mar 26 20:54:12.225129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.226560 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 761/1648] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:11 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1316 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:12.228079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:12.239383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d9725c2-3bdd-40bc-b6a5-fa2f4031b3d7 tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e594d3040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.245826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.246636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.248585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.249265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.458792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:12.468477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a083fe36-07d0-4432-bcf6-b70fc64be6a8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.268397 Mar 26 20:54:12.469298 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 888/1649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:12.474523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e594f51f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.576885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.577553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.578568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.579177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.606094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cba2df44-253f-41c4-807c-02868e37fced tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3/detail" status: 200 len: 916 microversion: 2.1 time: 0.135342 Mar 26 20:54:12.607741 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 889/1650] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3/detail => generated 916 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:12.612954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-48e8eeb0-8a03-4b1c-b5ad-e7e57bd83a29 req-dc1835c9-51ae-42f1-867e-a14aabbf0056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8f0b12-682f-4c5b-809a-508c8974e650", "name": "network-vif-deleted", "tag": "d20c4d66-5919-4014-97bf-e9934b31149c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:12.642215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-48e8eeb0-8a03-4b1c-b5ad-e7e57bd83a29 req-dc1835c9-51ae-42f1-867e-a14aabbf0056 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.643467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-48e8eeb0-8a03-4b1c-b5ad-e7e57bd83a29 req-dc1835c9-51ae-42f1-867e-a14aabbf0056 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.678035 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-48e8eeb0-8a03-4b1c-b5ad-e7e57bd83a29 req-dc1835c9-51ae-42f1-867e-a14aabbf0056 service nova] Creating event network-vif-deleted:d20c4d66-5919-4014-97bf-e9934b31149c for instance 4b8f0b12-682f-4c5b-809a-508c8974e650 on nch1-master-1 Mar 26 20:54:12.690357 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-48e8eeb0-8a03-4b1c-b5ad-e7e57bd83a29 req-dc1835c9-51ae-42f1-867e-a14aabbf0056 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081158 Mar 26 20:54:12.694983 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 890/1651] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:12.718276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1e46a4b-a7ef-49ff-8155-2da49d8999dc tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596fa820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.814511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1e46a4b-a7ef-49ff-8155-2da49d8999dc tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.117828 Mar 26 20:54:12.816156 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 891/1652] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:12.823276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.824598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:12.833077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.834109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.835939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.836557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.902547 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d9725c2-3bdd-40bc-b6a5-fa2f4031b3d7 tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/caf2f58b-9836-44f8-a5b8-3dc7b35bc312" status: 200 len: 142 microversion: 2.1 time: 0.672406 Mar 26 20:54:12.903141 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 762/1653] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/os-floating-ips/caf2f58b-9836-44f8-a5b8-3dc7b35bc312 => generated 142 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:12.914632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:12.915379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 4b8f0b12-682f-4c5b-809a-508c8974e650] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:12.931047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.933834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.935211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:12.935909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:12.966151 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] HTTP exception thrown: Instance 4b8f0b12-682f-4c5b-809a-508c8974e650 could not be found. Mar 26 20:54:12.968690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Returning 404 to user: Instance 4b8f0b12-682f-4c5b-809a-508c8974e650 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:12.971281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60342d52-0898-46b0-bb6f-d02039b3ae60 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650" status: 404 len: 111 microversion: 2.1 time: 0.060784 Mar 26 20:54:12.976858 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 763/1654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/servers/4b8f0b12-682f-4c5b-809a-508c8974e650 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:12.983355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Action: 'update', calling method: .version_select at 0x7f6e594d3c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:13.124029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.124501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.125693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.125823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.169966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:13.178551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-709d2a7d-64aa-49f1-916c-bba8332606b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.360489 Mar 26 20:54:13.179142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 892/1655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:12 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:13.202323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d00d591b-814a-4a85-962d-f9c46c14778e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e59a2e9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.278457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.279500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.280579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.291747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.398690 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8190377-c6bc-4de9-81d1-97bb7562c7ee tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3?user_id=bff382a2b81f4c74af38f4ee2d4bb779" status: 200 len: 328 microversion: 2.1 time: 0.419534 Mar 26 20:54:13.399933 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 764/1656] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 20:54:12 2022] PUT /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3?user_id=bff382a2b81f4c74af38f4ee2d4bb779 => generated 328 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:13.419035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.419555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:13.433753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.434242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.437790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.438356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.497652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:13.528574 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d00d591b-814a-4a85-962d-f9c46c14778e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.334851 Mar 26 20:54:13.529988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 893/1657] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:54:13 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:13.539994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.540951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:13.567741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.569291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.570132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.573856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.687795 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-07a28e0e-16f0-4fa8-b145-ae4ce8abbc0d tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "DELETE /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 204 len: 0 microversion: 2.1 time: 0.285786 Mar 26 20:54:13.691998 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 765/1658] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:13 2022] DELETE /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:13.701560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.708293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:13.722879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.723640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.726469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.727227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.812914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:13.821280 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcfa83ea-38ab-4ef7-b6e8-60da6f2a7e48 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.289968 Mar 26 20:54:13.822792 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 894/1659] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:13 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:13.838286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76ef604b-be4c-4704-9ae7-b7e172b659d0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e597cad30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.943792 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76ef604b-be4c-4704-9ae7-b7e172b659d0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3?user_id=bff382a2b81f4c74af38f4ee2d4bb779" status: 200 len: 370 microversion: 2.1 time: 0.119641 Mar 26 20:54:13.950404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 895/1660] 10.222.0.16 () {58 vars in 1322 bytes} [Sat Mar 26 20:54:13 2022] GET /compute/v2.1/os-quota-sets/8c7f858a6afd4998950d168a0c489bf3?user_id=bff382a2b81f4c74af38f4ee2d4bb779 => generated 370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:13.950977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:13.951895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:13.958729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.959323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.960263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:13.960998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:13.967991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:13.976909 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8546348d-4e74-4c24-a636-08db52411a7a tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1505 microversion: 2.1 time: 0.283649 Mar 26 20:54:13.979220 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 766/1661] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:13 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:13.992444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-09fbb8b9-2ae3-47db-ad10-55e9aa38befb tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e5945ae50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:14.185529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:14.197063 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b7e2b13-8ec3-4a0c-b141-3c56d31052f3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.250158 Mar 26 20:54:14.197524 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 896/1662] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:13 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:14.202652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:14.203261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:14.210957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.211663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.212704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.213312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.404815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:14.414587 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e720befa-ed4e-4b96-90c5-186b7ed8febb tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1469 microversion: 2.1 time: 0.215097 Mar 26 20:54:14.415777 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 897/1663] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:14 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:14.420786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c229227-fa31-44f3-97ad-c652071af283", "name": "network-vif-plugged", "status": "completed", "tag": "d1f9f2eb-0ee1-479e-b5c0-022814a80bd6"}, {"server_uuid": "3eeeea44-b9a8-488c-a395-c322e1ff64f1", "name": "network-vif-plugged", "status": "completed", "tag": "97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:14.438034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.438695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.456561 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] Creating event network-vif-plugged:d1f9f2eb-0ee1-479e-b5c0-022814a80bd6 for instance 7c229227-fa31-44f3-97ad-c652071af283 on nch1-master-1 Mar 26 20:54:14.457350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] Creating event network-vif-plugged:97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d for instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 on nch2-master-1 Mar 26 20:54:14.467065 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-86ea9ce3-7163-48b0-bd0b-1b377484d474 req-0c42247e-78af-4eb6-944b-e53a3f3cbdf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049794 Mar 26 20:54:14.467959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 898/1664] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:14.474949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35fc33eb-6e46-44d0-869f-745ff5e26348 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596f64c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:14.545027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35fc33eb-6e46-44d0-869f-745ff5e26348 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.075361 Mar 26 20:54:14.545921 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 899/1665] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:14 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:14.555771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:14.557395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:14.565957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.566698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.567648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.568288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.742638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:14.757520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-099c7f48-6456-4b03-b041-84e91c4158e0 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1505 microversion: 2.1 time: 0.210302 Mar 26 20:54:14.758351 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 900/1666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:14 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:14.764657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:14.765520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:14.773415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.774196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.775236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:14.775868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:14.983838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:14.995394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ed896035-7cad-4d56-9666-d0739814760e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.235703 Mar 26 20:54:15.004955 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 901/1667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:14 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:15.014082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f05141a1-acd6-4414-b4a2-db17fe5c7ead tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Calling method '.version_select at 0x7f6e596fac10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:15.256507 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f05141a1-acd6-4414-b4a2-db17fe5c7ead tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.258489 Mar 26 20:54:15.257358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 902/1668] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:54:14 2022] GET /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7/defaults => generated 371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:15.265674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d736dae6-9823-46f3-b350-3a0958fbf1e2 req-bd3a94e5-e2cc-478e-922b-1cf1d5547c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "219ff1d8-95f5-4514-a2d8-a010ecdd1289", "tag": "61358ffa-a2dd-4354-a24e-4e1a7782c3c8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:15.279302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d736dae6-9823-46f3-b350-3a0958fbf1e2 req-bd3a94e5-e2cc-478e-922b-1cf1d5547c47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.279746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d736dae6-9823-46f3-b350-3a0958fbf1e2 req-bd3a94e5-e2cc-478e-922b-1cf1d5547c47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.293089 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d736dae6-9823-46f3-b350-3a0958fbf1e2 req-bd3a94e5-e2cc-478e-922b-1cf1d5547c47 service nova] Creating event network-changed:61358ffa-a2dd-4354-a24e-4e1a7782c3c8 for instance 219ff1d8-95f5-4514-a2d8-a010ecdd1289 on nch1-master-1 Mar 26 20:54:15.309674 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d736dae6-9823-46f3-b350-3a0958fbf1e2 req-bd3a94e5-e2cc-478e-922b-1cf1d5547c47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046539 Mar 26 20:54:15.311946 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 903/1669] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:15.321804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:15.323653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:15.330462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.331141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.332149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.332781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.407118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6dfa87a8-887d-4ae1-8f3d-df2d60024657 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "PUT /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1077 microversion: 2.1 time: 0.093429 Mar 26 20:54:15.421326 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 904/1670] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:54:15 2022] PUT /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1077 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:15.428088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:15.428979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:15.436566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-09fbb8b9-2ae3-47db-ad10-55e9aa38befb tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/caf2f58b-9836-44f8-a5b8-3dc7b35bc312" status: 202 len: 0 microversion: 2.1 time: 1.456664 Mar 26 20:54:15.438082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 767/1671] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:54:13 2022] DELETE /compute/v2.1/os-floating-ips/caf2f58b-9836-44f8-a5b8-3dc7b35bc312 => generated 0 bytes in 1459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:54:15.455244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:15.455906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:15.462670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.463805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.464908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.465604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.481673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.484193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.485573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.486239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.704464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:15.714490 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6fa6c675-a98e-41d5-b906-819e5d21431e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.291692 Mar 26 20:54:15.728259 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 905/1672] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:15 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:15.728259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Action: 'update', calling method: .version_select at 0x7f6e596faaf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:15.773326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:15.784525 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bd100225-788a-4eb4-82cc-60164a03ec43 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1309 microversion: 2.1 time: 0.340779 Mar 26 20:54:15.787804 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 768/1673] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:15 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:15.796833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:15.797882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:15.808124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.817531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.820640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.821505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.867968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.871245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:15.875257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:15.876021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:16.301085 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-183d3928-0640-4d8f-808e-c15d43783d1c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7" status: 200 len: 329 microversion: 2.1 time: 0.581460 Mar 26 20:54:16.304427 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 906/1674] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Mar 26 20:54:15 2022] PUT /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7 => generated 329 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:16.318216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:16.318854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:16.329709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:16.330165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:16.330962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:16.331409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:16.382929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:16.403105 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a95893d6-d369-4a35-abab-f5b3522a0c0c tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1503 microversion: 2.1 time: 0.610187 Mar 26 20:54:16.404451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 769/1675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:15 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1503 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:16.424373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e41a2762-0376-49ad-b469-d9e47352484a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Action: 'create', calling method: .version_select at 0x7f6e593d9820>, body: {"pool": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:16.569754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:16.578789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61198c95-d919-436c-aa38-5db6624a4e1b tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 200 len: 1427 microversion: 2.1 time: 0.273235 Mar 26 20:54:16.582124 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 907/1676] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:16 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 1427 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:16.599340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fb71361-4a8c-4a4e-83c2-f7aa38a6abb6 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5933a5e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:16.691982 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2fb71361-4a8c-4a4e-83c2-f7aa38a6abb6 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.107901 Mar 26 20:54:16.692693 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 908/1677] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:16 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:16.703335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:16.704132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:16.730826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:16.731273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:16.732107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:16.732549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:16.950191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:16.957966 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-afc6339f-f713-448a-a8d4-00fdff984e58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.258193 Mar 26 20:54:16.968281 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 909/1678] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:16 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:16.973374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Action: 'update', calling method: .version_select at 0x7f6e596cce50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:17.088046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.088601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.089372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.089826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.571244 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22e70978-9a44-4c76-9d43-cede2f9e19ec tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7" status: 200 len: 329 microversion: 2.1 time: 0.593032 Mar 26 20:54:17.571244 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 910/1679] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Mar 26 20:54:16 2022] PUT /compute/v2.1/os-quota-sets/39273eada056495685094a0e70a466b7 => generated 329 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:17.571244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:17.571244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:17.583486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.583968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.585163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.585523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.772185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:17.781694 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbb13f33-7ed8-4e20-a88d-71f5705dbb94 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1503 microversion: 2.1 time: 0.216860 Mar 26 20:54:17.792987 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 911/1680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:17 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:17.797948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f374fc18-7a64-493d-b8af-f8bb98ea43ff req-42f805e8-cff7-4e5d-b080-13f1d6f935dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946921b2-6fe2-4057-9572-adb926bd277d", "name": "network-vif-deleted", "tag": "45b38ca2-4fe0-430a-bebd-437115db1ae6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:17.808680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f374fc18-7a64-493d-b8af-f8bb98ea43ff req-42f805e8-cff7-4e5d-b080-13f1d6f935dc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.809260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f374fc18-7a64-493d-b8af-f8bb98ea43ff req-42f805e8-cff7-4e5d-b080-13f1d6f935dc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.821137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f374fc18-7a64-493d-b8af-f8bb98ea43ff req-42f805e8-cff7-4e5d-b080-13f1d6f935dc service nova] Creating event network-vif-deleted:45b38ca2-4fe0-430a-bebd-437115db1ae6 for instance 946921b2-6fe2-4057-9572-adb926bd277d on nch1-master-1 Mar 26 20:54:17.829972 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f374fc18-7a64-493d-b8af-f8bb98ea43ff req-42f805e8-cff7-4e5d-b080-13f1d6f935dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 Mar 26 20:54:17.834377 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 912/1681] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:17.840648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e1c55-f44b-4e3f-8ee9-3071f9e29591", "name": "network-vif-plugged", "status": "completed", "tag": "b3d629b9-e0f1-4758-9c2f-6a5d7008cb39"}, {"server_uuid": "f34c1c94-0613-4ece-b62f-7a089bb82bf5", "name": "network-vif-plugged", "status": "completed", "tag": "b23662ab-35ef-424a-a830-2cdfa6ba7902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:17.855793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.856425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.871675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] Creating event network-vif-plugged:b3d629b9-e0f1-4758-9c2f-6a5d7008cb39 for instance 718e1c55-f44b-4e3f-8ee9-3071f9e29591 on nch2-master-1 Mar 26 20:54:17.872182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] Creating event network-vif-plugged:b23662ab-35ef-424a-a830-2cdfa6ba7902 for instance f34c1c94-0613-4ece-b62f-7a089bb82bf5 on nch1-master-1 Mar 26 20:54:17.882966 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-474ae336-f492-414c-b14b-6c9b56881928 req-2fd917f7-bceb-4e0b-9e35-34133d2116b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046515 Mar 26 20:54:17.886600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 913/1682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:17.908948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:17.910960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:17.928695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.929332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:17.931385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:17.932899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.237902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:18.260514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2c8198b-8dd0-42d3-bfe1-adc953709b7e tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.371595 Mar 26 20:54:18.269792 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 914/1683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:17 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:18.271735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:18.276131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:18.288289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.288664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.289463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.293848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.684467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:18.693461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e41a2762-0376-49ad-b469-d9e47352484a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.273070 Mar 26 20:54:18.695401 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 770/1684] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:54:16 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:18.695671 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-578aa112-f936-4fa6-9098-29ca877900c3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1489 microversion: 2.1 time: 0.429095 Mar 26 20:54:18.696348 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 915/1685] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:18 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1489 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:18.705691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e62d6a93-fc20-4063-9489-2e9e6ae636ea tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59382310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:18.707439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:18.712304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: 946921b2-6fe2-4057-9572-adb926bd277d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:18.721724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.722410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.723351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.723985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.749340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] HTTP exception thrown: Instance 946921b2-6fe2-4057-9572-adb926bd277d could not be found. Mar 26 20:54:18.750069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Returning 404 to user: Instance 946921b2-6fe2-4057-9572-adb926bd277d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:18.750912 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0292e21b-27f2-4cb3-8d97-638e71cdfcef tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d" status: 404 len: 111 microversion: 2.1 time: 0.054218 Mar 26 20:54:18.758568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 771/1686] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:18 2022] GET /compute/v2.1/servers/946921b2-6fe2-4057-9572-adb926bd277d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:18.763841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:18.765063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:18.769364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e62d6a93-fc20-4063-9489-2e9e6ae636ea tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.071452 Mar 26 20:54:18.770089 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 916/1687] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:18 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:18.771554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.772195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.773123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.773706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.775120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:18.775738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:18.782063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.782519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.783308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:18.783753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:18.924675 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73857746-98dd-43ed-86ae-a481bc7bd1f1 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "PUT /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1079 microversion: 2.1 time: 0.164961 Mar 26 20:54:18.925983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 772/1688] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:54:18 2022] PUT /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1079 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:18.930942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-594cb99b-185d-45ad-b197-83d0cdf60a9e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e59597e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:18.995375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:19.006027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5cc66b68-b02e-4c2b-ab26-74f0ca410698 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1323 microversion: 2.1 time: 0.234633 Mar 26 20:54:19.016207 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 917/1689] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:18 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:19.024078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:19.025348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:19.035187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.035730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.036616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.037127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.135351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3854ea25-dfc4-4b68-a5b7-e8911c1e85b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "PUT /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1084 microversion: 2.1 time: 0.114958 Mar 26 20:54:19.146186 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 918/1690] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:54:19 2022] PUT /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1084 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:19.150861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:19.151369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:19.157758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.158221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.159007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.159448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.192468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:19.335954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1bf8b7dc-cf1b-44ff-8ee5-c47522f07f48 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 204 len: 0 microversion: 2.1 time: 0.196321 Mar 26 20:54:19.337341 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 919/1691] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:19 2022] DELETE /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:19.344880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:19.345875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:19.355172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.355774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.356924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.358214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.673450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:19.683611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-753f7903-6bb3-4384-afdd-3acc31045eb5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1505 microversion: 2.1 time: 0.344712 Mar 26 20:54:19.686956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 920/1692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:19 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:19.692412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:19.694428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:19.714039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.714498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:19.715278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:19.715716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.140941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:20.146991 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-594cb99b-185d-45ad-b197-83d0cdf60a9e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b" status: 202 len: 0 microversion: 2.1 time: 1.219590 Mar 26 20:54:20.148876 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 773/1693] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:54:18 2022] DELETE /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b => generated 0 bytes in 1222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:54:20.155351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-420c9486-2c62-49a4-9f4c-17c5acd526d9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1510 microversion: 2.1 time: 0.466558 Mar 26 20:54:20.156588 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 921/1694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:19 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.159232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.161590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.164401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.165467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.170900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.172210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.172674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.173475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.173925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.178741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.179701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.180285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.358909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:20.359573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:20.370655 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8074e840-52c3-4e31-93b7-e9334b7cc804 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.220546 Mar 26 20:54:20.371068 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c3b935f-3a5c-427a-af87-ca6c715f39dc tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1468 microversion: 2.1 time: 0.211462 Mar 26 20:54:20.371947 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 922/1695] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.372087 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 774/1696] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.378296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-385a8812-26ab-44a2-8c37-80c41b04b503 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59597e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.398553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.399216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.412320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.412795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.419743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.420509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.432715 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-385a8812-26ab-44a2-8c37-80c41b04b503 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.059529 Mar 26 20:54:20.433577 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 775/1697] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.438130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-408781ba-610f-4549-88dd-67078c4acf3e req-fa7e5498-ea9c-4deb-82c6-8cec32b3dada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219ff1d8-95f5-4514-a2d8-a010ecdd1289", "name": "network-vif-plugged", "status": "completed", "tag": "61358ffa-a2dd-4354-a24e-4e1a7782c3c8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:20.447493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-408781ba-610f-4549-88dd-67078c4acf3e req-fa7e5498-ea9c-4deb-82c6-8cec32b3dada service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.448595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-408781ba-610f-4549-88dd-67078c4acf3e req-fa7e5498-ea9c-4deb-82c6-8cec32b3dada service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.464662 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-408781ba-610f-4549-88dd-67078c4acf3e req-fa7e5498-ea9c-4deb-82c6-8cec32b3dada service nova] Creating event network-vif-plugged:61358ffa-a2dd-4354-a24e-4e1a7782c3c8 for instance 219ff1d8-95f5-4514-a2d8-a010ecdd1289 on nch1-master-1 Mar 26 20:54:20.470449 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-408781ba-610f-4549-88dd-67078c4acf3e req-fa7e5498-ea9c-4deb-82c6-8cec32b3dada service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035735 Mar 26 20:54:20.471277 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 776/1698] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:20.482172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.483147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.501424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.501888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.502690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.503132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.699103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:20.708686 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24e5e2c6-f49c-478d-bfb7-577e36bcbce5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1505 microversion: 2.1 time: 0.321411 Mar 26 20:54:20.709971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 923/1699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.718151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86f60fc4-92ba-457b-a06a-ac0d5d92b79a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e593824c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.784043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:20.794577 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ec1121f2-c6dc-4770-8d16-85fc0b8b89aa tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 200 len: 1515 microversion: 2.1 time: 0.321872 Mar 26 20:54:20.804078 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 777/1700] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:20.809960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-86f60fc4-92ba-457b-a06a-ac0d5d92b79a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f38f4f52-097b-4f9f-8e2c-9fa85e99e03b could not be found", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:54:20.810657 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-86f60fc4-92ba-457b-a06a-ac0d5d92b79a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] HTTP exception thrown: Floating IP not found for ID f38f4f52-097b-4f9f-8e2c-9fa85e99e03b Mar 26 20:54:20.811256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86f60fc4-92ba-457b-a06a-ac0d5d92b79a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Returning 404 to user: Floating IP not found for ID f38f4f52-097b-4f9f-8e2c-9fa85e99e03b {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:20.812135 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-86f60fc4-92ba-457b-a06a-ac0d5d92b79a tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b" status: 404 len: 111 microversion: 2.1 time: 0.100906 Mar 26 20:54:20.812873 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 924/1701] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:20.813476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.814348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.817780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:20.818095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:20.821051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.821513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.822837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.823467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.825360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.825813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.826585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:20.827027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:20.852357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:21.007567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c97fbf2-5d56-418c-b8a1-f1329aaf58c5 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 204 len: 0 microversion: 2.1 time: 0.193492 Mar 26 20:54:21.008915 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 925/1702] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:20 2022] DELETE /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:21.032561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.033352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.047034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.058021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.058885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.059344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.109477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:21.126681 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-78c691c4-8f3b-45e5-a479-6dcdc1b5ccc2 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1510 microversion: 2.1 time: 0.317465 Mar 26 20:54:21.127321 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 778/1703] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:20 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:21.141882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2659af70-8d2a-434c-80e1-9a7c3662410e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Calling method '.version_select at 0x7f6e59597e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.254493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-2659af70-8d2a-434c-80e1-9a7c3662410e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f38f4f52-097b-4f9f-8e2c-9fa85e99e03b could not be found", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:54:21.255838 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2659af70-8d2a-434c-80e1-9a7c3662410e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] HTTP exception thrown: Floating IP not found for ID f38f4f52-097b-4f9f-8e2c-9fa85e99e03b Mar 26 20:54:21.257210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2659af70-8d2a-434c-80e1-9a7c3662410e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] Returning 404 to user: Floating IP not found for ID f38f4f52-097b-4f9f-8e2c-9fa85e99e03b {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:21.258720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2659af70-8d2a-434c-80e1-9a7c3662410e tempest-FloatingIPsTestJSON-697150170 tempest-FloatingIPsTestJSON-697150170-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b" status: 404 len: 111 microversion: 2.1 time: 0.127924 Mar 26 20:54:21.260048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 779/1704] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:54:21 2022] DELETE /compute/v2.1/os-floating-ips/f38f4f52-097b-4f9f-8e2c-9fa85e99e03b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:21.265699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.268537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.283909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.284694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.288967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.289667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.338768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:21.354741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:21.365326 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5722a32a-92a3-4d5a-a6cb-55ef7facd4db tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591" status: 200 len: 1515 microversion: 2.1 time: 0.352325 Mar 26 20:54:21.368068 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 926/1705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:21 2022] GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:21.377777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.380551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.403412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.403899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.404739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.407460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.457677 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Instance is already in deleting state, ignoring this request Mar 26 20:54:21.460443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fdf0fa42-108d-450c-9fbf-c83076d30540 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 204 len: 0 microversion: 2.1 time: 0.196798 Mar 26 20:54:21.461037 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 780/1706] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:21 2022] DELETE /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:21.463512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:21.470807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.472191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.485347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.488933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.490122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.497311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.641359 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bf22d17-4b2a-48ed-b41d-6ff0f366292e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 204 len: 0 microversion: 2.1 time: 0.271103 Mar 26 20:54:21.642299 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 927/1707] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:21 2022] DELETE /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:21.649884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.652330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.669619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.670099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.671044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.671489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.832539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:21.842358 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c8760db-f45a-4f40-9e21-495b45c176b9 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 200 len: 1516 microversion: 2.1 time: 0.379157 Mar 26 20:54:21.856500 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 781/1708] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:21 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:21.866271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:21.869482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:21.880094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.885199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:21.891134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:21.892496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.002092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef943b3272c48aa884a7ff4a7e854d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c93c47827247b8b178018931efb9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:22.011476 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8f266c6-05c3-4f8a-873d-c12e3c149257 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 200 len: 1426 microversion: 2.1 time: 0.152806 Mar 26 20:54:22.015280 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 782/1709] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:21 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:22.028640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f951a4fa-eb24-4b14-90a4-4f8f69297da5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59637940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:22.087634 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f951a4fa-eb24-4b14-90a4-4f8f69297da5 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.070738 Mar 26 20:54:22.088804 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 783/1710] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:22 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:22.094483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:22.095343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:22.102242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.103016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.104192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.104965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.150841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:22.158879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e09296e-dc89-485b-85be-7c32a9e84017 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1318 microversion: 2.1 time: 0.515061 Mar 26 20:54:22.172080 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 928/1711] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:21 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:22.182682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:22.196553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:22.215132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.216459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.219582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.221067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.323173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:22.331898 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3fed68e8-1c8f-465b-ba50-16cc2be85750 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1511 microversion: 2.1 time: 0.241759 Mar 26 20:54:22.335194 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 784/1712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:22 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:22.345870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:22.346629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:22.357826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.358664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.359712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.360521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.391279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:22.554314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7663a98f-a029-4cf4-aac5-b6facc29caab tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 204 len: 0 microversion: 2.1 time: 0.215370 Mar 26 20:54:22.555356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 785/1713] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:22 2022] DELETE /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:22.859458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:22.911014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e4004bb-0e3f-4a66-9b53-296816800eab tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1516 microversion: 2.1 time: 0.736632 Mar 26 20:54:22.915359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ce5c6420-5dfe-4e3f-b2ba-b7b43bd13de9 req-c29b8f85-21c3-4a94-a372-ec210cff27e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba79c797-f232-452e-bc13-7ce33ac926f0", "name": "network-vif-deleted", "tag": "d86480f4-ccb4-4512-910f-b238b3c84889"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:22.924858 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 929/1714] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:22 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1516 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:22.947653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ce5c6420-5dfe-4e3f-b2ba-b7b43bd13de9 req-c29b8f85-21c3-4a94-a372-ec210cff27e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.948150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ce5c6420-5dfe-4e3f-b2ba-b7b43bd13de9 req-c29b8f85-21c3-4a94-a372-ec210cff27e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.952533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:22.956418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:22.978409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.978880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.979693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:22.980176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:22.990959 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ce5c6420-5dfe-4e3f-b2ba-b7b43bd13de9 req-c29b8f85-21c3-4a94-a372-ec210cff27e5 service nova] Creating event network-vif-deleted:d86480f4-ccb4-4512-910f-b238b3c84889 for instance ba79c797-f232-452e-bc13-7ce33ac926f0 on nch2-master-1 Mar 26 20:54:22.999079 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ce5c6420-5dfe-4e3f-b2ba-b7b43bd13de9 req-c29b8f85-21c3-4a94-a372-ec210cff27e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437229 Mar 26 20:54:23.000439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 786/1715] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:23.034295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:23.035645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] [instance: ba79c797-f232-452e-bc13-7ce33ac926f0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:23.043604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.045086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.046846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.048449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.066249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] HTTP exception thrown: Instance ba79c797-f232-452e-bc13-7ce33ac926f0 could not be found. Mar 26 20:54:23.067185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] Returning 404 to user: Instance ba79c797-f232-452e-bc13-7ce33ac926f0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:23.068316 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9cdb9917-6080-4de7-b058-e33f07271498 tempest-MigrationsAdminTest-1748733937 tempest-MigrationsAdminTest-1748733937-project] 10.222.0.16 "GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0" status: 404 len: 111 microversion: 2.1 time: 0.038829 Mar 26 20:54:23.069281 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 787/1716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:23 2022] GET /compute/v2.1/servers/ba79c797-f232-452e-bc13-7ce33ac926f0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:23.101566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18294ea6-708a-438d-9a92-2f85ab0c211c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5945a550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:23.203880 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18294ea6-708a-438d-9a92-2f85ab0c211c tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.106419 Mar 26 20:54:23.208519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:23.210647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 788/1717] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:23 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:23.216674 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-740b1a3d-ecf6-4ee0-9959-1eb00c1d2f2c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 200 len: 1522 microversion: 2.1 time: 0.283299 Mar 26 20:54:23.219575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:23.221544 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 930/1718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:22 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:23.223842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:23.244460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.245019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.249478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.250035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.353536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:23.354384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:23.360729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.361299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.362194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.362726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.683222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5effd8428df4616865ee71160f53594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473aa792ab1045a9bc717a9a66f15afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:23.692185 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-728d7cfb-0bc1-4f2e-a2b2-8bbbed0e5925 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 200 len: 1511 microversion: 2.1 time: 0.343446 Mar 26 20:54:23.706572 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 931/1719] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:23 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:23.939956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:23.940619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:23.950490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.952929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.956973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:23.957992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:23.958622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:23.966697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5765ba96-1043-4a57-8f73-af14bb8087be tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1467 microversion: 2.1 time: 0.754535 Mar 26 20:54:23.968667 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 789/1720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:23 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1467 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:24.372654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-695657304", "block_migration": true, "disk_over_commit": false}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:24.374158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:24.385097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:24.391836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:24.393074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:24.393609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:24.452325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lazy-loading 'flavor' on Instance uuid 219ff1d8-95f5-4514-a2d8-a010ecdd1289 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:54:24.502853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Going to try to live migrate instance to tempest-host-695657304 {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 20:54:24.532872 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] HTTP exception thrown: Compute host tempest-host-695657304 could not be found. Mar 26 20:54:24.535186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Returning 400 to user: Compute host tempest-host-695657304 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:24.538119 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af303e8e-0f97-4000-b083-35e8c6c4217c tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289/action" status: 400 len: 99 microversion: 2.1 time: 0.556429 Mar 26 20:54:24.542826 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 790/1721] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Mar 26 20:54:23 2022] POST /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289/action => generated 99 bytes in 562 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 26 20:54:24.553874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51638c0e-1077-4bd1-9a80-6a748925213a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59666820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:24.633476 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51638c0e-1077-4bd1-9a80-6a748925213a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1455 microversion: 2.1 time: 0.089394 Mar 26 20:54:24.634989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 791/1722] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:24 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:24.654811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:24.656036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:24.674148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:24.674715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:24.677813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:24.679620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.289740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:25.327853 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0734d055-9650-42c9-a2f8-efd70447dc4a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 200 len: 1516 microversion: 2.1 time: 1.370131 Mar 26 20:54:25.333763 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 932/1723] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:23 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 1516 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:25.351103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.352666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:25.377526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.378283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.379288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.379973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.561146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:25.576142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bf89772b-8a59-4f01-b530-240406b487b3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 200 len: 1522 microversion: 2.1 time: 0.933154 Mar 26 20:54:25.577515 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 792/1724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:24 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:25.588827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.590070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 225fcdcd-e3c0-4d87-85bd-529e40d06a7a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:25.597998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.601981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.606235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.607386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.646427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] HTTP exception thrown: Instance 225fcdcd-e3c0-4d87-85bd-529e40d06a7a could not be found. Mar 26 20:54:25.647000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Returning 404 to user: Instance 225fcdcd-e3c0-4d87-85bd-529e40d06a7a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:25.647836 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d1ff94a6-68e4-494f-87ae-baff7d264328 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a" status: 404 len: 111 microversion: 2.1 time: 0.068580 Mar 26 20:54:25.657756 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 793/1725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/servers/225fcdcd-e3c0-4d87-85bd-529e40d06a7a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:25.665353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c7e18d4a-d73b-4249-8205-c6ea57fa8c30 req-f5301a0f-e14a-49a0-8309-7473e4988c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225fcdcd-e3c0-4d87-85bd-529e40d06a7a", "name": "network-vif-deleted", "tag": "3d7f6ab7-23ad-4cd6-ab3f-08db1644f474"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:25.689450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c7e18d4a-d73b-4249-8205-c6ea57fa8c30 req-f5301a0f-e14a-49a0-8309-7473e4988c51 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.690194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c7e18d4a-d73b-4249-8205-c6ea57fa8c30 req-f5301a0f-e14a-49a0-8309-7473e4988c51 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.711543 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c7e18d4a-d73b-4249-8205-c6ea57fa8c30 req-f5301a0f-e14a-49a0-8309-7473e4988c51 service nova] Creating event network-vif-deleted:3d7f6ab7-23ad-4cd6-ab3f-08db1644f474 for instance 225fcdcd-e3c0-4d87-85bd-529e40d06a7a on nch2-master-1 Mar 26 20:54:25.728918 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c7e18d4a-d73b-4249-8205-c6ea57fa8c30 req-f5301a0f-e14a-49a0-8309-7473e4988c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068721 Mar 26 20:54:25.730759 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 794/1726] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:25.749066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82d15b3c-50f5-4d93-b060-a44454f2b233 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59f44040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.818250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82d15b3c-50f5-4d93-b060-a44454f2b233 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1464 microversion: 2.1 time: 0.085955 Mar 26 20:54:25.818834 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 795/1727] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1464 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:25.830666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.831597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:25.839858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.840810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.842737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.843191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.858158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] HTTP exception thrown: Instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 could not be found. Mar 26 20:54:25.859249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Returning 404 to user: Instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:25.860138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ecb1a74-9417-4364-b99e-d0b9baf009e2 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 404 len: 111 microversion: 2.1 time: 0.040138 Mar 26 20:54:25.860744 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 796/1728] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:25 2022] DELETE /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:25.865812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2eca7fb-6004-4bb0-9473-69dbfb3d2556 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596a83a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.911312 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2eca7fb-6004-4bb0-9473-69dbfb3d2556 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 200 len: 1464 microversion: 2.1 time: 0.049283 Mar 26 20:54:25.912136 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 797/1729] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 1464 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:25.915195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:25.923751 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-afb695cd-3328-485d-9d5a-234d33591135 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1467 microversion: 2.1 time: 0.578115 Mar 26 20:54:25.923946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.924583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: da132383-a7f1-43fd-8160-f3a4ad2ce4f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:25.928668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 933/1730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1467 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:25.944961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.945742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.949247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.949601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.950336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.952973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:25.970068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.970852 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] HTTP exception thrown: Instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 could not be found. Mar 26 20:54:25.971089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.971481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Returning 404 to user: Instance da132383-a7f1-43fd-8160-f3a4ad2ce4f1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:25.972385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b3ae6c0-e475-4412-bcf2-7ef79cc74f7f tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1" status: 404 len: 111 microversion: 2.1 time: 0.059181 Mar 26 20:54:25.972794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:25.973469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:25.974710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 798/1731] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/servers/da132383-a7f1-43fd-8160-f3a4ad2ce4f1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:25.998073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:25.998599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:26.017126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.017594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.022210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.024365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.043354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] HTTP exception thrown: Instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 could not be found. Mar 26 20:54:26.044486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Returning 404 to user: Instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:26.046489 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7ff620fe-90af-4c91-a8cc-c701dffa0786 tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 404 len: 111 microversion: 2.1 time: 0.065054 Mar 26 20:54:26.047647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 799/1732] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:25 2022] DELETE /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:26.060605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:26.064208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] [instance: 3b9ddccd-3d9d-4f22-a991-d9f94e62e449] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:26.078458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.083401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.084747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.086045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.117398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] HTTP exception thrown: Instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 could not be found. Mar 26 20:54:26.118460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] Returning 404 to user: Instance 3b9ddccd-3d9d-4f22-a991-d9f94e62e449 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:26.119556 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b83431d7-2ff0-4c97-96eb-f1c29ab4009b tempest-ServerDiskConfigTestJSON-2120226699 tempest-ServerDiskConfigTestJSON-2120226699-project] 10.222.0.16 "GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449" status: 404 len: 111 microversion: 2.1 time: 0.066967 Mar 26 20:54:26.124606 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 800/1733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:26 2022] GET /compute/v2.1/servers/3b9ddccd-3d9d-4f22-a991-d9f94e62e449 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:26.132075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2029645751", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:26.210629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:26.627231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:26.645794 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a369ecd-7a25-4bc6-b0c0-ed250dec4718 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1468 microversion: 2.1 time: 0.715677 Mar 26 20:54:26.646455 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 934/1734] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:25 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1468 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:26.657238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:26.658426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:26.660424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:26.660994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:26.661321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:26.661898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:26.662471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:26.676891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.680070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.680313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.680524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.681585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.682386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.691831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.693245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.730032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Getting quotas for project 1de3ee23ad854cd3aed820396ed8bd53. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:26.732934 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. Mar 26 20:54:26.736905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:26.736905 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae63db1c-5de8-4295-bda0-06066e8c2f20 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 404 len: 111 microversion: 2.1 time: 0.088049 Mar 26 20:54:26.739414 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 935/1735] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:26 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:26.744508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Getting quotas for user b1109e52939e48759e11f26461e05a5a and project 1de3ee23ad854cd3aed820396ed8bd53. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:26.754626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:26.755354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:26.769932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.772064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.772907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:26.773357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:26.801264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:26.805317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:26.948434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5352e89d-8739-4807-9bfe-5729115dddcb tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822157 Mar 26 20:54:26.954690 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 801/1736] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:26.984177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1801811233"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:26.987830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:27.000035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:27.001815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:27.006113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:27.006938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:27.069324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:27.082346 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91f19a63-0ea8-46f1-8189-e2e26c16df58 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 200 len: 1480 microversion: 2.1 time: 0.339455 Mar 26 20:54:27.085802 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 936/1737] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:26 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 1480 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:27.105181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6303a4ef-d0cb-4f2e-b0bd-0783eaaf2f20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:27.105798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6303a4ef-d0cb-4f2e-b0bd-0783eaaf2f20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:27.228326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6303a4ef-d0cb-4f2e-b0bd-0783eaaf2f20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:27.237578 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6303a4ef-d0cb-4f2e-b0bd-0783eaaf2f20 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1219 microversion: 2.1 time: 0.149391 Mar 26 20:54:27.239528 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 937/1738] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:27 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:27.245677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1081309524", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5c3e37a7-82c4-4995-a81c-82a00a51df42"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:27.369765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] validate_networks() for [('5c3e37a7-82c4-4995-a81c-82a00a51df42', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:27.677899 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c64537cf-3d28-401b-a492-ab32ab9d1db0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "POST /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de/action" status: 202 len: 0 microversion: 2.1 time: 0.713234 Mar 26 20:54:27.689699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 802/1739] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:54:26 2022] POST /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:54:28.093759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-97a08480-d282-49be-a8a9-a6b9b936a9a8 req-95f94ed1-5a74-4ac9-b022-e563dac15bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeeea44-b9a8-488c-a395-c322e1ff64f1", "name": "network-vif-deleted", "tag": "97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:28.122612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-97a08480-d282-49be-a8a9-a6b9b936a9a8 req-95f94ed1-5a74-4ac9-b022-e563dac15bce service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.124479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-97a08480-d282-49be-a8a9-a6b9b936a9a8 req-95f94ed1-5a74-4ac9-b022-e563dac15bce service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.170841 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-97a08480-d282-49be-a8a9-a6b9b936a9a8 req-95f94ed1-5a74-4ac9-b022-e563dac15bce service nova] Creating event network-vif-deleted:97e064d2-92b9-47c5-ad75-0bdfcfbb0a7d for instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 on nch2-master-1 Mar 26 20:54:28.186877 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-97a08480-d282-49be-a8a9-a6b9b936a9a8 req-95f94ed1-5a74-4ac9-b022-e563dac15bce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.496001 Mar 26 20:54:28.195891 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 803/1740] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:28.203237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4545ffc1-5d65-4ec6-bd1d-ad00b6a76146 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59445280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:28.305056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4545ffc1-5d65-4ec6-bd1d-ad00b6a76146 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.105043 Mar 26 20:54:28.309580 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 804/1741] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:28 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:28.325978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-efdb182e-8cc6-4607-9a76-a698250de8f0 req-63a1a58b-6788-49de-8a5c-a87fb511a8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c229227-fa31-44f3-97ad-c652071af283", "name": "network-vif-deleted", "tag": "d1f9f2eb-0ee1-479e-b5c0-022814a80bd6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:28.361776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-efdb182e-8cc6-4607-9a76-a698250de8f0 req-63a1a58b-6788-49de-8a5c-a87fb511a8fa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.362314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-efdb182e-8cc6-4607-9a76-a698250de8f0 req-63a1a58b-6788-49de-8a5c-a87fb511a8fa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.395300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-efdb182e-8cc6-4607-9a76-a698250de8f0 req-63a1a58b-6788-49de-8a5c-a87fb511a8fa service nova] Creating event network-vif-deleted:d1f9f2eb-0ee1-479e-b5c0-022814a80bd6 for instance 7c229227-fa31-44f3-97ad-c652071af283 on nch1-master-1 Mar 26 20:54:28.407090 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-efdb182e-8cc6-4607-9a76-a698250de8f0 req-63a1a58b-6788-49de-8a5c-a87fb511a8fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095888 Mar 26 20:54:28.413222 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 805/1742] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:28.419152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:28.419869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:28.439440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.440670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.447355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.448112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.481854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] HTTP exception thrown: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. Mar 26 20:54:28.484141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 404 to user: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:28.486718 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96f46853-8428-43da-bd37-9e80229afd92 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 404 len: 111 microversion: 2.1 time: 0.072117 Mar 26 20:54:28.499668 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 806/1743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:28 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:28.511604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:28.515807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:28.531088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.532000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.546846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.547551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.737000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:28.749124 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ecac679-70dd-48de-9f1b-b3f90f616afa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1215 microversion: 2.1 time: 0.247935 Mar 26 20:54:28.753332 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 807/1744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:28 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:28.763460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:28.774614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:28.781080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:28.791207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.791782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:28.792715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:28.794467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.051700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48bbe2d3-d87e-493f-ac03-aeb881523650 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.295866 Mar 26 20:54:29.053584 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 808/1745] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:54:28 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:54:29.068784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-88d11688-4998-42c9-9cf6-a0aa934fea2b req-9ac68f13-ab45-4fc0-9f94-a93224dd8c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d23ce7-becf-4a04-bf7e-36f8c0329a53", "name": "network-vif-unplugged", "status": "completed", "tag": "2b326ee0-26a1-418e-8493-4f045fa716a8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:29.093624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-88d11688-4998-42c9-9cf6-a0aa934fea2b req-9ac68f13-ab45-4fc0-9f94-a93224dd8c41 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.094688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-88d11688-4998-42c9-9cf6-a0aa934fea2b req-9ac68f13-ab45-4fc0-9f94-a93224dd8c41 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.126214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-88d11688-4998-42c9-9cf6-a0aa934fea2b req-9ac68f13-ab45-4fc0-9f94-a93224dd8c41 service nova] Creating event network-vif-unplugged:2b326ee0-26a1-418e-8493-4f045fa716a8 for instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 on nch2-master-1 Mar 26 20:54:29.132194 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-88d11688-4998-42c9-9cf6-a0aa934fea2b req-9ac68f13-ab45-4fc0-9f94-a93224dd8c41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077172 Mar 26 20:54:29.133339 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 809/1746] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:29.145230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b8658dd-6770-4dd6-93f2-873772ef4c00 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.150365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b8658dd-6770-4dd6-93f2-873772ef4c00 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:29.151383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7b8658dd-6770-4dd6-93f2-873772ef4c00 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016687 Mar 26 20:54:29.158452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 810/1747] 10.222.0.16 () {58 vars in 1181 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:54:29.171682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.177376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:29.178162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:29.196561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.197512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.198511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.198965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.245391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:54:29.326575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb174103-a02c-43b2-a440-88ac5cc17b84 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.161398 Mar 26 20:54:29.329863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 811/1748] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers => generated 683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:29.337290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c920825-6a1f-4ed7-b131-415b2e5ace1f tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59637e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.431480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c920825-6a1f-4ed7-b131-415b2e5ace1f tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.098320 Mar 26 20:54:29.431480 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 812/1749] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:29.446882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.463087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:29.463444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.servers [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Removing options 'limit' from query {{(pid=141580) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 26 20:54:29.469948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:29.487813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.488606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.490863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.491431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.563993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:54:29.598034 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e76082b7-a235-4990-9714-3d22ca43fb39 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.159054 Mar 26 20:54:29.605461 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 813/1750] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:29.613811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4da1adb6-0995-4daf-87cb-7648aa44addf tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.617612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4da1adb6-0995-4daf-87cb-7648aa44addf tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:29.619669 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4da1adb6-0995-4daf-87cb-7648aa44addf tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.011955 Mar 26 20:54:29.620489 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 814/1751] 10.222.0.16 () {58 vars in 1141 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:54:29.630524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89865000-24c7-4641-a7f3-a7bdc62ef819 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.632106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89865000-24c7-4641-a7f3-a7bdc62ef819 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:29.632999 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-89865000-24c7-4641-a7f3-a7bdc62ef819 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007288 Mar 26 20:54:29.633787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 815/1752] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:54:29.647312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6337c9a0-2df1-4d97-9bec-45f6df3dde94 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.653815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6337c9a0-2df1-4d97-9bec-45f6df3dde94 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:29.654659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6337c9a0-2df1-4d97-9bec-45f6df3dde94 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:29.662805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.servers [None req-6337c9a0-2df1-4d97-9bec-45f6df3dde94 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Flavor 'non_existing_flavor' could not be found {{(pid=141580) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Mar 26 20:54:29.663884 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6337c9a0-2df1-4d97-9bec-45f6df3dde94 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021883 Mar 26 20:54:29.676078 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 816/1753] 10.222.0.16 () {58 vars in 1177 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:54:29.676419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:29.676874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:29.677417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:29.677844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:29.678292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:29.682444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.687181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:29.688049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:29.694523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.695130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.696351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.697427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.707712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.708216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.709054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.722458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.803360 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7ad944a8-8b0e-4a20-bec9-2439867cb33c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.126078 Mar 26 20:54:29.803910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:29.812510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 817/1754] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:54:29.817569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:29.818342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:29.826670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.827132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.827676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Getting quotas for user b188ca4deda94cec85da4582a37fea72 and project 2aa3ac21589f496b83c20104323f4bb2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:29.828001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:29.828447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:29.875300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:29.879576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:30.000888 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4cd2af2b-ec92-4533-bf6f-5242f47e1932 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759838 Mar 26 20:54:30.003437 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 938/1755] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:30.009987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:30.014884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:30.022481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:30.026251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:30.033192 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c5d8809-8768-4f9a-ba28-255f6205a8e6 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1277 microversion: 2.1 time: 0.219518 Mar 26 20:54:30.036293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:30.036954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:30.038090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:30.038703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:30.039675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 818/1756] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:29 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:30.064164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5ed0755-4378-471b-a6d4-a9459f2d8361 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:30.064848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c5ed0755-4378-471b-a6d4-a9459f2d8361 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:30.299711 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bf60f287-a84b-4f34-9698-3669e4e0c1da tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.294285 Mar 26 20:54:30.301112 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 939/1757] 10.222.0.16 () {58 vars in 1183 bytes} [Sat Mar 26 20:54:30 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:54:30.329323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:30.332835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:30.333645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:30.370029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:30.371327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:30.376001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:30.376829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:30.437957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:54:30.489626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:30.498597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:30.499212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:30.631997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c5ed0755-4378-471b-a6d4-a9459f2d8361 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:30.639955 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5ed0755-4378-471b-a6d4-a9459f2d8361 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1209 microversion: 2.1 time: 0.588244 Mar 26 20:54:30.642983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 819/1758] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:30 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1209 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:30.654850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12a30d6b-f5f6-48cf-bf71-45d5ac2d58eb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5972cb80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:30.740523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12a30d6b-f5f6-48cf-bf71-45d5ac2d58eb tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.095999 Mar 26 20:54:30.742212 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 820/1759] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:30 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:31.294396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-864ee7f4-4cff-45cb-b588-047423cb67a5 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.982283 Mar 26 20:54:31.295345 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 940/1760] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:54:30 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:31.311633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:31.312564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:31.329267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.329654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.330469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.330928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.368804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5967f280>, body: {"quota_set": {"ram": "5120"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:31.438672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:31.448054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55e35760-d5c5-400f-9c92-bce7e1fb0baa tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1277 microversion: 2.1 time: 0.150631 Mar 26 20:54:31.453549 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 941/1761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:31.464556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f5eecf1-a1f8-40a0-9b5f-c2acd16fad7e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:31.474174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f5eecf1-a1f8-40a0-9b5f-c2acd16fad7e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:31.476702 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f5eecf1-a1f8-40a0-9b5f-c2acd16fad7e tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021902 Mar 26 20:54:31.479393 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 942/1762] 10.222.0.16 () {58 vars in 1177 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:54:31.492472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:31.500006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:31.501107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Searching by: {'deleted': False, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:54:31.512906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.514875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.516355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.517524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.518162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.518454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.519528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.520157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.653027 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1936ede9-263f-435b-b4a5-d3f7b66e2e13 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce" status: 200 len: 148 microversion: 2.57 time: 0.797044 Mar 26 20:54:31.653860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 821/1763] 10.222.0.16 () {62 vars in 1302 bytes} [Sat Mar 26 20:54:30 2022] PUT /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce => generated 148 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 20:54:31.663848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:31.664840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:31.673303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.676207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.677376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.678072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.683175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:54:31.769457 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a56743a8-924f-4bae-bddf-c2b2bd99471d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.281632 Mar 26 20:54:31.770960 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 943/1764] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:54:31.777124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Calling method '.version_select at 0x7f6e596cc160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:31.918904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.919822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.921240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:31.922270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:31.949559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e3cf82e-bd99-46a5-9cfb-948d02300c89 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce/detail" status: 200 len: 463 microversion: 2.57 time: 0.176811 Mar 26 20:54:31.951736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 944/1765] 10.222.0.16 () {60 vars in 1303 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce/detail => generated 463 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:54:31.973935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6e7d2919-aacf-44fd-914a-641975d52766 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e595d5d30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.058832 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6e7d2919-aacf-44fd-914a-641975d52766 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.105328 Mar 26 20:54:32.063087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 945/1766] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:32.074775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.076790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:32.094591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.095103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.095927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.096390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.101216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:32.126862 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-335111da-78b8-476c-af31-377b6a27d26d tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1269 microversion: 2.1 time: 0.463960 Mar 26 20:54:32.130687 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 822/1767] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:31 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1269 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:32.139049 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] HTTP exception thrown: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. Mar 26 20:54:32.140522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 404 to user: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:32.141472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-77c01a52-60ce-45b0-8582-4098b403eca3 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 404 len: 111 microversion: 2.1 time: 0.077280 Mar 26 20:54:32.143808 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 946/1768] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:32 2022] DELETE /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:32.152430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.153210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:32.169757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.176569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.178643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.179813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.257247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:32.262798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5926adc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:32.367840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.370385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.371997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.372679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.475704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.476573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.480848 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c7c5214-94c5-46a8-bead-18cdc8407802 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591" status: 204 len: 0 microversion: 2.1 time: 0.333395 Mar 26 20:54:32.482443 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 823/1769] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:32 2022] DELETE /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:32.484258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.486059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.495977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.500243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:32.517248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.519092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.521282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.521991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.629399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf6f0348-e359-47e3-95a4-5483988d1bd9 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce?user_id=44efec53e0ca41d6b928582bf7a73c7a" status: 200 len: 148 microversion: 2.57 time: 0.370764 Mar 26 20:54:32.634906 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 947/1770] 10.222.0.16 () {62 vars in 1383 bytes} [Sat Mar 26 20:54:32 2022] PUT /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce?user_id=44efec53e0ca41d6b928582bf7a73c7a => generated 148 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:54:32.639082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.639580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:32.655773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.656504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.657261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.657779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.699433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:54:32.711103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:32.726433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce69c859-9b05-47e5-be7a-5a103080d53f tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1277 microversion: 2.1 time: 0.241914 Mar 26 20:54:32.728990 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 824/1771] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:32 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:32.741871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08497895-b862-44ec-b45b-a0e222253534 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Calling method '.version_select at 0x7f6e59725670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.855482 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11ed8d5f-21ee-4834-8fe0-00a1f2a4518c tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 204 len: 0 microversion: 2.1 time: 0.223933 Mar 26 20:54:32.856472 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 948/1772] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:54:32 2022] DELETE /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:54:32.873360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.876637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 3eeeea44-b9a8-488c-a395-c322e1ff64f1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:32.890561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.891022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.891822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:32.894219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:32.948678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] HTTP exception thrown: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. Mar 26 20:54:32.949239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 404 to user: Instance 3eeeea44-b9a8-488c-a395-c322e1ff64f1 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:32.951791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-316314ed-0034-470f-b468-304efbf230e2 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1" status: 404 len: 111 microversion: 2.1 time: 0.090798 Mar 26 20:54:32.958438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 949/1773] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:32 2022] GET /compute/v2.1/servers/3eeeea44-b9a8-488c-a395-c322e1ff64f1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:32.997269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:32.997915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:33.001254 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08497895-b862-44ec-b45b-a0e222253534 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce?user_id=44efec53e0ca41d6b928582bf7a73c7a" status: 200 len: 190 microversion: 2.57 time: 0.269637 Mar 26 20:54:33.010246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 825/1774] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Mar 26 20:54:32 2022] GET /compute/v2.1/os-quota-sets/352a377d0a424d8b945698841f95a8ce?user_id=44efec53e0ca41d6b928582bf7a73c7a => generated 190 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:54:33.027489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.033064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:33.034490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.039402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:33.096748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8dcfb396-d1de-4145-9b59-5f64298e19a8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e598e1700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:33.180750 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8dcfb396-d1de-4145-9b59-5f64298e19a8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.109985 Mar 26 20:54:33.189940 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 826/1775] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:33 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:33.194898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:33.195517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:33.209746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.219383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:33.220440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.220896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:33.600596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:33.616788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c60abf8e-efb9-4229-bd97-e73a34601409 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1267 microversion: 2.1 time: 0.421872 Mar 26 20:54:33.621241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 827/1776] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:33 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1267 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:33.748400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:33.749037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:33.766423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.767433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:33.770267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:33.773756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:34.320379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:34.333275 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90255dd7-ebf1-4489-bc61-92ff4f85c943 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591" status: 200 len: 1521 microversion: 2.1 time: 1.373680 Mar 26 20:54:34.336367 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 950/1777] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:32 2022] GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591 => generated 1521 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:34.349586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c71444d-e577-41b3-a5d8-aac599252b01 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ed54f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:34.449511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c71444d-e577-41b3-a5d8-aac599252b01 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.110640 Mar 26 20:54:34.452644 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 951/1778] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:34 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:34.639142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:34.640074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:34.652059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:34.656863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:34.658150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:34.658765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:35.012701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:35.027757 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f783407-cfbb-4a77-bb27-4159924f8256 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 1.285106 Mar 26 20:54:35.030405 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 828/1779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:33 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:35.046491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-67bc9d6f-f945-40f0-8e00-ebe176459892 req-bdf32ed4-529c-4364-8c34-31efd89b1754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-plugged", "status": "completed", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:35.074610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67bc9d6f-f945-40f0-8e00-ebe176459892 req-bdf32ed4-529c-4364-8c34-31efd89b1754 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:35.075780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67bc9d6f-f945-40f0-8e00-ebe176459892 req-bdf32ed4-529c-4364-8c34-31efd89b1754 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:35.112359 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-67bc9d6f-f945-40f0-8e00-ebe176459892 req-bdf32ed4-529c-4364-8c34-31efd89b1754 service nova] Creating event network-vif-plugged:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:54:35.131787 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-67bc9d6f-f945-40f0-8e00-ebe176459892 req-bdf32ed4-529c-4364-8c34-31efd89b1754 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091122 Mar 26 20:54:35.133435 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 829/1780] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:35.356075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:35.357136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:35.372082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:35.373541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:35.376215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:35.377371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:35.463791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:35.501387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37ade178-bb34-4d4d-8f5b-8a0e007a3825 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.867504 Mar 26 20:54:35.514399 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 952/1781] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:34 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:35.516710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ea28697-83c2-434b-afa3-f74e47fa6cfe tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5926ac10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:35.606670 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ea28697-83c2-434b-afa3-f74e47fa6cfe tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.100059 Mar 26 20:54:35.607698 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 953/1782] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:35 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:36.044770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:36.045715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:36.054634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:36.059368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:36.060742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:36.062057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:36.892192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99375ab58bf4a24adf07b75d7e6caf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93125ac1a714e3ca18236ff7794ca6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:36.899705 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-597401d1-1bcd-4699-8dc0-74a7814c185d tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591" status: 200 len: 1521 microversion: 2.1 time: 1.549638 Mar 26 20:54:36.900376 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 830/1783] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:35 2022] GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591 => generated 1521 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:36.924998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:36.926033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:36.953326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:36.973358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:36.974677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:36.975351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:37.078956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:37.090523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-789b09cb-f4ba-44ed-936b-ff935e28792a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 1.049482 Mar 26 20:54:37.095835 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 954/1784] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:36 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:37.108579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-29ab59d1-367c-4d61-89c1-8e9bf1667312 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e597cad30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:37.167763 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-29ab59d1-367c-4d61-89c1-8e9bf1667312 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.069900 Mar 26 20:54:37.168664 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 955/1785] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:37 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:37.409500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-86126175", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b548d517-dd30-4b03-a661-453f42eea720"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:37.514514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] validate_networks() for [('b548d517-dd30-4b03-a661-453f42eea720', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:38.210976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:38.267666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e09eef40-1234-45c5-b18f-ad2ef965ea8a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 1.360854 Mar 26 20:54:38.272972 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 831/1786] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:36 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:39.197527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac7ee768-e1c2-465c-8907-7b1a33b8f4f0 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Calling method '.version_select at 0x7f6e598e1ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:39.237175 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ac7ee768-e1c2-465c-8907-7b1a33b8f4f0 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:39.238659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac7ee768-e1c2-465c-8907-7b1a33b8f4f0 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:39.239813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac7ee768-e1c2-465c-8907-7b1a33b8f4f0 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "DELETE /compute/v2.1/images/48d8d1da-8ed9-487e-b67c-411b80d7754f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.962536 Mar 26 20:54:39.248247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 832/1787] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 20:54:38 2022] DELETE /compute/v2.1/images/48d8d1da-8ed9-487e-b67c-411b80d7754f/metadata/os_distro => generated 62 bytes in 975 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:39.263358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-67786cf0-1215-48f7-a389-a0541cee6cfc req-82896b6a-e9f1-478d-8fee-d8ad8d34326d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e1c55-f44b-4e3f-8ee9-3071f9e29591", "name": "network-vif-deleted", "tag": "b3d629b9-e0f1-4758-9c2f-6a5d7008cb39"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:39.308835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67786cf0-1215-48f7-a389-a0541cee6cfc req-82896b6a-e9f1-478d-8fee-d8ad8d34326d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.312883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67786cf0-1215-48f7-a389-a0541cee6cfc req-82896b6a-e9f1-478d-8fee-d8ad8d34326d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:39.340661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-67786cf0-1215-48f7-a389-a0541cee6cfc req-82896b6a-e9f1-478d-8fee-d8ad8d34326d service nova] Creating event network-vif-deleted:b3d629b9-e0f1-4758-9c2f-6a5d7008cb39 for instance 718e1c55-f44b-4e3f-8ee9-3071f9e29591 on nch2-master-1 Mar 26 20:54:39.354964 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-67786cf0-1215-48f7-a389-a0541cee6cfc req-82896b6a-e9f1-478d-8fee-d8ad8d34326d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101380 Mar 26 20:54:39.356057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 833/1788] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:39.369354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:39.371043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: 718e1c55-f44b-4e3f-8ee9-3071f9e29591] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:39.388418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.392133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:39.393479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.393833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:39.422562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] HTTP exception thrown: Instance 718e1c55-f44b-4e3f-8ee9-3071f9e29591 could not be found. Mar 26 20:54:39.423177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 404 to user: Instance 718e1c55-f44b-4e3f-8ee9-3071f9e29591 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:39.428423 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b425765-0cb4-4c72-8ab3-f4e7cfb27923 tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591" status: 404 len: 111 microversion: 2.1 time: 0.066558 Mar 26 20:54:39.432559 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 834/1789] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:39 2022] GET /compute/v2.1/servers/718e1c55-f44b-4e3f-8ee9-3071f9e29591 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:39.444569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ea3c3b15-149e-4c26-9518-d10c79b118b3 req-b18ee895-d55c-44ec-b56f-def0e7050042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d951af70-c52e-49f1-9b46-09efd09fe52f", "tag": "2aecae7b-472a-4f8c-a96d-ce83680c4f2f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:39.462323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ea3c3b15-149e-4c26-9518-d10c79b118b3 req-b18ee895-d55c-44ec-b56f-def0e7050042 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.463374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ea3c3b15-149e-4c26-9518-d10c79b118b3 req-b18ee895-d55c-44ec-b56f-def0e7050042 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:39.492854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ea3c3b15-149e-4c26-9518-d10c79b118b3 req-b18ee895-d55c-44ec-b56f-def0e7050042 service nova] Creating event network-changed:2aecae7b-472a-4f8c-a96d-ce83680c4f2f for instance d951af70-c52e-49f1-9b46-09efd09fe52f on nch2-master-1 Mar 26 20:54:39.509097 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ea3c3b15-149e-4c26-9518-d10c79b118b3 req-b18ee895-d55c-44ec-b56f-def0e7050042 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075182 Mar 26 20:54:39.510948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 835/1790] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:39.516521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:39.520464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:39.537979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.538702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:39.539705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:39.542348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.073188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:40.075124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:40.075796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:40.076401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:40.077017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:40.091798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.103009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.104623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.105268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.124523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Getting quotas for project 032c3519ef0d4b99891f8fe4e48a2fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:40.142752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Getting quotas for user e9e5b428b7b341a5a253addfd9493158 and project 032c3519ef0d4b99891f8fe4e48a2fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:40.169379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:40.172141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:40.251686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:40.263643 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f784a2dd-aae2-4ae0-a522-1ce11d637e96 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 0.751245 Mar 26 20:54:40.264557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 836/1791] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:39 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:40.277459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4ca81ba-7ce5-4452-8efb-c23752957da6 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e593971f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:40.297840 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73773fa6-f936-46a6-9953-14910bd3178f tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.107451 Mar 26 20:54:40.301911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 956/1792] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:40.311851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ca97d85-f552-472d-95bb-ea8d65f02f13 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Calling method '.version_select at 0x7f6e5ed285e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:40.434528 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6ca97d85-f552-472d-95bb-ea8d65f02f13 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:40.435143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ca97d85-f552-472d-95bb-ea8d65f02f13 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:40.436029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ca97d85-f552-472d-95bb-ea8d65f02f13 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "GET /compute/v2.1/images/f0f1576f-fd3f-4fed-9fda-db1f0fc6df86/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.132179 Mar 26 20:54:40.436891 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 957/1793] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 20:54:40 2022] GET /compute/v2.1/images/f0f1576f-fd3f-4fed-9fda-db1f0fc6df86/metadata/os_version => generated 62 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:40.443358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:40.444603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:40.461225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.461705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.462544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.462992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.486344 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4ca81ba-7ce5-4452-8efb-c23752957da6 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.217629 Mar 26 20:54:40.486953 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 837/1794] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:40 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:40.500579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:40.501607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] [instance: f34c1c94-0613-4ece-b62f-7a089bb82bf5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:40.521285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.521758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.522843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:40.523479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:40.549937 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] HTTP exception thrown: Instance f34c1c94-0613-4ece-b62f-7a089bb82bf5 could not be found. Mar 26 20:54:40.550966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] Returning 404 to user: Instance f34c1c94-0613-4ece-b62f-7a089bb82bf5 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:40.553811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2fc246f5-62ad-4671-a112-de87a635d8be tempest-ListServersNegativeTestJSON-248339683 tempest-ListServersNegativeTestJSON-248339683-project] 10.222.0.16 "GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5" status: 404 len: 111 microversion: 2.1 time: 0.065841 Mar 26 20:54:40.559171 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 838/1795] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:40 2022] GET /compute/v2.1/servers/f34c1c94-0613-4ece-b62f-7a089bb82bf5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:40.565870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e5fa1a4b-4c67-47a4-99e5-84ec5e3dae39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:40.566852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e5fa1a4b-4c67-47a4-99e5-84ec5e3dae39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:41.360168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:41.372355 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61f2fcbd-e73a-4f94-bab0-f819e54b0c74 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.934199 Mar 26 20:54:41.375433 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 958/1796] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:40 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:41.383540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-660c117a-4368-415f-b426-14ee33b2d24a tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Calling method '.version_select at 0x7f6e5ed54310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:41.397669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e5fa1a4b-4c67-47a4-99e5-84ec5e3dae39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:41.404695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e5fa1a4b-4c67-47a4-99e5-84ec5e3dae39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1215 microversion: 2.1 time: 0.843966 Mar 26 20:54:41.408465 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 839/1797] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:40 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1215 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:41.414220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:41.414220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:41.432318 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-660c117a-4368-415f-b426-14ee33b2d24a tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:41.433010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-660c117a-4368-415f-b426-14ee33b2d24a tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:41.436267 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-660c117a-4368-415f-b426-14ee33b2d24a tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "GET /compute/v2.1/images/b98dd76a-4143-48e8-b189-3a4b05788374/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059377 Mar 26 20:54:41.440912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 959/1798] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:54:41 2022] GET /compute/v2.1/images/b98dd76a-4143-48e8-b189-3a4b05788374/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:41.461257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:41.461924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:41.462419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:41.462871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:41.464070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-05004122-6258-4a30-a3e7-36b5f8532dac tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Action: 'update_all', calling method: .version_select at 0x7f6e5ed53dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:41.520420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-05004122-6258-4a30-a3e7-36b5f8532dac tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:41.521638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-05004122-6258-4a30-a3e7-36b5f8532dac tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:41.522625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-05004122-6258-4a30-a3e7-36b5f8532dac tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "PUT /compute/v2.1/images/5ab5cdba-b203-4c48-9eaa-7f941b766f19/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080426 Mar 26 20:54:41.527334 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 960/1799] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:54:41 2022] PUT /compute/v2.1/images/5ab5cdba-b203-4c48-9eaa-7f941b766f19/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:41.533540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cb904799-00cc-46c5-919b-839aea535e1b req-51e3329a-2b8d-4805-8cee-fe0154c05148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c465f7-5289-47b5-be81-a8bffea6bb40", "tag": "bc6395f6-f2f3-4aa7-912e-2231739b4607"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:41.554952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb904799-00cc-46c5-919b-839aea535e1b req-51e3329a-2b8d-4805-8cee-fe0154c05148 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:41.555420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb904799-00cc-46c5-919b-839aea535e1b req-51e3329a-2b8d-4805-8cee-fe0154c05148 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:41.600073 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cb904799-00cc-46c5-919b-839aea535e1b req-51e3329a-2b8d-4805-8cee-fe0154c05148 service nova] Creating event network-changed:bc6395f6-f2f3-4aa7-912e-2231739b4607 for instance 38c465f7-5289-47b5-be81-a8bffea6bb40 on nch1-master-1 Mar 26 20:54:41.610920 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cb904799-00cc-46c5-919b-839aea535e1b req-51e3329a-2b8d-4805-8cee-fe0154c05148 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085368 Mar 26 20:54:41.614487 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 961/1800] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:41.627519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d968ecd-6aa8-4bb7-aa45-db1755476ed8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596faaf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:41.727350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d968ecd-6aa8-4bb7-aa45-db1755476ed8 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.111248 Mar 26 20:54:41.732506 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 962/1801] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:41 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:41.750212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25cf8e1e-7de3-4fbb-a227-07cc6a96ff84 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Action: 'update', calling method: .version_select at 0x7f6e5926a700>, body: {"meta": {"os_distro": "alt"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:41.819121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-25cf8e1e-7de3-4fbb-a227-07cc6a96ff84 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:41.819953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25cf8e1e-7de3-4fbb-a227-07cc6a96ff84 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:41.820983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25cf8e1e-7de3-4fbb-a227-07cc6a96ff84 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "PUT /compute/v2.1/images/a4479404-8ecc-4b14-9c6e-52215515373c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.086519 Mar 26 20:54:41.824485 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 963/1802] 10.222.0.16 () {60 vars in 1309 bytes} [Sat Mar 26 20:54:41 2022] PUT /compute/v2.1/images/a4479404-8ecc-4b14-9c6e-52215515373c/metadata/os_distro => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:41.851400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8260c049-cab1-4886-9b74-1223a89df15a req-80d16617-7abc-40f0-ae9d-e3f478807685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34c1c94-0613-4ece-b62f-7a089bb82bf5", "name": "network-vif-deleted", "tag": "b23662ab-35ef-424a-a830-2cdfa6ba7902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:41.870367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8260c049-cab1-4886-9b74-1223a89df15a req-80d16617-7abc-40f0-ae9d-e3f478807685 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:41.871201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8260c049-cab1-4886-9b74-1223a89df15a req-80d16617-7abc-40f0-ae9d-e3f478807685 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:41.962265 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8260c049-cab1-4886-9b74-1223a89df15a req-80d16617-7abc-40f0-ae9d-e3f478807685 service nova] Creating event network-vif-deleted:b23662ab-35ef-424a-a830-2cdfa6ba7902 for instance f34c1c94-0613-4ece-b62f-7a089bb82bf5 on nch1-master-1 Mar 26 20:54:41.973901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8260c049-cab1-4886-9b74-1223a89df15a req-80d16617-7abc-40f0-ae9d-e3f478807685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147750 Mar 26 20:54:41.974525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 964/1803] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:41.984129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65281392-d2f6-47f3-8499-87805125a876 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Action: 'create', calling method: .version_select at 0x7f6e5ed54430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:42.093425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-65281392-d2f6-47f3-8499-87805125a876 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] HTTP exception thrown: Image not found. Mar 26 20:54:42.094222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65281392-d2f6-47f3-8499-87805125a876 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:54:42.095145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65281392-d2f6-47f3-8499-87805125a876 tempest-ImagesMetadataNegativeTestJSON-657338280 tempest-ImagesMetadataNegativeTestJSON-657338280-project] 10.222.0.16 "POST /compute/v2.1/images/a92c84f9-9113-421e-8910-f65fd2d619d2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.118032 Mar 26 20:54:42.096044 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 965/1804] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Mar 26 20:54:41 2022] POST /compute/v2.1/images/a92c84f9-9113-421e-8910-f65fd2d619d2/metadata => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:54:42.390793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:42.392494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:42.425461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:42.430729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:42.436605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:42.442871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:42.680761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:42.689294 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dea0e152-5e30-4661-a16f-439ff651ee74 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 1.279692 Mar 26 20:54:42.695356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 840/1805] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:41 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:42.710547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:42.717899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:42.736788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:42.738246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:42.740779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:42.744891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:42.995688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:43.007491 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fbe4073d-232c-43ce-b782-ae69f742c2db tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1273 microversion: 2.1 time: 0.309112 Mar 26 20:54:43.018917 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 841/1806] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:42 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:43.029262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-027f811b-20ae-4dfc-8fb2-ee1388224117 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5942be50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:43.115026 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-027f811b-20ae-4dfc-8fb2-ee1388224117 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.094420 Mar 26 20:54:43.115891 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 842/1807] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:43 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:43.475443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:43.494543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8514eeb1-6fd5-4255-90ed-b985c8e2fc19 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 1.105835 Mar 26 20:54:43.496786 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 966/1808] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:42 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:43.711691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:43.712960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:43.733949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:43.733949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:43.735063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:43.735684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:44.027490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:44.028334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:44.048236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:44.049793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:44.056205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:44.061641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:44.245330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:44.254671 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-98d35626-568d-42cb-bd41-686fc8b8f86c tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1273 microversion: 2.1 time: 0.233014 Mar 26 20:54:44.260070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 967/1809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:44 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:44.273344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c10eb54-0ba3-4f58-95e1-f009a0a93ef4 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ebf0e50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:44.359478 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c10eb54-0ba3-4f58-95e1-f009a0a93ef4 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.097944 Mar 26 20:54:44.365370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 968/1810] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:44 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:44.514045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:44.528877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:44.546047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:44.553800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:44.562962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:44.564556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:44.866966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:44.875574 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0b36d52f-af60-49ff-9fc7-4d50e68cd082 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 1.167630 Mar 26 20:54:44.892863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 843/1811] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:43 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:45.129131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:45.138948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53c6b995-0513-40ea-bbb5-c61332a81aaf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.628564 Mar 26 20:54:45.140706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 969/1812] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:44 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:45.278469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:45.279095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:45.293578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:45.296612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:45.308733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:45.309108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:45.922641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-63c87ffa-52cd-47af-8298-d1f577949e4e req-738afd1c-15b8-48a9-89ea-b1cd49bae0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d951af70-c52e-49f1-9b46-09efd09fe52f", "name": "network-vif-plugged", "status": "completed", "tag": "2aecae7b-472a-4f8c-a96d-ce83680c4f2f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:45.937453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-63c87ffa-52cd-47af-8298-d1f577949e4e req-738afd1c-15b8-48a9-89ea-b1cd49bae0ef service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:45.937909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-63c87ffa-52cd-47af-8298-d1f577949e4e req-738afd1c-15b8-48a9-89ea-b1cd49bae0ef service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:45.983832 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-63c87ffa-52cd-47af-8298-d1f577949e4e req-738afd1c-15b8-48a9-89ea-b1cd49bae0ef service nova] Creating event network-vif-plugged:2aecae7b-472a-4f8c-a96d-ce83680c4f2f for instance d951af70-c52e-49f1-9b46-09efd09fe52f on nch2-master-1 Mar 26 20:54:46.027415 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-63c87ffa-52cd-47af-8298-d1f577949e4e req-738afd1c-15b8-48a9-89ea-b1cd49bae0ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.817994 Mar 26 20:54:46.036278 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 844/1813] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:46.043878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12e9bc23-c23f-4b5b-b8e6-1b41a7faff97 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5b1600d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:46.179651 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12e9bc23-c23f-4b5b-b8e6-1b41a7faff97 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.141846 Mar 26 20:54:46.180625 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 845/1814] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:46 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:46.190501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:46.200386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:46.227310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:46.230797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:46.232218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:46.236486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:46.412153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:46.429646 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46505d1c-87ca-453c-91ce-ab56a4ed1956 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 1.157432 Mar 26 20:54:46.434185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 970/1815] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:45 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:46.443114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:46.449613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:46.459669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:46.465276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:46.466476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:46.467136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:46.779375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:46.787133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b70d07f-fea8-4127-acd3-94439d0aed67 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.351598 Mar 26 20:54:46.792201 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 971/1816] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:46 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:47.070100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:47.078697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26a1739a-303b-43b9-83f9-3f45ed37c144 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1319 microversion: 2.1 time: 0.896741 Mar 26 20:54:47.088876 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 846/1817] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:46 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1319 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:47.178696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1644617164", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:47.193623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6b54039-16fe-40d6-bc29-bc4a8e712ccd tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5942b790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:47.346961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6b54039-16fe-40d6-bc29-bc4a8e712ccd tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.157293 Mar 26 20:54:47.347624 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 847/1818] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:47 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:47.383756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:47.385048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:47.385686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:47.386277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:47.386845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:47.410331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:47.411009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:47.412050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:47.413902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:47.448084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:47.448797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:47.461865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:47.465289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:47.466272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:47.466982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:47.467246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Getting quotas for project f1a4be7864234e8f93a10896a309e6ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:47.486428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Getting quotas for user 5d3b74fb605347bcbe8359165aaa0c6f and project f1a4be7864234e8f93a10896a309e6ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:47.512606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:47.517347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:47.613210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-294e68c2-bf80-4d25-b0a9-62029eeed2d0 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.819584 Mar 26 20:54:47.617061 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 972/1819] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:54:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 20:54:47.627940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:47.631256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:47.908868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:47.920888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:47.922650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:47.950016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70d545a5-9ee4-4ca3-8aeb-6f3d4ba7f46a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "PUT /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1359 microversion: 2.75 time: 0.326140 Mar 26 20:54:47.951182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 973/1820] 10.222.0.16 () {62 vars in 1296 bytes} [Sat Mar 26 20:54:47 2022] PUT /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:54:48.159154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-271656031", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:48.271436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:48.361438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:48.370169 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c2c7367-60dd-4483-b4a8-7c5a2f2a2c68 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 0.926881 Mar 26 20:54:48.379631 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 848/1821] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:47 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:54:48.379631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:48.380082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:48.397470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:48.397922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:48.404727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:48.405425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:48.981133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:49.004619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69ec0a5a-6ed0-47c1-8e11-5c0e5afe8364 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.628785 Mar 26 20:54:49.025919 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 849/1822] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:48 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:49.042550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-06f2e8ab-c6da-4124-90e9-33c3d2ca0373 req-8c5f839a-be6b-49fc-9eb2-c05fa1033a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1e06b9-61a3-4b19-805d-42475235c1e4", "tag": "1df11505-f619-4383-bdf2-f2c503680a3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:49.059687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-06f2e8ab-c6da-4124-90e9-33c3d2ca0373 req-8c5f839a-be6b-49fc-9eb2-c05fa1033a47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.060457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-06f2e8ab-c6da-4124-90e9-33c3d2ca0373 req-8c5f839a-be6b-49fc-9eb2-c05fa1033a47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.103732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-06f2e8ab-c6da-4124-90e9-33c3d2ca0373 req-8c5f839a-be6b-49fc-9eb2-c05fa1033a47 service nova] Creating event network-changed:1df11505-f619-4383-bdf2-f2c503680a3f for instance 6f1e06b9-61a3-4b19-805d-42475235c1e4 on nch2-master-1 Mar 26 20:54:49.112242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-06f2e8ab-c6da-4124-90e9-33c3d2ca0373 req-8c5f839a-be6b-49fc-9eb2-c05fa1033a47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084673 Mar 26 20:54:49.114340 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 850/1823] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:49.129155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:49.130400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:49.131495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:49.132383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:49.134780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:49.149883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:49.155538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:49.159952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.162794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.187278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.188244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.194993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.198042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.200137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.202084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.239395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Getting quotas for project b2f47185eafd43c3a0a4a7cbfb9d679d. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:49.251988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Getting quotas for user 864b039c62424775834b1294a6725d80 and project b2f47185eafd43c3a0a4a7cbfb9d679d. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:49.282876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:49.290193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:49.448122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-595ffc62-74e7-4af1-8ed6-c1bf6e6efc3e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495640 Mar 26 20:54:49.459988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 974/1824] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:49.509181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:49.510180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:49.538942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.539804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.545549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.546323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.641768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:49.656559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:49.661078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:49.684666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d91c7cf4-6083-4d58-b92e-2062d130723d tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1411 microversion: 2.75 time: 0.568672 Mar 26 20:54:49.685681 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 851/1825] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:54:49 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1411 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:54:49.714719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc5ecca7-9145-4bbc-b160-f89d874b3a1b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59397ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:49.803576 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc5ecca7-9145-4bbc-b160-f89d874b3a1b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.116083 Mar 26 20:54:49.805669 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 852/1826] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:49 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:49.824847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:49.825526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:49.862273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.864458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:49.870650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:49.873398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:50.261851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:50.271267 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-344842ac-c6fe-4d92-843d-cccab04fe0f3 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1469 microversion: 2.1 time: 0.809561 Mar 26 20:54:50.289122 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 975/1827] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:49 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1469 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:50.300612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af5d6a48-9b4b-4085-b9b5-ed56a55d49b5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:50.304794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af5d6a48-9b4b-4085-b9b5-ed56a55d49b5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:50.577385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af5d6a48-9b4b-4085-b9b5-ed56a55d49b5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:50.597195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af5d6a48-9b4b-4085-b9b5-ed56a55d49b5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1216 microversion: 2.1 time: 0.306708 Mar 26 20:54:50.600127 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 976/1828] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:50 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1216 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:50.615882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:50.616692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:50.644122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:50.648972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:50.650544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:50.653088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:50.788506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:50.798793 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-94ca4274-96f4-43a7-8fa9-0362c5525b80 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 0.989488 Mar 26 20:54:50.799299 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 853/1829] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:49 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:50.809813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:50.815875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:50.830778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:50.832550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:50.834504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:50.836712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:50.888675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lazy-loading 'flavor' on Instance uuid d951af70-c52e-49f1-9b46-09efd09fe52f {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:54:51.030088 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66dd31fb-1d60-4d53-b598-13031ad198c0 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f/action" status: 202 len: 0 microversion: 2.1 time: 0.224813 Mar 26 20:54:51.035095 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 854/1830] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:54:50 2022] POST /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:54:51.156657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2018739925", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "226ff5e6-1a29-48f3-b9f3-1c0eb848dd35"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:51.265172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] validate_networks() for [('226ff5e6-1a29-48f3-b9f3-1c0eb848dd35', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:54:51.774209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:51.801061 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39b6772d-ae77-478d-8a47-255512c7201a tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 1.190911 Mar 26 20:54:51.803480 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 977/1831] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:50 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:51.819947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:51.821411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:51.840030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:51.840770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:51.846959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:51.847646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:52.370454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:52.381277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:52.388789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:52.402435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06e0b61d-232c-41d9-ba43-767abc0dc8fa tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1417 microversion: 2.75 time: 0.594099 Mar 26 20:54:52.415322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 978/1832] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:54:51 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1417 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:54:52.415322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-893da3fa-45c7-40d6-8b9c-830e90e95d33 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ed28c10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:52.493479 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-893da3fa-45c7-40d6-8b9c-830e90e95d33 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.085156 Mar 26 20:54:52.494768 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 979/1833] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:52 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:52.511808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:52.512465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:52.536176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:52.536629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:52.537427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:52.538057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.469233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:53.479932 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-472f123d-a23e-4d50-80d0-a37798fc52b4 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1460 microversion: 2.1 time: 0.983614 Mar 26 20:54:53.481347 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 980/1834] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:52 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1460 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:53.486283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-09aed634-257b-41d5-88ef-0247ae9557a3 req-656faaf9-7380-4fdc-9da2-b6d2b76db259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c465f7-5289-47b5-be81-a8bffea6bb40", "name": "network-vif-plugged", "status": "completed", "tag": "bc6395f6-f2f3-4aa7-912e-2231739b4607"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:53.504782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-09aed634-257b-41d5-88ef-0247ae9557a3 req-656faaf9-7380-4fdc-9da2-b6d2b76db259 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.505482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-09aed634-257b-41d5-88ef-0247ae9557a3 req-656faaf9-7380-4fdc-9da2-b6d2b76db259 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.519405 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-09aed634-257b-41d5-88ef-0247ae9557a3 req-656faaf9-7380-4fdc-9da2-b6d2b76db259 service nova] Creating event network-vif-plugged:bc6395f6-f2f3-4aa7-912e-2231739b4607 for instance 38c465f7-5289-47b5-be81-a8bffea6bb40 on nch1-master-1 Mar 26 20:54:53.527059 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-09aed634-257b-41d5-88ef-0247ae9557a3 req-656faaf9-7380-4fdc-9da2-b6d2b76db259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044305 Mar 26 20:54:53.528688 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 981/1835] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:53.534949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:53.536024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:53.555474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.556864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.557956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.559001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.646916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:53.665289 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b1ea1e4-96e1-409f-a835-89125c8ba22a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1274 microversion: 2.1 time: 0.134603 Mar 26 20:54:53.666782 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 982/1836] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:53 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:53.671502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:53.672180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:53.680140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.680762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.681845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.682774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.836968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:53.838493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:53.839625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:53.840322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:53.840918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:53.863224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:53.871353 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4125e33c-dce0-4073-87a9-585e9c5708d0 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 0.203406 Mar 26 20:54:53.879810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.880605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.881662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.882011 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 983/1837] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:53 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:53.882680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.887647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:53.888579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:53.895319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.895778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.896605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:53.897047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:53.924968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Getting quotas for project c1854d29eeb64bb4b5851d72ac8dddab. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:54:53.940565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Getting quotas for user d6067a3bcd1e4ccb808323697704fea2 and project c1854d29eeb64bb4b5851d72ac8dddab. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:54:53.959716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:54:53.963038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:54:54.070446 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff0b54ef-3d4a-4059-b4c5-ead45a6e849c tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.036280 Mar 26 20:54:54.083134 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 855/1838] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:54:54.094093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:54.104789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:54.126478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:54.133262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:54.135730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:54.136923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:54.244962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:54.253749 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8954b258-d65d-4e6f-b630-ab225945d4e3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.370613 Mar 26 20:54:54.269784 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 984/1839] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:53 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:54.281908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:54.286301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:54.298992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:54.303726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:54.304955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:54.310755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:54.344900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:54.358330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:54.360406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:54.380064 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a5b7bb1-3878-4882-b581-9288acc0ee0a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1438 microversion: 2.75 time: 0.295345 Mar 26 20:54:54.383250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 856/1840] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:54:54 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1438 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:54:54.397390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46bf42f9-44b2-42f3-8866-a02df4c6907b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59748700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:55.247455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3c3a334-abc4-4ca2-855c-fb585675e05e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1611 microversion: 2.1 time: 0.976347 Mar 26 20:54:55.258171 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 985/1841] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:54 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1611 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:55.282289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:55.282917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:55.353421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:55.353974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:55.363190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:55.371405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:55.617450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:55.625951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8c388bd0-3f8f-45f7-9292-7729fbbb7fe6 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1221 microversion: 2.1 time: 0.365481 Mar 26 20:54:55.626532 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 986/1842] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:55 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1221 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:55.674567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:54:55.684965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:55.733202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:55.733665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:55.734542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:55.735034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.284401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:54:59.285440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:54:59.286082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:54:59.288539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:54:59.289024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:54:59.292766 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46bf42f9-44b2-42f3-8866-a02df4c6907b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 4.908177 Mar 26 20:54:59.301649 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 857/1843] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:54 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 4917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:59.312885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:59.315959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:59.334018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.336494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.339094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.339830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.500220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:59.530119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.531128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.536130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.537346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.783154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:59.793471 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59d52634-d8eb-487a-b52e-a1f63d7ac1d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.488967 Mar 26 20:54:59.794688 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 858/1844] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:59 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:54:59.800524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:59.801412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:59.809193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:59.835576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:59.845618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:54:59.847336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.848871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.850654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.852150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.859552 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b8017a6-ff73-478d-bfeb-922a7b4930f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "POST /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab/action" status: 202 len: 1495 microversion: 2.75 time: 4.208638 Mar 26 20:54:59.863081 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 987/1845] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:54:55 2022] POST /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab/action => generated 1495 bytes in 4236 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 26 20:54:59.871836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:59.894902 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:54:59.894902 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:54:59.894902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.896085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.900416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:54:59.900416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:54:59.977377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-639928d0-898b-4cbe-8e0e-baa9b43e2e61 tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.112703 Mar 26 20:54:59.984516 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 988/1846] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:54:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:54:59.992076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:54:59.993007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:54:59.999982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.002730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.004605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.005735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.193390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.221271 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7000966b-76ca-4b86-9958-57159435dc39 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 0.425138 Mar 26 20:55:00.231312 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 859/1847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:59 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:00.240042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-02ce03b3-5fc7-4e8c-8f4f-911e9e8db51a req-0a52ec8c-cf59-44df-b447-cde3cc13edc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e06b9-61a3-4b19-805d-42475235c1e4", "name": "network-vif-plugged", "status": "completed", "tag": "1df11505-f619-4383-bdf2-f2c503680a3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:00.270465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-02ce03b3-5fc7-4e8c-8f4f-911e9e8db51a req-0a52ec8c-cf59-44df-b447-cde3cc13edc2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.270921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-02ce03b3-5fc7-4e8c-8f4f-911e9e8db51a req-0a52ec8c-cf59-44df-b447-cde3cc13edc2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.304429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-02ce03b3-5fc7-4e8c-8f4f-911e9e8db51a req-0a52ec8c-cf59-44df-b447-cde3cc13edc2 service nova] Creating event network-vif-plugged:1df11505-f619-4383-bdf2-f2c503680a3f for instance 6f1e06b9-61a3-4b19-805d-42475235c1e4 on nch2-master-1 Mar 26 20:55:00.314331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-02ce03b3-5fc7-4e8c-8f4f-911e9e8db51a req-0a52ec8c-cf59-44df-b447-cde3cc13edc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081420 Mar 26 20:55:00.315743 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 860/1848] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:00.322041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:00.323250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:00.329712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.330394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.331366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.332011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.588310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.602679 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-442b0e34-d9c3-484d-8b03-aa2987b42ea9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1489 microversion: 2.1 time: 0.616981 Mar 26 20:55:00.603317 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 989/1849] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:54:59 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1489 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:00.641105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-24e035af-7e3c-4db7-8497-a5daf1fd18e2 req-ca2c0017-fb19-4345-810a-78334154804a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:00.663674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.675284 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-247d8986-0893-43ea-af4c-cd9ee9df2473 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.358115 Mar 26 20:55:00.675450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-24e035af-7e3c-4db7-8497-a5daf1fd18e2 req-ca2c0017-fb19-4345-810a-78334154804a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.677084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-24e035af-7e3c-4db7-8497-a5daf1fd18e2 req-ca2c0017-fb19-4345-810a-78334154804a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.686382 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 861/1850] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:00 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:00.702421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:00.706203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:00.718152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.720453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.720915 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-24e035af-7e3c-4db7-8497-a5daf1fd18e2 req-ca2c0017-fb19-4345-810a-78334154804a service nova] Creating event network-changed:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:55:00.723786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.724575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.736011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-24e035af-7e3c-4db7-8497-a5daf1fd18e2 req-ca2c0017-fb19-4345-810a-78334154804a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127553 Mar 26 20:55:00.736829 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 990/1851] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:00.747366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:00.753056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:00.768354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.768816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.769607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.775728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.799848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.812974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.814746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:00.821097 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa0636a0-53cf-404e-b11f-654adfe09ae6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.133273 Mar 26 20:55:00.823112 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 862/1852] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:00 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:00.828579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d73e31d4-99b3-4d71-bdc2-1fe976d372a3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e594088b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:00.851891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Lazy-loading 'flavor' on Instance uuid d951af70-c52e-49f1-9b46-09efd09fe52f {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:00.887839 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d951af70-c52e-49f1-9b46-09efd09fe52f while it is in vm_state suspended Mar 26 20:55:00.891864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d951af70-c52e-49f1-9b46-09efd09fe52f while it is in vm_state suspended {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:00.892768 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-42c96819-7e3f-43cb-b412-ac082d001e9e tempest-LiveMigrationNegativeTest-893286455 tempest-LiveMigrationNegativeTest-893286455-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f/action" status: 409 len: 155 microversion: 2.1 time: 0.154124 Mar 26 20:55:00.894202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 991/1853] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:55:00 2022] POST /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f/action => generated 155 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:55:00.908059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d73e31d4-99b3-4d71-bdc2-1fe976d372a3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1455 microversion: 2.1 time: 0.083708 Mar 26 20:55:00.909180 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 863/1854] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:00 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:00.920934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:00.922124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:00.942438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1015123204"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:00.954204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.954902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.955871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.956540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.968643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:00.989510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.989961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:00.990753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:00.991190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.225025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00a19ce7-21bb-4879-ac7a-1f34babb7d28 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "PUT /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1074 microversion: 2.1 time: 0.329869 Mar 26 20:55:01.238411 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 992/1855] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:55:00 2022] PUT /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1074 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:01.252553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c75f9da8-7e05-4a1f-a640-1739b62207b8 req-7d78d60f-d5ea-4c83-bd77-502b88f631af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e559cd6-163d-4e56-889f-574746da5d5b", "tag": "63ba9525-82f3-4e19-a0c3-0d361b9ac813"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:01.272427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c75f9da8-7e05-4a1f-a640-1739b62207b8 req-7d78d60f-d5ea-4c83-bd77-502b88f631af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.272878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c75f9da8-7e05-4a1f-a640-1739b62207b8 req-7d78d60f-d5ea-4c83-bd77-502b88f631af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.302353 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c75f9da8-7e05-4a1f-a640-1739b62207b8 req-7d78d60f-d5ea-4c83-bd77-502b88f631af service nova] Creating event network-changed:63ba9525-82f3-4e19-a0c3-0d361b9ac813 for instance 5e559cd6-163d-4e56-889f-574746da5d5b on nch2-master-1 Mar 26 20:55:01.314853 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c75f9da8-7e05-4a1f-a640-1739b62207b8 req-7d78d60f-d5ea-4c83-bd77-502b88f631af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073391 Mar 26 20:55:01.316296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 993/1856] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:01.333122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:01.333701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:01.349237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.349697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.356589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.356589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.421865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:01.435281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:01.443821 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d062358b-d7d5-4f3d-b925-68c057de8502 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.533294 Mar 26 20:55:01.457903 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 864/1857] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:00 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:01.466334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:01.467211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:01.488344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.489217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.498172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.498995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.557948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a5a3b68-7596-4c07-b5e6-f455ce127d13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 204 len: 0 microversion: 2.1 time: 0.240024 Mar 26 20:55:01.561755 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 994/1858] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:01 2022] DELETE /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:01.566360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:01.567821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:01.576556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.577100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.577954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.578501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.817130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:01.825788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a205e576-e706-4abb-a2cc-7ebc9747b78e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1315 microversion: 2.1 time: 0.366510 Mar 26 20:55:01.832202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 865/1859] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:01 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:01.840408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:01.846019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:01.862497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.863231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.864209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.864828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.890328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:01.902337 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ae8e8b7-d761-4eb3-919f-6a5c6c361239 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1500 microversion: 2.1 time: 0.342031 Mar 26 20:55:01.906802 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 995/1860] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:01 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1500 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:01.919030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:01.938668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:01.959313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.960985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:01.978995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:01.979471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.221330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.233647 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a255d5c-11a0-4f01-8e3a-4f645edea2dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1466 microversion: 2.1 time: 0.400111 Mar 26 20:55:02.239154 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 866/1861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:01 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1466 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.249949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.250571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:02.270789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.271273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.276308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.277005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.362583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.374470 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ee6bdc3-f926-42ba-b034-086889d2d6a7 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.466170 Mar 26 20:55:02.383703 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 996/1862] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:01 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.383703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db0e9d31-6486-4d81-b0ab-e80b15bcbfba tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb60a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.394896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.403574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.405946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.411289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3eb7e452-02a0-46a4-ba8a-f5655bed5894 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.170285 Mar 26 20:55:02.418850 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 867/1863] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:02.430084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.431876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:02.441556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.443141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.444631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.444753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db0e9d31-6486-4d81-b0ab-e80b15bcbfba tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1464 microversion: 2.1 time: 0.068264 Mar 26 20:55:02.445709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.452716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 997/1864] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.459045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8cf8db57-b95b-43ee-9684-f9cc32a4fad3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ed53670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.505714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8cf8db57-b95b-43ee-9684-f9cc32a4fad3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 200 len: 1464 microversion: 2.1 time: 0.051352 Mar 26 20:55:02.506286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 998/1865] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 1464 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:02.511823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.512636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:02.521214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.521699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.522477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.522915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.679447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.689252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c40bf06f-f683-441b-a27e-3700b89ba86e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.181692 Mar 26 20:55:02.690326 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 999/1866] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.695297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.696214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:02.703242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.705224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.705224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.705814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.840346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.848408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-170f2a80-ae62-4228-9e90-5c4265dc1835 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1500 microversion: 2.1 time: 0.427985 Mar 26 20:55:02.851409 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 868/1867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1500 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.873786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:02.875606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:02.884995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.885458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.886301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.886912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:02.924781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:02.934031 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eec0fbae-d9d2-42af-9026-952cffab22b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1481 microversion: 2.1 time: 0.242267 Mar 26 20:55:02.947682 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1000/1868] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1481 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:02.961838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3205f13d-1509-41a1-a0ec-9054dcdf97a5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:02.967902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3205f13d-1509-41a1-a0ec-9054dcdf97a5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:02.968402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3205f13d-1509-41a1-a0ec-9054dcdf97a5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.053773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3205f13d-1509-41a1-a0ec-9054dcdf97a5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 20:55:03.110992 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3205f13d-1509-41a1-a0ec-9054dcdf97a5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "POST /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40/action" status: 202 len: 0 microversion: 2.1 time: 0.161530 Mar 26 20:55:03.111406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.114531 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1001/1869] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:55:02 2022] POST /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:03.120674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.122265 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef702dba-64a5-4553-b479-a2b65b02765e tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1504 microversion: 2.1 time: 0.264823 Mar 26 20:55:03.128286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 869/1870] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:02 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:03.128452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.142366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.142959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.144192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.144636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.146128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.146959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.154288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.155099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.156189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.156864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.209310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.210447 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-154886aa-931c-4107-80cb-db03fe5bc68a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/os-instance-actions/req-73773fa6-f936-46a6-9953-14910bd3178f" status: 200 len: 313 microversion: 2.1 time: 0.072251 Mar 26 20:55:03.211196 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 870/1871] 10.222.0.16 () {58 vars in 1418 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/os-instance-actions/req-73773fa6-f936-46a6-9953-14910bd3178f => generated 313 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:03.232095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:03.233139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.245998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.246430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.247231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.247677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.376916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.380920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82d084d9-e667-4004-bc82-4a4cb18d952a tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "POST /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/action" status: 202 len: 0 microversion: 2.1 time: 0.153010 Mar 26 20:55:03.387839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 871/1872] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:55:03 2022] POST /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:03.394833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.395907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.399122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5867ffec-4220-4827-9c0e-1316e38054b9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.283120 Mar 26 20:55:03.401464 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1002/1873] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:03.406157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.406977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.407559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.408697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.410184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.411027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.432945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.433168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.447857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.448644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.704201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.724589 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d034f18-3e20-4cea-b2bf-38e059f4aa6a tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1466 microversion: 2.1 time: 0.334857 Mar 26 20:55:03.734245 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 872/1874] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1466 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:03.739034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.739653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.745938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.746560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.747351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.747792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.766420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.776384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b8f99b9-659f-44fb-8158-0458e2fc0bc1 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.374081 Mar 26 20:55:03.786543 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1003/1875] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:03.796641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.800634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:03.810070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.810962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.812081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:03.812780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:03.937937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.952603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.954443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:03.965387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-28c84704-b04f-4491-a71e-97ffa947235f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.177206 Mar 26 20:55:03.966207 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1004/1876] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:03.976562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:03.977200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:04.002906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.002906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.002906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.002906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.087250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:04.101588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d0d9d1f-0787-4bf1-933d-191f2f5b13f1 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1506 microversion: 2.1 time: 0.366166 Mar 26 20:55:04.104913 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 873/1877] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:04.123765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.124808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:04.136772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.139142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.143297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.144196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.420503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:04.432451 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1fd5042-c670-46f9-9aac-6e1840a1b6a4 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.465337 Mar 26 20:55:04.433336 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1005/1878] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:03 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:04.447887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8013f9b4-613c-4722-9854-066ccde1c3f1 req-501d6c48-efc9-4ac1-8a9b-10e4d3f68d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d951af70-c52e-49f1-9b46-09efd09fe52f", "name": "network-vif-deleted", "tag": "2aecae7b-472a-4f8c-a96d-ce83680c4f2f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:04.456698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:04.457375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8013f9b4-613c-4722-9854-066ccde1c3f1 req-501d6c48-efc9-4ac1-8a9b-10e4d3f68d89 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.457876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8013f9b4-613c-4722-9854-066ccde1c3f1 req-501d6c48-efc9-4ac1-8a9b-10e4d3f68d89 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.465225 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6ee6d50-c126-448b-9b8f-bcc979a19acf tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1468 microversion: 2.1 time: 0.355225 Mar 26 20:55:04.466373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 874/1879] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:04.471496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.473221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:04.479396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8013f9b4-613c-4722-9854-066ccde1c3f1 req-501d6c48-efc9-4ac1-8a9b-10e4d3f68d89 service nova] Creating event network-vif-deleted:2aecae7b-472a-4f8c-a96d-ce83680c4f2f for instance d951af70-c52e-49f1-9b46-09efd09fe52f on nch2-master-1 Mar 26 20:55:04.480014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.480542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.481581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.482252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.485109 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8013f9b4-613c-4722-9854-066ccde1c3f1 req-501d6c48-efc9-4ac1-8a9b-10e4d3f68d89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041475 Mar 26 20:55:04.485712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1006/1880] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:04.497469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f70d4821-ecac-4aa7-a416-c715224c3724 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ebf0280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.656867 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f70d4821-ecac-4aa7-a416-c715224c3724 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-03-26T20%3A53%3A07Z" status: 200 len: 1903 microversion: 2.1 time: 0.165288 Mar 26 20:55:04.668925 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1007/1881] 10.222.0.16 () {58 vars in 1198 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/images?changes-since=2022-03-26T20%3A53%3A07Z => generated 1903 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:04.683857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7087e94-2ed9-4bca-8a02-cb684d672024 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb2cc10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.690853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:04.705831 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6838301f-e15a-4046-8260-dad2f571c7db tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.237298 Mar 26 20:55:04.717038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 875/1882] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:04.744509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.745570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:04.759955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.760555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.761114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.761558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.807523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7087e94-2ed9-4bca-8a02-cb684d672024 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-242058790" status: 200 len: 484 microversion: 2.1 time: 0.128586 Mar 26 20:55:04.808487 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1008/1883] 10.222.0.16 () {58 vars in 1228 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-242058790 => generated 484 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:55:04.813144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:04.813897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:04.822078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.822864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.823395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lazy-loading 'fault' on Instance uuid d951af70-c52e-49f1-9b46-09efd09fe52f {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:04.841975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.842412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.843244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:04.843716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:04.872834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:04.880568 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a9b60ae-c2bf-4359-8cc7-6283fd2610dc tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 200 len: 1309 microversion: 2.1 time: 0.141876 Mar 26 20:55:04.887667 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 876/1884] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:04.887667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-152afec0-f8e8-4958-bf0d-09fcdb03d0f0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59b85820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.048384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-152afec0-f8e8-4958-bf0d-09fcdb03d0f0 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?server=e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 957 microversion: 2.1 time: 0.161305 Mar 26 20:55:05.049200 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 877/1885] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/images?server=e33401ac-938b-4afe-9405-e4fca20980de => generated 957 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.063173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.063943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.071101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.072086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.073229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.073745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.083500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.093870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da405a40-494f-4b9b-86f8-f5b734806f25 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.284226 Mar 26 20:55:05.095071 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1009/1886] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:04 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:05.099990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fec0ce68-11c8-4b8c-b230-13e73d4059df tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb7caf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.168844 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fec0ce68-11c8-4b8c-b230-13e73d4059df tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 485 microversion: 2.1 time: 0.072395 Mar 26 20:55:05.169827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.178267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.180011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.180777 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1010/1887] 10.222.0.16 () {58 vars in 1316 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.192133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6565708b-5638-41a9-ab25-47738c47156b tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.133601 Mar 26 20:55:05.193023 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 878/1888] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:05.198352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-faf3dee3-3931-4394-9e61-295ae055bedc tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5942b3a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.216596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.217226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.237381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.238232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.239686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.240430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.250601 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-faf3dee3-3931-4394-9e61-295ae055bedc tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 485 microversion: 2.1 time: 0.056423 Mar 26 20:55:05.257586 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 879/1889] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 485 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.267413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca5a2ee1-4164-4fe5-bd74-52b9f126289a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e591d2b80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.452413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.462425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-623912f5-4328-4108-bd77-ff44516ba803 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1504 microversion: 2.1 time: 0.280070 Mar 26 20:55:05.479676 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1011/1890] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:05.492396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4d75e154-5914-4370-8fe0-8fb9a3145193 req-5b6e3cc6-6327-4a39-b429-022b112a0d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-plugged", "status": "completed", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:05.503719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4d75e154-5914-4370-8fe0-8fb9a3145193 req-5b6e3cc6-6327-4a39-b429-022b112a0d11 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.504430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4d75e154-5914-4370-8fe0-8fb9a3145193 req-5b6e3cc6-6327-4a39-b429-022b112a0d11 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.517503 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4d75e154-5914-4370-8fe0-8fb9a3145193 req-5b6e3cc6-6327-4a39-b429-022b112a0d11 service nova] Creating event network-vif-plugged:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:55:05.521306 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca5a2ee1-4164-4fe5-bd74-52b9f126289a tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.262018 Mar 26 20:55:05.523402 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 880/1891] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:05.529227 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4d75e154-5914-4370-8fe0-8fb9a3145193 req-5b6e3cc6-6327-4a39-b429-022b112a0d11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042376 Mar 26 20:55:05.529978 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1012/1892] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.537850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.538760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.542755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '.version_select at 0x7f6e5eb7c310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.543772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.546741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.548300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.549330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.549995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.551737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.552222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.553254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.553913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.621806 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11e9f518-19e5-4db5-b2d2-47d2324442d3 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.089600 Mar 26 20:55:05.622620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1013/1893] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4/os-instance-actions => generated 611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.634192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19383d01-ae75-49b9-aeaa-2d0b52252dda tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb2c700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.713039 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19383d01-ae75-49b9-aeaa-2d0b52252dda tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.082762 Mar 26 20:55:05.720835 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1014/1894] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:05.727396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.728757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.741401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.742155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.743204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.748253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.774877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:05.805753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:05.814242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e585aaa1-275a-4164-b2c2-f68d345cbdad tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.287401 Mar 26 20:55:05.819947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 881/1895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:05.820231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d287cdcf-4425-4fd8-8956-ff3cf86e6345 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e596661f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.860927 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cbbd363-1286-4310-88b7-8f86dfc256de tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 204 len: 0 microversion: 2.1 time: 0.137475 Mar 26 20:55:05.865957 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1015/1896] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:05 2022] DELETE /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:05.878162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.878162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.884263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.884721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.891191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.893595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.909530 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d287cdcf-4425-4fd8-8956-ff3cf86e6345 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.093189 Mar 26 20:55:05.918509 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 882/1897] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:05.938918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:05.939563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:05.946189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.946696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:05.947741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:05.948606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.129707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.138508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08a27105-f78e-4243-90d6-416435a5e0a3 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.266258 Mar 26 20:55:06.139080 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1016/1898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.154324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.154324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: d951af70-c52e-49f1-9b46-09efd09fe52f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.154324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.154948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.155559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.156054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.173336 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] HTTP exception thrown: Instance d951af70-c52e-49f1-9b46-09efd09fe52f could not be found. Mar 26 20:55:06.173958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Returning 404 to user: Instance d951af70-c52e-49f1-9b46-09efd09fe52f could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:06.174812 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-321dd5c8-7d79-4aa4-aa62-de87330af5ec tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f" status: 404 len: 111 microversion: 2.1 time: 0.034296 Mar 26 20:55:06.175566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1017/1899] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/servers/d951af70-c52e-49f1-9b46-09efd09fe52f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:06.177972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.181515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79fbe102-2a9e-4965-a954-c291b3fddbef tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e58c91040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.188950 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e70d5624-3264-4e6a-892b-dfa8659b86dd tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1510 microversion: 2.1 time: 0.268409 Mar 26 20:55:06.199448 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 883/1900] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:05 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1510 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.204577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.205337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.213441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.213907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.214695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.215137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.323326 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79fbe102-2a9e-4965-a954-c291b3fddbef tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-03-26T20%3A53%3A01Z" status: 200 len: 6334 microversion: 2.1 time: 0.146757 Mar 26 20:55:06.328013 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1018/1901] 10.222.0.16 () {58 vars in 1219 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/images/detail?changes-since=2022-03-26T20%3A53%3A01Z => generated 6334 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.329337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.329947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.337521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.338265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.339196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.340429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.371381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:06.416591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.425045 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-842a05f1-e597-4805-a0fd-795d0ea07bce tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.224365 Mar 26 20:55:06.432185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 884/1902] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.433107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.433725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.440471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.440926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.441708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.442146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.475958 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58f27b06-11eb-4bed-a126-0d34a8a8a8fd tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 204 len: 0 microversion: 2.1 time: 0.149981 Mar 26 20:55:06.476762 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1019/1903] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:06 2022] DELETE /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:06.488098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-015f0b1b-2725-4eb2-80e7-e6b0ed817994 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e58c91dc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.528667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.538068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.539876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.547219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f78a361-ec25-47bd-a792-881728dcf136 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.118309 Mar 26 20:55:06.547853 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 885/1904] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:06.561008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.561637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.568050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.568729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.569526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.569975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.571188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-015f0b1b-2725-4eb2-80e7-e6b0ed817994 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-242058790" status: 200 len: 664 microversion: 2.1 time: 0.092357 Mar 26 20:55:06.572255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1020/1905] 10.222.0.16 () {58 vars in 1249 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-242058790 => generated 664 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:06.586952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca590c13-2010-4b05-8a9a-198dac2f0fa7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5ebf0e50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.744650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:06.765350 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb572c7b-3df7-413d-9e16-dcf5eec22c73 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1473 microversion: 2.1 time: 0.215922 Mar 26 20:55:06.766307 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 886/1906] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.802073 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca590c13-2010-4b05-8a9a-198dac2f0fa7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1467 microversion: 2.1 time: 0.213709 Mar 26 20:55:06.802073 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1021/1907] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1467 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.810058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6ec52ffd-1ac4-4a2f-b0d7-3f83a2c5c98b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59652160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.832318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:06.833511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:06.854757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.855299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.856181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:06.856630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:06.869184 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6ec52ffd-1ac4-4a2f-b0d7-3f83a2c5c98b tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1467 microversion: 2.1 time: 0.063484 Mar 26 20:55:06.878234 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 887/1908] 10.222.0.16 () {58 vars in 1323 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1467 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:06.883492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-07ef6696-fc3e-443e-95ee-4d3295b6f437 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5942bb80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.050638 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-07ef6696-fc3e-443e-95ee-4d3295b6f437 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.170955 Mar 26 20:55:07.067064 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 888/1909] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.079744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.080038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f792347-8ad5-47f6-a209-ae60e27ca907 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e591d2160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.082803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cdd9fa7f-9d5b-4fd5-bc32-8fe34871f533 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1316 microversion: 2.1 time: 0.254681 Mar 26 20:55:07.091225 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1022/1910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:06 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.154049 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f792347-8ad5-47f6-a209-ae60e27ca907 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.085479 Mar 26 20:55:07.154899 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 889/1911] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.171452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bde17386-676f-4c2f-ab0f-0ff768db432d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59b7c040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.173926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.174628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:07.183547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.184098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.184896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.185340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.224372 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bde17386-676f-4c2f-ab0f-0ff768db432d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb" status: 200 len: 784 microversion: 2.1 time: 0.057607 Mar 26 20:55:07.225243 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 890/1912] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:07.238155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.238861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:07.245837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.246379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.247236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.247752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.391153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.403425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46da7e23-34a9-4db4-a538-99ba3159ecd4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.246506 Mar 26 20:55:07.404589 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1023/1913] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.409814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a7a71ed-4c19-4419-a27d-6c04eb931ba3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e58c91f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.449037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.458022 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e84c505-8611-42e6-bb39-cab3925b1457 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1510 microversion: 2.1 time: 0.224296 Mar 26 20:55:07.458918 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 891/1914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.465396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.466361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:07.473058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.473609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.474482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.475009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.505823 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a7a71ed-4c19-4419-a27d-6c04eb931ba3 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.099295 Mar 26 20:55:07.506690 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1024/1915] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.519437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea899dd6-c060-4733-bc51-4c24aef68544 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e58c91b80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.642278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.651024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29461d37-c3ee-4f4b-a721-47f7d5e0939a tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1317 microversion: 2.1 time: 0.189396 Mar 26 20:55:07.651621 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 892/1916] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:07.663418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-unplugged", "status": "completed", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}, {"server_uuid": "5e559cd6-163d-4e56-889f-574746da5d5b", "name": "network-vif-plugged", "status": "completed", "tag": "63ba9525-82f3-4e19-a0c3-0d361b9ac813"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:07.673841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.675372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.697366 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] Creating event network-vif-unplugged:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:55:07.699593 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] Creating event network-vif-plugged:63ba9525-82f3-4e19-a0c3-0d361b9ac813 for instance 5e559cd6-163d-4e56-889f-574746da5d5b on nch2-master-1 Mar 26 20:55:07.709558 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3db11e5c-5407-4896-8cd2-d8a762e6a60f req-ead94c9f-787a-4fc1-98bb-15ecd037605e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056376 Mar 26 20:55:07.710358 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 893/1917] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:07.716873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.717547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:07.724559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.725026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.725817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.726269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.805416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.814697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.818073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:07.826882 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-215e27cd-c18f-4323-8ff5-4e0eed6ee959 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.114951 Mar 26 20:55:07.828477 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 894/1918] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:07.833491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:07.834377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:07.842419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.843196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:07.844269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:07.844917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:08.046085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1109e52939e48759e11f26461e05a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de3ee23ad854cd3aed820396ed8bd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:08.054844 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90041e44-198d-4ca5-a147-1fb37a966f6d tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 200 len: 1473 microversion: 2.1 time: 0.224903 Mar 26 20:55:08.055639 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 895/1919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:07 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:08.102265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:08.103415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:08.116845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:08.117304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:08.118093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:08.119314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:08.362130 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea899dd6-c060-4733-bc51-4c24aef68544 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767" status: 204 len: 0 microversion: 2.1 time: 0.846593 Mar 26 20:55:08.362702 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1025/1920] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:07 2022] DELETE /compute/v2.1/images/79607247-7746-487d-9389-11c5b6ae1767 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:08.370646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e392cc7-7c79-4947-97e2-f4ce3d808740 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb2c790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:08.423690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:08.443341 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88e6d14f-1876-41ee-b585-3beb121c4414 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1466 microversion: 2.1 time: 0.345035 Mar 26 20:55:08.451217 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 896/1921] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:08 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:08.461357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:08.462080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:08.477886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:08.481268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:08.482174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:08.483113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:08.977158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:08.984737 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41f12742-d833-4523-87ed-122bad0356bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.532367 Mar 26 20:55:08.987157 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 897/1922] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:08 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:09.007955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-777826457", "metadata": {"image_type": "test"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:09.010081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:09.022260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.023215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.025564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.026033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.106799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Getting quotas for project b2f47185eafd43c3a0a4a7cbfb9d679d. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:09.112509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Getting quotas for user 864b039c62424775834b1294a6725d80 and project b2f47185eafd43c3a0a4a7cbfb9d679d. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:09.229362 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e392cc7-7c79-4947-97e2-f4ce3d808740 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b" status: 204 len: 0 microversion: 2.1 time: 0.862287 Mar 26 20:55:09.230287 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1026/1923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:08 2022] DELETE /compute/v2.1/images/5368c78c-df89-4a85-8248-4d433976e02b => generated 0 bytes in 864 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:55:09.235568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:09.236496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:09.253192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.253906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.254925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.255578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.297798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.298645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.299316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lazy-loading 'fault' on Instance uuid 6f1e06b9-61a3-4b19-805d-42475235c1e4 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:09.392773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e5b428b7b341a5a253addfd9493158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032c3519ef0d4b99891f8fe4e48a2fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:09.404156 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e8c40a9-794d-4e44-9fdd-bff008d2a4b4 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 200 len: 1305 microversion: 2.1 time: 0.172582 Mar 26 20:55:09.414880 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1027/1924] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:09 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:09.437790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:09.440085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:09.457056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.458512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.461321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.464283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.599174 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-28349f83-182c-44d6-b48a-7a9ead48cfb3 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "POST /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5/action" status: 202 len: 0 microversion: 2.1 time: 0.608440 Mar 26 20:55:09.599830 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 898/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:55:08 2022] POST /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:55:09.642067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a208bf06-63c4-47ad-a12c-e61d7aa5beb5 req-ff7809ae-2f33-4f19-82b3-a392f8b463b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e06b9-61a3-4b19-805d-42475235c1e4", "name": "network-vif-deleted", "tag": "1df11505-f619-4383-bdf2-f2c503680a3f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:09.663314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a208bf06-63c4-47ad-a12c-e61d7aa5beb5 req-ff7809ae-2f33-4f19-82b3-a392f8b463b4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.666229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a208bf06-63c4-47ad-a12c-e61d7aa5beb5 req-ff7809ae-2f33-4f19-82b3-a392f8b463b4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.704048 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a208bf06-63c4-47ad-a12c-e61d7aa5beb5 req-ff7809ae-2f33-4f19-82b3-a392f8b463b4 service nova] Creating event network-vif-deleted:1df11505-f619-4383-bdf2-f2c503680a3f for instance 6f1e06b9-61a3-4b19-805d-42475235c1e4 on nch2-master-1 Mar 26 20:55:09.719240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a208bf06-63c4-47ad-a12c-e61d7aa5beb5 req-ff7809ae-2f33-4f19-82b3-a392f8b463b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093065 Mar 26 20:55:09.722152 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 899/1926] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:09.742411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:09.743304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:09.758511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.759840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.760749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.761370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.831541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:09.838311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:09.839838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a060e3f0-b129-4a14-a346-7ed94e18e323 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1506 microversion: 2.1 time: 0.422457 Mar 26 20:55:09.841195 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1028/1927] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:09 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:09.846553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-28bd2af8-96ee-4bf9-ba81-393570e7fa6c req-0072fdbe-3f2e-45b7-9eac-67f962a33639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219ff1d8-95f5-4514-a2d8-a010ecdd1289", "name": "network-vif-deleted", "tag": "61358ffa-a2dd-4354-a24e-4e1a7782c3c8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:09.849329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:09.850917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:09.856743 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-069ea9d5-795e-432e-a7bd-2c3439828b95 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.130198 Mar 26 20:55:09.857380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-28bd2af8-96ee-4bf9-ba81-393570e7fa6c req-0072fdbe-3f2e-45b7-9eac-67f962a33639 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.857836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-28bd2af8-96ee-4bf9-ba81-393570e7fa6c req-0072fdbe-3f2e-45b7-9eac-67f962a33639 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.858170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 900/1928] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:09 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:09.867664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:09.869109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] [instance: 219ff1d8-95f5-4514-a2d8-a010ecdd1289] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:09.876189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.876895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.877925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:09.878551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:09.882347 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-28bd2af8-96ee-4bf9-ba81-393570e7fa6c req-0072fdbe-3f2e-45b7-9eac-67f962a33639 service nova] Creating event network-vif-deleted:61358ffa-a2dd-4354-a24e-4e1a7782c3c8 for instance 219ff1d8-95f5-4514-a2d8-a010ecdd1289 on nch1-master-1 Mar 26 20:55:09.888094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-28bd2af8-96ee-4bf9-ba81-393570e7fa6c req-0072fdbe-3f2e-45b7-9eac-67f962a33639 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045603 Mar 26 20:55:09.888862 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1029/1929] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:09.893956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad0fa12f-1eb1-48dc-b0b6-aca607004e74 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e5eb2cdc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:09.894575 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] HTTP exception thrown: Instance 219ff1d8-95f5-4514-a2d8-a010ecdd1289 could not be found. Mar 26 20:55:09.895198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] Returning 404 to user: Instance 219ff1d8-95f5-4514-a2d8-a010ecdd1289 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:09.896079 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fad037b5-9091-4e3d-874c-af91f316bd13 tempest-LiveMigrationNegativeTest-266956686 tempest-LiveMigrationNegativeTest-266956686-project] 10.222.0.16 "GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289" status: 404 len: 111 microversion: 2.1 time: 0.036717 Mar 26 20:55:09.899890 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 901/1930] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:09 2022] GET /compute/v2.1/servers/219ff1d8-95f5-4514-a2d8-a010ecdd1289 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:09.906945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0a3d304-721a-4362-93ed-502c3e433226 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e591d28b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.576026 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad0fa12f-1eb1-48dc-b0b6-aca607004e74 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d" status: 204 len: 0 microversion: 2.1 time: 0.686021 Mar 26 20:55:10.576602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1030/1931] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:09 2022] DELETE /compute/v2.1/images/ed0b9758-bf89-4445-b539-88ec6363d41d => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:10.585902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.586802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:10.608365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.609922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.610749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.611204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.651264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0a3d304-721a-4362-93ed-502c3e433226 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.750037 Mar 26 20:55:10.657134 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1f121de-f42b-4aa6-bc40-610f9795199f tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips" status: 200 len: 109 microversion: 2.1 time: 0.079126 Mar 26 20:55:10.658388 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1031/1933] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:55:10 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips => generated 109 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:10.665693 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 902/1933] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:09 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:10.668820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.671214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:10.676850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.678667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.679636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.680526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] [instance: 6f1e06b9-61a3-4b19-805d-42475235c1e4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:10.681726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.682391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.692239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.692699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.693711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.694369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.714858 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] HTTP exception thrown: Instance 6f1e06b9-61a3-4b19-805d-42475235c1e4 could not be found. Mar 26 20:55:10.716336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] Returning 404 to user: Instance 6f1e06b9-61a3-4b19-805d-42475235c1e4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:10.717954 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c14b2366-b4c6-428f-904c-49adb170c256 tempest-InstanceActionsTestJSON-728623544 tempest-InstanceActionsTestJSON-728623544-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4" status: 404 len: 111 microversion: 2.1 time: 0.050852 Mar 26 20:55:10.722311 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 903/1934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:10 2022] GET /compute/v2.1/servers/6f1e06b9-61a3-4b19-805d-42475235c1e4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:10.730533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.731373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:10.739823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.740709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.741761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.742427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.777422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:10.892449 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d833f6bb-a960-43b5-aba8-cd5b81de8346 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 204 len: 0 microversion: 2.1 time: 0.167081 Mar 26 20:55:10.896551 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 904/1935] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:10 2022] DELETE /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:10.911162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:10.912661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:10.924839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.925303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.932129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:10.932730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:10.983749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99757fd8-b9a2-4cd6-a585-cfb62e29e70b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips" status: 200 len: 109 microversion: 2.1 time: 0.088596 Mar 26 20:55:10.990330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 905/1936] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:55:10 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips => generated 109 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:10.997696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.000702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:11.009837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.011132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.011944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.012436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.027298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.039498 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-389dd26c-13c2-40f4-a842-8832c564eb51 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.375363 Mar 26 20:55:11.040366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1032/1937] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:10 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:11.047078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.049978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:11.059367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.060633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.062491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.063687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.114129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.123477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.129828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.143281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2c3115e-01c3-4976-a53b-d0d209aaaf3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.151438 Mar 26 20:55:11.156074 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 906/1938] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:10 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:11.167870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.168544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:11.174925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.175587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.183518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.184135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.243841 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-867183fe-e1e8-4fc5-b619-5168941ba7ea tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips/tempest-ServerAddressesTestJSON-842463399-network" status: 200 len: 94 microversion: 2.1 time: 0.096836 Mar 26 20:55:11.250378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 907/1939] 10.222.0.16 () {58 vars in 1397 bytes} [Sat Mar 26 20:55:11 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b/ips/tempest-ServerAddressesTestJSON-842463399-network => generated 94 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:55:11.256644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.257148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:11.264248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.264699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.265638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.266084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.295134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:11.340863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.354996 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00bbd1f7-16d2-4dc2-b80e-2a8cabad101e tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1474 microversion: 2.1 time: 0.311357 Mar 26 20:55:11.371057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1033/1940] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:11 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:11.419605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17a76d77-c9af-484a-96a0-5519f0dbec96 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 204 len: 0 microversion: 2.1 time: 0.167030 Mar 26 20:55:11.424117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 908/1941] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:11 2022] DELETE /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:11.430093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.431596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:11.438091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.438818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.439732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:11.440370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:11.638243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:11.646484 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1af4d8c4-4070-44d7-99cf-f452556df87b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1512 microversion: 2.1 time: 0.221629 Mar 26 20:55:11.659323 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1034/1942] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:11 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:11.665768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-acf4eed0-6bf5-46bd-8b6e-f923eeff7d25 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5942b9d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:11.732181 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-acf4eed0-6bf5-46bd-8b6e-f923eeff7d25 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.070697 Mar 26 20:55:11.732764 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 909/1943] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:11 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:12.058812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:12.059357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:12.066095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.066872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.067839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.068319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.164558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:12.165504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:12.174118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.176088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.177129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.177651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.307689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.314462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.324034 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d26d07b0-4576-47f1-8762-64322e2da38c tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.269554 Mar 26 20:55:12.336288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.339355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.346483 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1035/1944] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:12 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:12.358697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d839bb33-cda2-4336-871d-a4da63834d2f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.198484 Mar 26 20:55:12.359313 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 910/1945] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:12 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:12.375792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:12.376540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:12.385193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.385654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.386447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.386923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.575109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.585581 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37d28510-b04a-4097-8278-20ed9ec1575d tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1474 microversion: 2.1 time: 0.214669 Mar 26 20:55:12.586176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1036/1946] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:12 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1474 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:12.668865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:12.670607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:12.682082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.682545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.683342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:12.683790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:12.745521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82bd39ec-aec6-44a9-a5e1-0bf4b9799737 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c915e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:12.856437 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82bd39ec-aec6-44a9-a5e1-0bf4b9799737 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.115207 Mar 26 20:55:12.863091 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1037/1947] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:12 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:12.932300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:12.940079 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e001a9b9-3ec1-408c-8b9b-25521bc39885 tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1512 microversion: 2.1 time: 0.277268 Mar 26 20:55:12.943163 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 911/1948] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:12 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:13.353018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:13.354153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:13.365857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.370404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.371523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.372201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.381513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:13.382126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:13.399693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.407322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.411887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.414777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.844087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:13.857971 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-056f2407-2f8e-45ac-a748-8ae2ea774ef4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.506434 Mar 26 20:55:13.861008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1038/1949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:13 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:13.873864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:13.874531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:13.884696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:13.895529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:13.906742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:13.919952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.920729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.930416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:13.934627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:13.939078 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-258ea78d-6e03-48ca-a535-e6920833d162 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.560004 Mar 26 20:55:13.943154 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 912/1950] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:13 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 20:55:13.967443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b266c72-d157-4ec8-b19e-17246c4cca40 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e590afc10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:14.342411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:14.350631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3e50dce-5e96-4de7-be37-b28d3480c9af tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 200 len: 1474 microversion: 2.1 time: 0.488385 Mar 26 20:55:14.355388 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1039/1951] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:13 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:14.369155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:14.370138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:14.390190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:14.391027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:14.392320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:14.395886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:14.687635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6067a3bcd1e4ccb808323697704fea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1854d29eeb64bb4b5851d72ac8dddab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:14.696308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcaee9e3-05eb-4b74-90b8-efcece76f5fe tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 200 len: 1512 microversion: 2.1 time: 0.339481 Mar 26 20:55:14.715294 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1040/1952] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:14 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:14.721419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c2b675a8-3541-45a8-9212-ae241447cf56 req-3cb54e2e-3921-4c37-8114-dd12994ab95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d23ce7-becf-4a04-bf7e-36f8c0329a53", "name": "network-vif-deleted", "tag": "2b326ee0-26a1-418e-8493-4f045fa716a8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:14.741961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c2b675a8-3541-45a8-9212-ae241447cf56 req-3cb54e2e-3921-4c37-8114-dd12994ab95d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:14.742726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c2b675a8-3541-45a8-9212-ae241447cf56 req-3cb54e2e-3921-4c37-8114-dd12994ab95d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:14.766924 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c2b675a8-3541-45a8-9212-ae241447cf56 req-3cb54e2e-3921-4c37-8114-dd12994ab95d service nova] Creating event network-vif-deleted:2b326ee0-26a1-418e-8493-4f045fa716a8 for instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 on nch2-master-1 Mar 26 20:55:14.778817 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c2b675a8-3541-45a8-9212-ae241447cf56 req-3cb54e2e-3921-4c37-8114-dd12994ab95d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061786 Mar 26 20:55:14.784020 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1041/1953] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:15.033969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fb7fc78-0031-4378-88a5-611ee54609b1 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Calling method '.version_select at 0x7f6e5926a700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:15.149087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fb7fc78-0031-4378-88a5-611ee54609b1 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 371 microversion: 2.1 time: 0.363375 Mar 26 20:55:15.158781 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1042/1954] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:55:14 2022] GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:15.165193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:15.166555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:15.193708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.194179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.195399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.195846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.593498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:15.606803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c75cc87-2218-4987-8171-71226b6cbe54 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1510 microversion: 2.1 time: 0.446680 Mar 26 20:55:15.608196 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1043/1955] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:15 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:15.613061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-898fee91-6cdc-4401-a06a-a8b83e1ee3a3 req-8ed33be7-4af0-4cc6-94b8-cdba9a1aaf68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e559cd6-163d-4e56-889f-574746da5d5b", "name": "network-vif-deleted", "tag": "63ba9525-82f3-4e19-a0c3-0d361b9ac813"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:15.639029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-898fee91-6cdc-4401-a06a-a8b83e1ee3a3 req-8ed33be7-4af0-4cc6-94b8-cdba9a1aaf68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.645934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-898fee91-6cdc-4401-a06a-a8b83e1ee3a3 req-8ed33be7-4af0-4cc6-94b8-cdba9a1aaf68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.667498 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-898fee91-6cdc-4401-a06a-a8b83e1ee3a3 req-8ed33be7-4af0-4cc6-94b8-cdba9a1aaf68 service nova] Creating event network-vif-deleted:63ba9525-82f3-4e19-a0c3-0d361b9ac813 for instance 5e559cd6-163d-4e56-889f-574746da5d5b on nch2-master-1 Mar 26 20:55:15.685673 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-898fee91-6cdc-4401-a06a-a8b83e1ee3a3 req-8ed33be7-4af0-4cc6-94b8-cdba9a1aaf68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075906 Mar 26 20:55:15.689243 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1044/1956] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:15.701086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:15.703451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:15.726148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.726904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.728501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.729111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.859642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:15.872298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:15.876960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:15.895063 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45b0e64f-22d6-4611-9093-8c09786a57f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.203985 Mar 26 20:55:15.896520 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1045/1957] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:15 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:15.908775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6e1d553a-5b0b-4320-ac64-8d509b35a707 req-386dbea2-817b-485d-81f2-19dd237c6a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-plugged", "status": "completed", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:15.932216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6e1d553a-5b0b-4320-ac64-8d509b35a707 req-386dbea2-817b-485d-81f2-19dd237c6a21 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:15.932995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6e1d553a-5b0b-4320-ac64-8d509b35a707 req-386dbea2-817b-485d-81f2-19dd237c6a21 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:15.963227 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6e1d553a-5b0b-4320-ac64-8d509b35a707 req-386dbea2-817b-485d-81f2-19dd237c6a21 service nova] Creating event network-vif-plugged:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:55:15.976557 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6e1d553a-5b0b-4320-ac64-8d509b35a707 req-386dbea2-817b-485d-81f2-19dd237c6a21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077098 Mar 26 20:55:15.981096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1046/1958] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:15.997552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5926aca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:16.136426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.139971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.144534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.145385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.268753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27c1bce8-b5c8-42d2-9a7e-b92d4be8319a tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 328 microversion: 2.1 time: 0.285867 Mar 26 20:55:16.270129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1047/1959] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:15 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:16.275582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:16.276657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: 46d23ce7-becf-4a04-bf7e-36f8c0329a53] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:16.283710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.284915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.286024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.286863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.303341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] HTTP exception thrown: Instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 could not be found. Mar 26 20:55:16.304363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Returning 404 to user: Instance 46d23ce7-becf-4a04-bf7e-36f8c0329a53 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:16.305904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07998157-84de-4e96-bf57-4083a5286ad7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53" status: 404 len: 111 microversion: 2.1 time: 0.034384 Mar 26 20:55:16.306697 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1048/1960] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:16 2022] GET /compute/v2.1/servers/46d23ce7-becf-4a04-bf7e-36f8c0329a53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:16.311970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:16.312920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] [instance: 5e559cd6-163d-4e56-889f-574746da5d5b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:16.320871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.322264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.323713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:16.324481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:16.340163 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] HTTP exception thrown: Instance 5e559cd6-163d-4e56-889f-574746da5d5b could not be found. Mar 26 20:55:16.341238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] Returning 404 to user: Instance 5e559cd6-163d-4e56-889f-574746da5d5b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:16.342422 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-338fb22f-329e-4b21-a366-96d382a0f47b tempest-ServerAddressesTestJSON-562564718 tempest-ServerAddressesTestJSON-562564718-project] 10.222.0.16 "GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b" status: 404 len: 111 microversion: 2.1 time: 0.034360 Mar 26 20:55:16.343187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1049/1961] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:16 2022] GET /compute/v2.1/servers/5e559cd6-163d-4e56-889f-574746da5d5b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:16.466847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1684463213", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "689923c6-d181-40c6-8164-9bea9c00ea2d"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:22.106507 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8b266c72-d157-4ec8-b19e-17246c4cca40 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 8.162247 Mar 26 20:55:22.107185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 913/1962] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:13 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 8163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:22.112278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:22.113064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:22.116155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] validate_networks() for [('689923c6-d181-40c6-8164-9bea9c00ea2d', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:22.120768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.121406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.124054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.124811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.151420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:22.261788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba409ace-6e59-4499-9870-3824517e3c53 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 204 len: 0 microversion: 2.1 time: 0.146072 Mar 26 20:55:22.262472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 914/1963] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:22 2022] DELETE /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:22.476414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-101991262", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:22.535201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:22.582816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:22.583523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:22.584050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:22.584466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:22.585109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:22.597273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.597765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.601515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.602994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.626533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Getting quotas for project 6fee503421884a52b75aae2ae940aad0. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:22.635732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Getting quotas for user c8d2e97047c1481eb9916e203d2d8cba and project 6fee503421884a52b75aae2ae940aad0. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:22.654736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:22.657664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:22.721157 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a6cd98b-9083-4261-898a-c978660463d6 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 6.376351 Mar 26 20:55:22.727344 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1050/1964] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 6383 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 20:55:22.740221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:22.741135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:22.749118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.749804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.750805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.751665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.794751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:22.795167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:22.795720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:22.798485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:22.799017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:22.813639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.814101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.814909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.815350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.834938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:22.844605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for user 80c37dca7eb34ef096e6d9093ad313b9 and project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:22.867016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.utils [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] cores quota exceeded for 7cc0a8152d814a5590cbc9be7c230181, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141580) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 26 20:55:22.868513 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Mar 26 20:55:22.869987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:22.871498 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-622f308f-9a51-4d56-a05d-cd788f764e21 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.607927 Mar 26 20:55:22.872608 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 915/1965] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:22 2022] POST /compute/v2.1/servers => generated 111 bytes in 609 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:22.880640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:22.881560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:22.889720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.890520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.891497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:22.892366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:22.940362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:22.958475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65bc4bcd-c293-49b9-a860-790e4be96bbc tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1487 microversion: 2.1 time: 0.229164 Mar 26 20:55:22.960004 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1051/1966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:22 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1487 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:22.964484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:22.972956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:22.974483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:22.982296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4770edfe-f4ef-4d2c-a830-061e51f276ce tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.108437 Mar 26 20:55:22.982885 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 916/1967] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:22 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:23.067193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: .version_select at 0x7f6e5ebf03a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-282809446", "policies": ["affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:23.096628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.102384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.168823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.178457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.192786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad85446f-a0ff-4f55-9b28-998204555b80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.231820 Mar 26 20:55:23.193657 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1052/1968] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 20:55:22 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:23.199566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:23.200299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:23.206979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.207516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.208548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.209135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.213701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Action: 'create', calling method: .version_select at 0x7f6e590afaf0>, body: {"keypair": {"name": "tempest-keypair-1075983386"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:23.234881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.241934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for user 57e806dbaedc49e395b7d6b374ca2fec and project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.384721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:23.393165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65fa35b9-95cd-43e3-82c2-1ea5af1992a2 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1474 microversion: 2.1 time: 0.198709 Mar 26 20:55:23.393866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1053/1969] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:23 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1474 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:23.398676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:23.399441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:23.409602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.410326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.411283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.411900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.450042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.456982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for user 57e806dbaedc49e395b7d6b374ca2fec and project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.474478 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c793e0ff-a751-40be-aea3-01b93b75e9b7 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.480419 Mar 26 20:55:23.474478 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 917/1970] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:23.484141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e597253a0>, body: {"quota_set": {"cores": 20}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:23.489835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:23.503684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:23.508128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:23.510723 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7ffae92-2a43-4fff-9ed8-5a1ea803a0c7 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1263 microversion: 2.21 time: 0.115700 Mar 26 20:55:23.513595 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1054/1971] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:23 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1263 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:23.522687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-611918675"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:23.524649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:23.550373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.550832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.557509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.557980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.666193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b88ac404-9bd7-4e77-9acf-6de5baeba161 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "PUT /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1059 microversion: 2.1 time: 0.150175 Mar 26 20:55:23.668191 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1055/1972] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 20:55:23 2022] PUT /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1059 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:23.675583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfa527d5-e96a-440c-8afb-731f0f06d13c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58cc50d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:23.732651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.732807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfa527d5-e96a-440c-8afb-731f0f06d13c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.063038 Mar 26 20:55:23.733377 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1056/1973] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:23 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:23.734866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.736977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.737770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.744782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: .version_select at 0x7f6e5ebf01f0>, body: {"server_group": {"name": "tempest-server-group-1915288312", "policies": ["affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:23.767448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.775842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.817666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd72bcef-36c2-4b2f-9d4a-aa5f32706269 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 329 microversion: 2.1 time: 0.336973 Mar 26 20:55:23.818800 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 918/1974] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:23 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 329 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:23.827574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:23.828593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:23.843570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.844147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.845054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:23.845534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:23.864203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:23.872363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:23.905066 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c095148-b6d4-49e5-9602-5bf1505f45d7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.170768 Mar 26 20:55:23.905850 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1057/1975] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 20:55:23 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:23.921342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ded466f9-036c-4eec-b45f-601e9bf7f4f8 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Calling method '.version_select at 0x7f6e5eb7cf70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.083504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.087876 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ded466f9-036c-4eec-b45f-601e9bf7f4f8 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 371 microversion: 2.1 time: 0.172954 Mar 26 20:55:24.093970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1058/1976] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:55:23 2022] GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:24.099387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: .version_select at 0x7f6e58cc5c10>, body: {"server_group": {"name": "tempest-server-group-1915288312", "policies": ["affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:24.104473 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2838db59-546b-442d-84c1-35546358d575 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1486 microversion: 2.1 time: 0.282567 Mar 26 20:55:24.106433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 919/1977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:23 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1486 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:24.117085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.118082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:24.132067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.132925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.134759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.135301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.154844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:24.172642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:24.270356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:24.278081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:24.292253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.302136 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8ce03cb-e80b-42dd-a795-89d0707ffdc4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.206972 Mar 26 20:55:24.302920 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1059/1978] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 20:55:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:24.309893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e58cc5310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:24.322326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.324228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.344920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-55d9d09f-a61b-4121-b608-43ba153bf7f3 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.236654 Mar 26 20:55:24.348029 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 920/1979] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:24 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:24.362617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.363314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:24.375442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.375898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.376703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.377139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.410813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.411274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.412131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.412575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.526903 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93383af7-e528-496e-837f-f6a89e3483a2 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 328 microversion: 2.1 time: 0.221124 Mar 26 20:55:24.528747 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1060/1980] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:24 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 328 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:24.534071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e99587d3-26fe-4580-a373-0f5b8c94e999 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.628270 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e99587d3-26fe-4580-a373-0f5b8c94e999 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/21502234-9196-4ca8-94a7-06fc00ed0987" status: 204 len: 0 microversion: 2.1 time: 0.098237 Mar 26 20:55:24.632490 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1061/1981] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:24 2022] DELETE /compute/v2.1/os-server-groups/21502234-9196-4ca8-94a7-06fc00ed0987 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:24.640731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.641365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:24.651019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.651405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.652335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.652777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.776050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.784059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8354adb9-0b49-44d7-b407-3ab41e0d59f4 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1486 microversion: 2.1 time: 0.434474 Mar 26 20:55:24.784674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 921/1982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:24 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1486 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:24.789990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:24.790859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:24.802506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.802506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.805179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:24.805179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:24.904929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.918207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.922413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:24.925522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b63f21b8-cd20-4c06-9b5c-23490083755f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1317 microversion: 2.21 time: 0.139821 Mar 26 20:55:24.928815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 922/1983] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:24 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:24.942880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-735104055", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:25.015677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:25.244462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493cfcb9e1b744aaba45b2a48c7306f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739cffc409bf4c9b831ae68701acafb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:25.255595 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2773ec74-64d7-40e1-931f-544d60d02942 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 200 len: 1474 microversion: 2.1 time: 0.622141 Mar 26 20:55:25.256793 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1062/1984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:24 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 1474 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:25.263055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d085ba8b-14f6-44e4-82c9-02484bff278e tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.292919 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d085ba8b-14f6-44e4-82c9-02484bff278e tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.034777 Mar 26 20:55:25.293709 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1063/1985] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:55:25 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:25.307848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f40d027-4636-4c58-9380-48e7a98cfead tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58cc5280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.362459 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f40d027-4636-4c58-9380-48e7a98cfead tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.061027 Mar 26 20:55:25.363464 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1064/1986] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:25 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:25.370130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.370931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:25.378048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.378882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.379866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.380488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.424936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:25.503813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:25.505204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:25.506133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:25.506999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:25.507631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:25.544474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.547149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.548244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.548697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.592513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:25.599741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for user 80c37dca7eb34ef096e6d9093ad313b9 and project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:25.610161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-caf3e63d-8d06-4e8a-8ea9-bfa4967420a1 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 204 len: 0 microversion: 2.1 time: 0.245079 Mar 26 20:55:25.610994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1065/1987] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:25 2022] DELETE /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:25.620388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.utils [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] instances quota exceeded for 7cc0a8152d814a5590cbc9be7c230181, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141580) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 26 20:55:25.621221 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Mar 26 20:55:25.621886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:25.624319 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe1e4155-b0e2-44ef-a748-85e02f114956 tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.686031 Mar 26 20:55:25.624768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-05e8532e-995a-4ed2-90c6-5f92c4213278 req-ca19b555-172f-4395-97ba-a2817772aca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33401ac-938b-4afe-9405-e4fca20980de", "name": "network-vif-deleted", "tag": "5f93aa05-948a-4603-ac9e-ad8d14873f3f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:25.624965 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 923/1988] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:24 2022] POST /compute/v2.1/servers => generated 119 bytes in 697 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:25.630110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-179daf3d-82a3-4f03-bdc6-523b78d2cc51 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.658265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05e8532e-995a-4ed2-90c6-5f92c4213278 req-ca19b555-172f-4395-97ba-a2817772aca4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.658974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05e8532e-995a-4ed2-90c6-5f92c4213278 req-ca19b555-172f-4395-97ba-a2817772aca4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.674180 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-05e8532e-995a-4ed2-90c6-5f92c4213278 req-ca19b555-172f-4395-97ba-a2817772aca4 service nova] Creating event network-vif-deleted:5f93aa05-948a-4603-ac9e-ad8d14873f3f for instance e33401ac-938b-4afe-9405-e4fca20980de on nch1-master-1 Mar 26 20:55:25.680273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-05e8532e-995a-4ed2-90c6-5f92c4213278 req-ca19b555-172f-4395-97ba-a2817772aca4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067860 Mar 26 20:55:25.681145 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1066/1989] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:25.691215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.692026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:25.696197 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-179daf3d-82a3-4f03-bdc6-523b78d2cc51 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/3c6913a0-e041-426b-9eb8-2069a156176e" status: 204 len: 0 microversion: 2.1 time: 0.069811 Mar 26 20:55:25.700890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.700890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.701519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.701799 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 924/1990] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:25 2022] DELETE /compute/v2.1/os-server-groups/3c6913a0-e041-426b-9eb8-2069a156176e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:25.701989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.710386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:25.711334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:25.721242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.722402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.723843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.725130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.815494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:25.824573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:25.826156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:25.831375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53c7cd0d-8f27-4821-95b6-8eb0aed0835a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.145648 Mar 26 20:55:25.843952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1067/1991] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:25 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:25.843952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5eb60dc0>, body: {"quota_set": {"instances": 10}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:25.916883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.918163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.920197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:25.921039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:25.996318 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0193132-7d04-4d4d-9adb-d5e302065a3b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 329 microversion: 2.1 time: 0.162598 Mar 26 20:55:25.997169 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1068/1992] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:25 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 329 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:26.004277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33e764fb-37d0-402f-a282-36245316925f tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:26.022375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33e764fb-37d0-402f-a282-36245316925f tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023903 Mar 26 20:55:26.029342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1069/1993] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:55:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:26.034252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:26.035728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:26.045043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.045043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.046026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.046734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.109495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:26.120724 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fd4cc44c-760d-4a0a-a040-622bc5dfc867 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1492 microversion: 2.1 time: 0.414048 Mar 26 20:55:26.121448 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 925/1994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:25 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1492 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:26.131590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b1f67812-3614-4f03-924e-5e19de6d2dfe tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Calling method '.version_select at 0x7f6e5904fa60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:26.281602 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b1f67812-3614-4f03-924e-5e19de6d2dfe tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 371 microversion: 2.1 time: 0.159011 Mar 26 20:55:26.287609 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 926/1995] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:55:26 2022] GET /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:26.289750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:26.295950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: .version_select at 0x7f6e590af0d0>, body: {"server_group": {"name": "tempest-server-group-530597647", "policies": ["affinity"]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:26.302185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:26.303707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:26.306481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dae8437f-6dd9-4453-9591-ae4df4afe142 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.281652 Mar 26 20:55:26.311978 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1070/1996] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:26 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:26.320753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:26.323901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] [instance: e33401ac-938b-4afe-9405-e4fca20980de] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:26.333410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.333864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.335314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.336016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.338332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:26.345347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:26.354573 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] HTTP exception thrown: Instance e33401ac-938b-4afe-9405-e4fca20980de could not be found. Mar 26 20:55:26.358624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Returning 404 to user: Instance e33401ac-938b-4afe-9405-e4fca20980de could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:26.359624 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2e4d329-b079-46ed-baba-86f0313fd0b7 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de" status: 404 len: 111 microversion: 2.1 time: 0.051805 Mar 26 20:55:26.363525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1071/1997] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:26 2022] GET /compute/v2.1/servers/e33401ac-938b-4afe-9405-e4fca20980de => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:26.371583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e5ed53310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:26.449484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.449937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.450813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:26.451263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:26.540767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:26.547804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:26.548496 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73eabd85-80b0-4e16-8a6c-45c9aff9a1b6 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 325 microversion: 2.1 time: 0.183716 Mar 26 20:55:26.549692 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1072/1998] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:26 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:26.556980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a34e9f13-229c-41c4-8a1a-410894a0e4ba tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e58cc51f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:26.579499 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5b6752f-c3d6-4f36-a40b-a4fdfed589c7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.289793 Mar 26 20:55:26.581393 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 927/1999] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 20:55:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:26.594895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3bd80c8-fd18-4086-955d-8c26db072094 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e591d2ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:27.063424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a34e9f13-229c-41c4-8a1a-410894a0e4ba tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843" status: 204 len: 0 microversion: 2.1 time: 0.512163 Mar 26 20:55:27.064092 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1073/2000] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:26 2022] DELETE /compute/v2.1/images/e9125198-c7db-4587-89d1-1e346dced843 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:27.070722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-442f1748-98f5-4e24-9fc5-7d50dffce00d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:27.109077 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3bd80c8-fd18-4086-955d-8c26db072094 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1419 microversion: 2.1 time: 0.526519 Mar 26 20:55:27.109644 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 928/2001] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:26 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1419 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:27.124509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-770468800", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:27.138405 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-442f1748-98f5-4e24-9fc5-7d50dffce00d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/bdd68873-ecf0-4db9-aef0-f462cf8972f8" status: 204 len: 0 microversion: 2.1 time: 0.073236 Mar 26 20:55:27.141641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1074/2002] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:27 2022] DELETE /compute/v2.1/os-server-groups/bdd68873-ecf0-4db9-aef0-f462cf8972f8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:27.147015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:27.147646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:27.169754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:27.171017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:27.171821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:27.172300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:27.210647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:27.277725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:27.287711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:27.289284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:27.295493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-67c2b3b2-9d77-41ed-807f-31e3d0064db5 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.152137 Mar 26 20:55:27.297194 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1075/2003] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:27 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:27.302364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1516768388", "imageRef": "e557bc90-b1f4-4b9b-b7e7-dc2749d94be8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "434726dc-6c91-47a9-a812-cfb57b96c526"}], "security_groups": [{"name": "tempest-securitygroup--811245122"}], "key_name": "tempest-keypair-1075983386", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:27.462173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] validate_networks() for [('434726dc-6c91-47a9-a812-cfb57b96c526', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:27.622649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:27.623116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:27.623749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:27.624249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:27.624772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:27.634250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:27.635545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:27.636564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:27.637309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:27.656808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:27.665879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Getting quotas for user 80c37dca7eb34ef096e6d9093ad313b9 and project 7cc0a8152d814a5590cbc9be7c230181. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:27.682112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.utils [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] ram quota exceeded for 7cc0a8152d814a5590cbc9be7c230181, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141580) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 26 20:55:27.682661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Mar 26 20:55:27.683253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:27.684142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3507c405-0e10-4b18-b5c4-e63d7ead557a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.573379 Mar 26 20:55:27.688126 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 929/2004] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 575 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:27.690692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b76d8acb-3614-4a8d-b395-c9c3b26229e4 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59725af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.012811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b76d8acb-3614-4a8d-b395-c9c3b26229e4 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0" status: 204 len: 0 microversion: 2.1 time: 0.326529 Mar 26 20:55:28.016707 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 930/2005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:27 2022] DELETE /compute/v2.1/images/910414b7-74d5-473e-866b-852aa59a1fc0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:28.022015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.022975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:28.034817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.035278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.036125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.036569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.078296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.079060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.079740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lazy-loading 'fault' on Instance uuid 38c465f7-5289-47b5-be81-a8bffea6bb40 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:28.125938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:28.126280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.126421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:28.126826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:28.127241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:28.127657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:28.134209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bbbba41-242d-4554-92c6-684f859d636f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 200 len: 1309 microversion: 2.1 time: 0.116279 Mar 26 20:55:28.134772 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 931/2006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:28.136629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.137185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.138097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.138648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.139556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af4e0ca5-7d84-44f5-b4c8-7846b88f4dc2 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.153493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af4e0ca5-7d84-44f5-b4c8-7846b88f4dc2 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017721 Mar 26 20:55:28.154059 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 932/2007] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:28.158559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.159536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:28.159691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:28.165070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Getting quotas for user 57e806dbaedc49e395b7d6b374ca2fec and project 28e51fbb6333452b84c0c77d29b423b0. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:28.168364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.168824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.169735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.170184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.177913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:28.180233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e557bc90-b1f4-4b9b-b7e7-dc2749d94be8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:28.225603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1be04d54-229c-437a-b20a-34663030fe19 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926941 Mar 26 20:55:28.226676 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1076/2008] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:28.231294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2b5a9c81-65c7-4850-8abd-ce3a92703481 req-897915ed-d15c-49c5-8019-25a7a3e6f10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971824c7-c9de-412e-8368-23c0d4e267af", "tag": "ba7ea312-d565-4f8b-bfb0-b923476e5902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:28.240076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2b5a9c81-65c7-4850-8abd-ce3a92703481 req-897915ed-d15c-49c5-8019-25a7a3e6f10c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.240614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2b5a9c81-65c7-4850-8abd-ce3a92703481 req-897915ed-d15c-49c5-8019-25a7a3e6f10c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.254029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2b5a9c81-65c7-4850-8abd-ce3a92703481 req-897915ed-d15c-49c5-8019-25a7a3e6f10c service nova] Creating event network-changed:ba7ea312-d565-4f8b-bfb0-b923476e5902 for instance 971824c7-c9de-412e-8368-23c0d4e267af on nch1-master-1 Mar 26 20:55:28.263052 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2b5a9c81-65c7-4850-8abd-ce3a92703481 req-897915ed-d15c-49c5-8019-25a7a3e6f10c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035152 Mar 26 20:55:28.264655 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1077/2009] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:28.270089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Action: 'update', calling method: .version_select at 0x7f6e58c23ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:28.346028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.347120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.348279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.348909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.368574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.383087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.385526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.387384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8b500404-a14d-4dac-a912-ea5433205759 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.232105 Mar 26 20:55:28.387959 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 933/2010] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:28.405124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5b496653-e42c-42bf-a9ef-64eb51d2a8b1 req-ddc48b56-f5a6-4fc4-a798-2b20eaa852af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c465f7-5289-47b5-be81-a8bffea6bb40", "name": "network-vif-deleted", "tag": "bc6395f6-f2f3-4aa7-912e-2231739b4607"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:28.413998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5b496653-e42c-42bf-a9ef-64eb51d2a8b1 req-ddc48b56-f5a6-4fc4-a798-2b20eaa852af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.414462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5b496653-e42c-42bf-a9ef-64eb51d2a8b1 req-ddc48b56-f5a6-4fc4-a798-2b20eaa852af service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.428797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5b496653-e42c-42bf-a9ef-64eb51d2a8b1 req-ddc48b56-f5a6-4fc4-a798-2b20eaa852af service nova] Creating event network-vif-deleted:bc6395f6-f2f3-4aa7-912e-2231739b4607 for instance 38c465f7-5289-47b5-be81-a8bffea6bb40 on nch1-master-1 Mar 26 20:55:28.435133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5b496653-e42c-42bf-a9ef-64eb51d2a8b1 req-ddc48b56-f5a6-4fc4-a798-2b20eaa852af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036729 Mar 26 20:55:28.436539 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 934/2011] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:28.439862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e2bd81c-39a6-4520-b8f2-0982aea51f18 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 200 len: 329 microversion: 2.1 time: 0.173634 Mar 26 20:55:28.440610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1078/2012] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:28 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 329 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:28.447084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ac7fcb8-4dcc-48d3-9fc8-a1c64cd9d92b tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58cc5ee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.449826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8e28a93-a0eb-4eb1-8c17-0044a1ece427 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] Calling method '.version_select at 0x7f6e59b7c940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.517669 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ac7fcb8-4dcc-48d3-9fc8-a1c64cd9d92b tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1428 microversion: 2.1 time: 0.075756 Mar 26 20:55:28.526959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1079/2013] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:28.533603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: .version_select at 0x7f6e5eb2c670>, body: {"server_group": {"name": "tempest-server-group-1987582899", "policies": ["anti-affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:28.552700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:28.560267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:28.623789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:28.632383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:28.651700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91f0f7d9-bc43-4ae2-95ca-c034e29084d0 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.122927 Mar 26 20:55:28.652941 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1080/2014] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 20:55:28 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:28.658009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea7e38f8-9c06-4a18-9b8d-cb7899dd8c16 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.659371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ea7e38f8-9c06-4a18-9b8d-cb7899dd8c16 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:28.727973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ea7e38f8-9c06-4a18-9b8d-cb7899dd8c16 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.745543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea7e38f8-9c06-4a18-9b8d-cb7899dd8c16 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1246 microversion: 2.1 time: 0.091384 Mar 26 20:55:28.755295 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1081/2015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:28.755295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.755295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:28.760586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.761338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.762448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.763185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.830738 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8e28a93-a0eb-4eb1-8c17-0044a1ece427 tempest-ListImageFiltersTestJSON-1657459460 tempest-ListImageFiltersTestJSON-1657459460-project] 10.222.0.16 "DELETE /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470" status: 204 len: 0 microversion: 2.1 time: 0.392778 Mar 26 20:55:28.831314 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 935/2016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:28 2022] DELETE /compute/v2.1/images/8ba7be3d-082b-4f7d-9757-3ab9affc4470 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:28.832859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.842097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.843682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.846742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ecd4dfd7-66a8-4f21-a704-6ab8e212ef3a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Action: 'update', calling method: .version_select at 0x7f6e590afaf0>, body: {"quota_set": {"ram": 0}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:28.849751 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40c5321d-a7ad-44da-a32a-f5497c3d4555 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.102466 Mar 26 20:55:28.850801 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1082/2017] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:28.857777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ecd4dfd7-66a8-4f21-a704-6ab8e212ef3a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '80c37dca7eb34ef096e6d9093ad313b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc0a8152d814a5590cbc9be7c230181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:28.858512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ecd4dfd7-66a8-4f21-a704-6ab8e212ef3a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:28.859355 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ecd4dfd7-66a8-4f21-a704-6ab8e212ef3a tempest-QuotasAdminNegativeTest-1285874347 tempest-QuotasAdminNegativeTest-1285874347-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181" status: 403 len: 116 microversion: 2.1 time: 0.027069 Mar 26 20:55:28.859906 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 936/2018] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 20:55:28 2022] PUT /compute/v2.1/os-quota-sets/7cc0a8152d814a5590cbc9be7c230181 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:28.865198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2294651-723d-4900-b5b8-169517c288ca tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c48b80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.874726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4529582-0033-4f61-bcf1-1e57ac7b4653 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.923479 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2294651-723d-4900-b5b8-169517c288ca tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 200 len: 1428 microversion: 2.1 time: 0.071730 Mar 26 20:55:28.926820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1083/2019] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:28.935251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4529582-0033-4f61-bcf1-1e57ac7b4653 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/eca75db1-3310-4a77-bb08-2eb987e6fcfe" status: 204 len: 0 microversion: 2.1 time: 0.067133 Mar 26 20:55:28.935879 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 937/2020] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:28 2022] DELETE /compute/v2.1/os-server-groups/eca75db1-3310-4a77-bb08-2eb987e6fcfe => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:28.940848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.941477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:28.944848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-170bc691-25d4-448b-bb4c-6c039bc7bca4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:28.954801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-170bc691-25d4-448b-bb4c-6c039bc7bca4 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014421 Mar 26 20:55:28.955662 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 938/2021] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:55:28.967003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.967003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:28.967003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:28.967003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.142057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:29.151081 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d72e5f9-1b2a-40e6-b550-7e1289b1315f tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1466 microversion: 2.1 time: 0.214232 Mar 26 20:55:29.152218 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1084/2022] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:28 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1466 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:29.160251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:29.161258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:29.169206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.170079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.171164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6df53468-2860-4335-ae92-54842d6d8d4e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c483a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:29.171519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.172212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.191302 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. Mar 26 20:55:29.192146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:29.192977 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-117214a4-7b00-4dcc-a346-0dc9d9f931f7 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 404 len: 111 microversion: 2.1 time: 0.045712 Mar 26 20:55:29.193732 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 939/2023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:29 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:29.206142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1205344980", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "1f1da915-0ad2-4c67-b923-e19608b6018b"}]}, "os:scheduler_hints": {"group": "d90df2d9-31f9-4437-8d2e-ad10e905702a"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:29.243007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6df53468-2860-4335-ae92-54842d6d8d4e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb" status: 200 len: 784 microversion: 2.1 time: 0.079681 Mar 26 20:55:29.244586 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1085/2024] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:29 2022] GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:29.249905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:29.250504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:29.256814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.257516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.258543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.259107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.264518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] validate_networks() for [('1f1da915-0ad2-4c67-b923-e19608b6018b', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:29.277175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. Mar 26 20:55:29.277786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:29.278632 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c24017c0-c821-4965-92bb-160180cbfa34 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 404 len: 111 microversion: 2.1 time: 0.032971 Mar 26 20:55:29.282041 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1086/2025] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:29 2022] DELETE /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:29.284112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b4192cb1-d6e7-4463-91b4-f53d519e9477 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:29.292765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b4192cb1-d6e7-4463-91b4-f53d519e9477 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012210 Mar 26 20:55:29.293573 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1087/2026] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:55:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:29.298165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:29.298959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 38c465f7-5289-47b5-be81-a8bffea6bb40] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:29.304949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.305652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.307158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:29.307769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:29.322051 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. Mar 26 20:55:29.322925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 38c465f7-5289-47b5-be81-a8bffea6bb40 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:29.323776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2f2a009-ac55-44b3-86d9-1b96aa543739 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40" status: 404 len: 111 microversion: 2.1 time: 0.029133 Mar 26 20:55:29.324721 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1088/2027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:29 2022] GET /compute/v2.1/servers/38c465f7-5289-47b5-be81-a8bffea6bb40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:29.329791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4675f6f6-596f-4d88-81cb-1757aff12075 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58cc5c10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:30.132871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4675f6f6-596f-4d88-81cb-1757aff12075 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "DELETE /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 204 len: 0 microversion: 2.1 time: 0.806978 Mar 26 20:55:30.133739 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1089/2028] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:29 2022] DELETE /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:30.138811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:30.139555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:30.148157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.148995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.150495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.151117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.178920 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. Mar 26 20:55:30.181183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:30.188514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab50354b-05ce-415a-9a5f-e8c3b69f2a35 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 404 len: 111 microversion: 2.1 time: 0.053371 Mar 26 20:55:30.192510 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1090/2029] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:30 2022] DELETE /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:30.202584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:30.213740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:30.230286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.233631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.234319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.234778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.644367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:30.647210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:30.648799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:30.649512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:30.650228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:30.650986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:30.661813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:30.667047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:30.668361 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f717ab91-208a-45a8-aa5c-e27cc922a028 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.474345 Mar 26 20:55:30.677801 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1091/2030] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:30 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:30.687215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.688578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.694018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.694812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.696795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:30.697437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:30.736632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.737128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.737954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.738379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.755704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:30.784396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:30.858707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:30.864656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:30.864843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:30.873877 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af029f0f-2f61-4f2a-8860-f394475f975e tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1304 microversion: 2.1 time: 0.194920 Mar 26 20:55:30.874460 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1092/2031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:30 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:30.886477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:30.887079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:30.903779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.911540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:30.912695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:30.918585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.053953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141580) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Mar 26 20:55:31.127830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:31.138804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:31.141842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:31.151847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:31.154773 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41d4c825-6cd0-463e-b4b6-13c12ecfd79f tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1447 microversion: 2.75 time: 0.273668 Mar 26 20:55:31.170815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1093/2032] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:30 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:31.178752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75ac946b-f6ef-428c-aafb-61e2b1ad03bc tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c48c10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:31.182396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:31.225628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-75ac946b-f6ef-428c-aafb-61e2b1ad03bc tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] HTTP exception thrown: Image not found. Mar 26 20:55:31.226662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75ac946b-f6ef-428c-aafb-61e2b1ad03bc tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:31.228919 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-75ac946b-f6ef-428c-aafb-61e2b1ad03bc tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 404 len: 62 microversion: 2.1 time: 0.056739 Mar 26 20:55:31.230213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1094/2033] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:31 2022] GET /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:55:31.237662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:31.238750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7c229227-fa31-44f3-97ad-c652071af283] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:31.249774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.251131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.253032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.253996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.275222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. Mar 26 20:55:31.276952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7c229227-fa31-44f3-97ad-c652071af283 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:31.278465 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5051720d-5f7f-4c4c-9e00-cc5ae4eedfb9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283" status: 404 len: 111 microversion: 2.1 time: 0.046362 Mar 26 20:55:31.279411 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1095/2034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:31 2022] GET /compute/v2.1/servers/7c229227-fa31-44f3-97ad-c652071af283 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:31.374632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:31.389970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Getting quotas for user c748958cc2c64a5c9f7af16cae37c969 and project 4dadd4e8f76f462b9f22b4211c7d5d47. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:31.450285 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da855986-e441-4f75-8368-8c4e037f3066 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.255509 Mar 26 20:55:31.456982 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 940/2035] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:31.468020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-950c6374-180c-4202-9466-73101ecf762b req-bdcfc54f-3c7c-4a37-8fe4-cd95f3e289e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-unplugged", "status": "completed", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:31.480222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-950c6374-180c-4202-9466-73101ecf762b req-bdcfc54f-3c7c-4a37-8fe4-cd95f3e289e4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.481116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-950c6374-180c-4202-9466-73101ecf762b req-bdcfc54f-3c7c-4a37-8fe4-cd95f3e289e4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.500794 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-950c6374-180c-4202-9466-73101ecf762b req-bdcfc54f-3c7c-4a37-8fe4-cd95f3e289e4 service nova] Creating event network-vif-unplugged:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:55:31.506975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-950c6374-180c-4202-9466-73101ecf762b req-bdcfc54f-3c7c-4a37-8fe4-cd95f3e289e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047912 Mar 26 20:55:31.508519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 941/2036] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:31.518867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-696908819"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:31.522802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:31.543001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.545610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.546696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.547476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.861724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7610e39-c118-423d-b02e-e707a50271ce tempest-ListImageFiltersNegativeTestJSON-397362378 tempest-ListImageFiltersNegativeTestJSON-397362378-project] Calling method '.version_select at 0x7f6e58c79550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:31.901690 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e7610e39-c118-423d-b02e-e707a50271ce tempest-ListImageFiltersNegativeTestJSON-397362378 tempest-ListImageFiltersNegativeTestJSON-397362378-project] HTTP exception thrown: Image not found. Mar 26 20:55:31.902416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7610e39-c118-423d-b02e-e707a50271ce tempest-ListImageFiltersNegativeTestJSON-397362378 tempest-ListImageFiltersNegativeTestJSON-397362378-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:31.903100 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e7610e39-c118-423d-b02e-e707a50271ce tempest-ListImageFiltersNegativeTestJSON-397362378 tempest-ListImageFiltersNegativeTestJSON-397362378-project] 10.222.0.16 "GET /compute/v2.1/images/9fceb8b9-1045-4b30-a9f7-710d5dcab080" status: 404 len: 62 microversion: 2.1 time: 0.622265 Mar 26 20:55:31.903650 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1096/2037] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:31 2022] GET /compute/v2.1/images/9fceb8b9-1045-4b30-a9f7-710d5dcab080 => generated 62 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:55:31.920058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:31.929202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:31.956759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.957403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:31.963803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:31.967046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:32.031829 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. Mar 26 20:55:32.046222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:32.051297 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73f44b71-cb56-4a22-a475-00499ee7bc71 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 404 len: 111 microversion: 2.1 time: 0.139163 Mar 26 20:55:32.057912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1097/2038] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:31 2022] DELETE /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:32.063080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c3f459d-f711-40b6-a2a9-0766734113a7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:32.063741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c3f459d-f711-40b6-a2a9-0766734113a7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:32.282426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9c3f459d-f711-40b6-a2a9-0766734113a7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:32.319722 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c3f459d-f711-40b6-a2a9-0766734113a7 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1213 microversion: 2.1 time: 0.256032 Mar 26 20:55:32.322070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1098/2039] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:32 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:32.334804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:32.344646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:32.370203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:32.372631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:32.373856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:32.376443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:32.646663 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61abef9f-c8e1-41a7-8ff0-92dc262d59ec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "POST /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5/action" status: 202 len: 0 microversion: 2.1 time: 1.136237 Mar 26 20:55:32.652672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 942/2040] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:55:31 2022] POST /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5/action => generated 0 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:55:32.663886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:32.676602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:32.687859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:32.705400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:32.708604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:32.709255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.051062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.061739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.080144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.093459 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9deb6a8a-9d60-4a64-9a75-5ac3cef94078 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.769722 Mar 26 20:55:33.094524 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1099/2041] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:32 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:33.100525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.110518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: dbdb010a-69af-469c-baa2-e3ef4c4694d8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.130981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.137505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.138588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.139257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.160921 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. Mar 26 20:55:33.172879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance dbdb010a-69af-469c-baa2-e3ef4c4694d8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.174142 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bf90645-38ee-4bb9-ba26-53e215319f73 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8" status: 404 len: 111 microversion: 2.1 time: 0.077298 Mar 26 20:55:33.174833 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1100/2042] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/dbdb010a-69af-469c-baa2-e3ef4c4694d8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.181465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.192872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.199613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.200414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.201394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.201883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.277201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.296118 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9c1f7b3-31aa-4c7b-99ed-b057d7e6d0ea tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.640740 Mar 26 20:55:33.298652 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 943/2043] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:32 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:33.305508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7b07d9d-1cf7-4323-8915-1cbf9854a89d tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ece8160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.381926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.397262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.403910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.420699 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7b07d9d-1cf7-4323-8915-1cbf9854a89d tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.119758 Mar 26 20:55:33.423975 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 944/2044] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:33.438046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.438750 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ce46a571-3669-4e64-be38-a65ad0018a3a tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1453 microversion: 2.75 time: 0.260669 Mar 26 20:55:33.439764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.440619 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1101/2045] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1453 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:33.453588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.459118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.463016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.463615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.465020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.467291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.477828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.479773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.483683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.484501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.511520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. Mar 26 20:55:33.512560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.514724 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9cbc1bc0-11da-498a-8539-677a444fa229 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 404 len: 111 microversion: 2.1 time: 0.088876 Mar 26 20:55:33.516947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 945/2046] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:33 2022] DELETE /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.535194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.541883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.556957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.558352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.559466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.560669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.601213 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. Mar 26 20:55:33.602166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.603782 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7df1be62-0073-460f-9f07-3b646c774611 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a" status: 404 len: 111 microversion: 2.1 time: 0.082686 Mar 26 20:55:33.605223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 946/2047] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/b582e0e9-3d2c-4992-ade9-17e8e3e0bc3a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.612758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.613584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.621680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.626164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.627829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:33.628195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.628877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.636154 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc1bd755-53aa-486e-95e7-9ac55256aff6 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1265 microversion: 2.1 time: 0.191202 Mar 26 20:55:33.646740 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1102/2048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:33.650611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. Mar 26 20:55:33.651803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.652981 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f674cb0-d391-4c06-b84c-1a0ada6f2203 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 404 len: 111 microversion: 2.1 time: 0.044065 Mar 26 20:55:33.654135 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 947/2049] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:33 2022] DELETE /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.662114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.662806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 5befa018-5000-4e02-941b-24ee5d09f607] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.683544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.684024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.684816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.689851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.730968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. Mar 26 20:55:33.731590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 5befa018-5000-4e02-941b-24ee5d09f607 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.732480 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-afbc0326-f973-4550-adda-474b8d78d1eb tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607" status: 404 len: 111 microversion: 2.1 time: 0.074387 Mar 26 20:55:33.733059 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1103/2050] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/5befa018-5000-4e02-941b-24ee5d09f607 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:33.742666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.746742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.759509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.764473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.765112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.765577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.826720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. Mar 26 20:55:33.827334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.828207 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47d2bf6e-a1b9-4d10-8818-86c3349128bf tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 404 len: 111 microversion: 2.1 time: 0.090515 Mar 26 20:55:33.837439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.838074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 7637a394-e609-4fcf-a3c0-06b029441efa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.838670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 948/2051] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:33 2022] DELETE /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.845159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.845616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.846398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:33.846835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:33.897088 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. Mar 26 20:55:33.905292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 7637a394-e609-4fcf-a3c0-06b029441efa could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.906534 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b5b2126-2bb5-4184-b5a7-42bd966df37e tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa" status: 404 len: 111 microversion: 2.1 time: 0.073569 Mar 26 20:55:33.909614 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1104/2052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/7637a394-e609-4fcf-a3c0-06b029441efa => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.917724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0be89ed7-def8-4597-a18c-e898dc5bcd37 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.918247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0be89ed7-def8-4597-a18c-e898dc5bcd37 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.927651 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0be89ed7-def8-4597-a18c-e898dc5bcd37 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. Mar 26 20:55:33.928378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0be89ed7-def8-4597-a18c-e898dc5bcd37 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.929253 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0be89ed7-def8-4597-a18c-e898dc5bcd37 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695" status: 404 len: 111 microversion: 2.1 time: 0.016552 Mar 26 20:55:33.929845 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 949/2053] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:33 2022] DELETE /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.938470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ecc9c2aa-4c5b-498f-a7ea-5f8409f51ade tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.939569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ecc9c2aa-4c5b-498f-a7ea-5f8409f51ade tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 890b276a-88ea-4174-8618-118a69943695] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:33.952959 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ecc9c2aa-4c5b-498f-a7ea-5f8409f51ade tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. Mar 26 20:55:33.954976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ecc9c2aa-4c5b-498f-a7ea-5f8409f51ade tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 890b276a-88ea-4174-8618-118a69943695 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:33.956076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ecc9c2aa-4c5b-498f-a7ea-5f8409f51ade tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695" status: 404 len: 111 microversion: 2.1 time: 0.021658 Mar 26 20:55:33.958991 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1105/2054] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:33 2022] GET /compute/v2.1/servers/890b276a-88ea-4174-8618-118a69943695 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:33.973773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:33.974290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:34.029898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.030391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.031474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.032120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.093774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:34.114870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:34.115599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:34.123021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.130614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.139029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.139700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.328474 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4408f0e7-fc2b-4f33-a8a7-480a1771fc7f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 204 len: 0 microversion: 2.1 time: 0.365692 Mar 26 20:55:34.329915 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 950/2055] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:33 2022] DELETE /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:34.338715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:34.339900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:34.352361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.360618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.361770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.362419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.519197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:34.529710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:34.534812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:34.536000 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-045792b5-cf00-4620-a79d-d79104da325e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.425495 Mar 26 20:55:34.541770 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1106/2056] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:34 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:34.561253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:34.565640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:34.599564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.602139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:34.604525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:34.605225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.052517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.062070 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8386f8b9-eaea-4257-b532-02be340547ce tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.518355 Mar 26 20:55:35.065424 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1107/2057] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:34 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:35.088666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2774b7b3-18f7-45be-b4fe-ee747f609884 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c793a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:35.157300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2774b7b3-18f7-45be-b4fe-ee747f609884 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.073249 Mar 26 20:55:35.158234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1108/2058] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:35 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:35.173275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-65ed4568-dc00-4ee3-8b5f-ae77790d64f8 req-c23a7e25-cd19-4bbc-b240-24e517203678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971824c7-c9de-412e-8368-23c0d4e267af", "name": "network-vif-plugged", "status": "completed", "tag": "ba7ea312-d565-4f8b-bfb0-b923476e5902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:35.184418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-65ed4568-dc00-4ee3-8b5f-ae77790d64f8 req-c23a7e25-cd19-4bbc-b240-24e517203678 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.185105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-65ed4568-dc00-4ee3-8b5f-ae77790d64f8 req-c23a7e25-cd19-4bbc-b240-24e517203678 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.200765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-65ed4568-dc00-4ee3-8b5f-ae77790d64f8 req-c23a7e25-cd19-4bbc-b240-24e517203678 service nova] Creating event network-vif-plugged:ba7ea312-d565-4f8b-bfb0-b923476e5902 for instance 971824c7-c9de-412e-8368-23c0d4e267af on nch1-master-1 Mar 26 20:55:35.208461 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-65ed4568-dc00-4ee3-8b5f-ae77790d64f8 req-c23a7e25-cd19-4bbc-b240-24e517203678 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048037 Mar 26 20:55:35.209899 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1109/2059] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:35.219212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:35.220378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:35.230556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.231781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.234676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.235542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.412303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.427405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.433316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.448398 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55ff33b7-6d8b-45e3-ab5c-fae537ec35f2 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1438 microversion: 2.75 time: 0.236562 Mar 26 20:55:35.450243 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1110/2060] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:35 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1438 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:35.462695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:35.463405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:35.474550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.479290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.480234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.480690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.623657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.632625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8914652b-31aa-4f0c-9e09-df5d35803e65 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1271 microversion: 2.1 time: 0.181369 Mar 26 20:55:35.633441 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1111/2061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:35 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:35.648349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b7405a8c-6380-4675-9a4a-6868e048d378 req-4a1d69c4-42b5-4e8c-8cac-a4d126ea70fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89eb23ef-ff6c-425c-811a-1aa2cffe0aad", "tag": "f3c532be-691b-4c26-98db-d112c6a3c064"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:35.657399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7405a8c-6380-4675-9a4a-6868e048d378 req-4a1d69c4-42b5-4e8c-8cac-a4d126ea70fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.657853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7405a8c-6380-4675-9a4a-6868e048d378 req-4a1d69c4-42b5-4e8c-8cac-a4d126ea70fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.678158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b7405a8c-6380-4675-9a4a-6868e048d378 req-4a1d69c4-42b5-4e8c-8cac-a4d126ea70fc service nova] Creating event network-changed:f3c532be-691b-4c26-98db-d112c6a3c064 for instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad on nch2-master-1 Mar 26 20:55:35.683452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b7405a8c-6380-4675-9a4a-6868e048d378 req-4a1d69c4-42b5-4e8c-8cac-a4d126ea70fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039438 Mar 26 20:55:35.684060 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1112/2062] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:35.710796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:35.721631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2be53174-646d-40ce-a064-57633491162f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 1.390249 Mar 26 20:55:35.723141 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 951/2063] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:34 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:35.733776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:35.736097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:35.751439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.752907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:35.757232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:35.757885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.014342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:36.032222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:36.034083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:36.035164 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-820f9bb6-75fe-40f9-90d2-fa2737cef22c tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1359 microversion: 2.21 time: 0.309571 Mar 26 20:55:36.035833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 952/2064] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:35 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:36.083592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:36.084960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:36.098035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.098925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.100110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.100763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.259664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:36.261385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:36.275161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.277095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.284538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.285106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.428326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:36.429156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:36.430065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:36.430747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:36.431425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:36.504028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:36.520708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d52c7b98-53d7-4e85-9f80-896a64c875d8 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.441630 Mar 26 20:55:36.522999 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 953/2065] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:36 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:36.534553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2efcdeb-e607-40b5-9203-5b22cf5f7bbf tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ed2cf70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:36.571119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:36.592832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.598242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.600445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:36.602093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:36.638905 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2efcdeb-e607-40b5-9203-5b22cf5f7bbf tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.114785 Mar 26 20:55:36.640378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 954/2066] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:36 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:36.921586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:36.993713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d13c9956-797b-4a9c-9079-c34ffafe9931 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab/action" status: 202 len: 1942 microversion: 2.75 time: 1.307803 Mar 26 20:55:36.994459 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1113/2067] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 20:55:35 2022] POST /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab/action => generated 1942 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 26 20:55:37.002329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:37.003434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:37.020543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.020543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.020543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.020543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.144500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e5ed2c8b0>, body: {"keypair": {"name": "tempest-keypair-639623143"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:37.194218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:37.214199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:37.350036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:37.363288 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa5140f1-2749-4dda-a45e-7f4843c0a790 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.367501 Mar 26 20:55:37.364976 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1114/2068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:36 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:37.376923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:37.380447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:37.392294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.396419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.397514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.398143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.645852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:37.660328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ea4c8fa-7464-41e8-ba3c-5e7731c7a738 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.293669 Mar 26 20:55:37.661345 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1115/2069] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:37 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:37.669109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:37.669731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:37.676129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.676588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.677407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.677901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.752421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:37.760811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:37.782839 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-21dfbf45-f6c6-4f79-9c84-49bbc0326adc tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.135162 Mar 26 20:55:37.784110 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 955/2070] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:36 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:37.850413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:37.897172 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-762ba162-c9f0-4efe-92a4-195c4b6e7916 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.233687 Mar 26 20:55:37.921087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1116/2071] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:37 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:37.928237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:37.930952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:37.939626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.941517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.942575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:37.943527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:37.953694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-396786392", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:38.019701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:38.145155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:38.154500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:38.156946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:38.162274 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8435808e-fd03-4f97-94b0-455cc899ff3a tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1552 microversion: 2.21 time: 0.235945 Mar 26 20:55:38.171970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1117/2072] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:37 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:38.177138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.177762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:38.185954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.186414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.187484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.188028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.377651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:38.390109 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c07ffdc2-b4ff-4d6e-957f-31dae4a0ffd0 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.216933 Mar 26 20:55:38.390949 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1118/2073] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:38.407762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:38.408847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e3a6dbbd-9aea-4353-80a1-78a3fa61fb8a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58c791f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.409017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:38.409599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:38.410020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:38.410594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:38.449854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.450321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.452677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.453148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.464276 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e3a6dbbd-9aea-4353-80a1-78a3fa61fb8a tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.071756 Mar 26 20:55:38.465121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1119/2074] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:38.474822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b41bac82-dd82-42e8-a652-e4f5f305fc62 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58c881f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.483045 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b41bac82-dd82-42e8-a652-e4f5f305fc62 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-639623143" status: 200 len: 691 microversion: 2.1 time: 0.011996 Mar 26 20:55:38.483640 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1120/2075] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-639623143 => generated 691 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:38.488367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.488942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:38.492839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:38.495443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.495909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.496751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.497204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.502764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:38.537226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:38.539703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:38.544658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:38.606459 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d48003c4-99fe-44e1-bcd9-30617cbffa54 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816602 Mar 26 20:55:38.607624 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 956/2076] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:38.617807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0164a82a-c2e8-4f42-8307-f3ea8124ea03 req-0074b218-8f41-4349-9c3d-885ec75a2dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6bc3b-be73-4ff0-aae6-cc196c146232", "tag": "7ffc94eb-46a6-4da8-a517-632fac7bd7b9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:38.652518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0164a82a-c2e8-4f42-8307-f3ea8124ea03 req-0074b218-8f41-4349-9c3d-885ec75a2dc0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.652975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0164a82a-c2e8-4f42-8307-f3ea8124ea03 req-0074b218-8f41-4349-9c3d-885ec75a2dc0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.684919 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25d3f393-43e7-4a41-a17b-2a3f5df52293 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "DELETE /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 204 len: 0 microversion: 2.21 time: 0.199981 Mar 26 20:55:38.686977 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0164a82a-c2e8-4f42-8307-f3ea8124ea03 req-0074b218-8f41-4349-9c3d-885ec75a2dc0 service nova] Creating event network-changed:7ffc94eb-46a6-4da8-a517-632fac7bd7b9 for instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 on nch1-master-1 Mar 26 20:55:38.693547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1121/2077] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:55:38 2022] DELETE /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:55:38.702965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0164a82a-c2e8-4f42-8307-f3ea8124ea03 req-0074b218-8f41-4349-9c3d-885ec75a2dc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089819 Mar 26 20:55:38.705969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 957/2078] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:38.709209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.712878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:38.720832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2d4f831-838a-4a3a-9fab-33dd74e97c43 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e5ed2caf0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.723995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.724456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.725256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.725790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.761220 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2d4f831-838a-4a3a-9fab-33dd74e97c43 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639623143" status: 202 len: 0 microversion: 2.1 time: 0.053700 Mar 26 20:55:38.765394 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 958/2079] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 20:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639623143 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:38.778787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d57e64d-d9b2-4be3-b2e7-1fb63fafde2b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.779837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d57e64d-d9b2-4be3-b2e7-1fb63fafde2b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:38.873097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3d57e64d-d9b2-4be3-b2e7-1fb63fafde2b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:38.880926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d57e64d-d9b2-4be3-b2e7-1fb63fafde2b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1216 microversion: 2.1 time: 0.114095 Mar 26 20:55:38.893815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 959/2080] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:38.898773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:38.899478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:38.919620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.920117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:38.920920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:38.930795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.005724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:39.019899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a4ee4975-6bee-4b3e-87d6-0717c188764b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.324599 Mar 26 20:55:39.021142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1122/2081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:39.028696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.029643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:39.044204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.045076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.046100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.047673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.322010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:39.327077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:39.335899 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ea90f37b-749d-4202-a4d6-606752637d17 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.440901 Mar 26 20:55:39.342264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:39.343774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:39.344993 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c8fbb70-15a7-46e9-9d7e-844ffd9e500e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1558 microversion: 2.21 time: 0.322658 Mar 26 20:55:39.348501 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 960/2082] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:38 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:39.353829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e5ecf34c0>, body: {"keypair": {"name": "tempest-keypair-252017668"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:39.363566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1123/2083] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:39 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1558 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:39.369549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:39.375191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:39.384446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.387258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:39.411951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.412618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.415585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.417844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.575303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:39.582364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:39.623610 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e12c89d3-1024-404a-90c9-c34297860ce9 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.273695 Mar 26 20:55:39.624561 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 961/2084] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:39 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:39.637925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-28274488-7415-4f64-8753-4e4af6d7ad9d req-ad8d4867-37b7-4d70-ad02-1917d1cd89f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-plugged", "status": "completed", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:39.657335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-28274488-7415-4f64-8753-4e4af6d7ad9d req-ad8d4867-37b7-4d70-ad02-1917d1cd89f8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.658428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:39.658939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-28274488-7415-4f64-8753-4e4af6d7ad9d req-ad8d4867-37b7-4d70-ad02-1917d1cd89f8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.684481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-28274488-7415-4f64-8753-4e4af6d7ad9d req-ad8d4867-37b7-4d70-ad02-1917d1cd89f8 service nova] Creating event network-vif-plugged:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:55:39.695420 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-28274488-7415-4f64-8753-4e4af6d7ad9d req-ad8d4867-37b7-4d70-ad02-1917d1cd89f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069530 Mar 26 20:55:39.702008 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 962/2085] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:39.707615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6adb5a08-4d9c-4dd0-9f40-fffd77ce0e10 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.332393 Mar 26 20:55:39.709277 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1124/2086] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:39 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:39.710333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.715486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:39.724869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b99a8491-5d71-4ef7-b5f5-82c47ff013d1 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58b52280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.731209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.731730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.732759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.733270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.806667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b99a8491-5d71-4ef7-b5f5-82c47ff013d1 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.095404 Mar 26 20:55:39.807562 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1125/2087] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:39 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:39.812244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17fdbf64-b594-4fd7-906a-7a4e61c12ff4 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58b52f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.838451 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17fdbf64-b594-4fd7-906a-7a4e61c12ff4 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252017668" status: 202 len: 0 microversion: 2.1 time: 0.028227 Mar 26 20:55:39.840208 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1126/2088] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 20:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252017668 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:39.855573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c52e88b9-e0cb-4098-8fb6-c1aefc39b79d tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e58bd0040>, body: {"keypair": {"name": "tempest-keypair-1998944774", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:39.891416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c52e88b9-e0cb-4098-8fb6-c1aefc39b79d tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:39.895173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c52e88b9-e0cb-4098-8fb6-c1aefc39b79d tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:39.936286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c52e88b9-e0cb-4098-8fb6-c1aefc39b79d tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.090604 Mar 26 20:55:39.937717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1127/2089] 10.222.0.16 () {60 vars in 1158 bytes} [Sat Mar 26 20:55:39 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:39.943271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:39.944161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:39.952010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.952643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:39.953595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:39.954147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.051465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.064272 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7fb624a7-7a93-412b-9e00-142dec411898 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1220 microversion: 2.1 time: 0.124264 Mar 26 20:55:40.065430 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1128/2090] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:39 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:40.077005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4b40786-eeae-45ab-a3f3-cb8a0e3e147e tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58c79160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:40.112305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.123722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51319e80-5b6f-4c59-99c1-901138a7596f tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.420242 Mar 26 20:55:40.124114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4b40786-eeae-45ab-a3f3-cb8a0e3e147e tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998944774" status: 202 len: 0 microversion: 2.1 time: 0.050980 Mar 26 20:55:40.124638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1129/2091] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 20:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998944774 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:40.127975 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 963/2092] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:39 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:40.139382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:40.141376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:40.148524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.148909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.150755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.151220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.152764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e5ecf7c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-963236772"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:40.197212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:40.204329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:40.461411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.474025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e826a7e-89d6-49e2-915e-64e14e1108b8 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.348166 Mar 26 20:55:40.483375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1130/2093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:40 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:40.488461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:40.489167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:40.495066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.495519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.496321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.496759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.501618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:40.507987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:40.551306 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d3e350c-a001-47bb-addc-a6c259232bbd tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.410171 Mar 26 20:55:40.553964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 964/2094] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:40 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:40.567181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:40.568768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:40.585655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.586700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.588587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.589044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.781843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.790856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.800318 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6df98cc-4e3f-40f1-9c64-ee43b60b9052 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.324117 Mar 26 20:55:40.802624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.804180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8d2e97047c1481eb9916e203d2d8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fee503421884a52b75aae2ae940aad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:40.805401 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00de2b35-5d4e-4a54-8e46-d5be34beeee3 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 200 len: 1558 microversion: 2.21 time: 0.248792 Mar 26 20:55:40.806510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 965/2095] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:40 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 1558 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:40.808176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1131/2096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:40 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:40.813730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:40.813730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:40.817118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e5ecf9a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-84564008"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:40.827072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.827528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.828357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:40.829458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:40.843694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:40.849099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:40.921035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:40.944099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af020ab4-2c74-4fae-87da-fdc91a75eb34 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.134035 Mar 26 20:55:40.945266 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1132/2097] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:40 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:40.962610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3bf78522-5ee0-48dc-ae4e-eba7753507cd tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58b520d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.035445 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3bf78522-5ee0-48dc-ae4e-eba7753507cd tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.088876 Mar 26 20:55:41.036546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1133/2098] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:40 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:41.055441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e8459653-3487-466d-a434-abe0f482d1e4 req-668ba563-a854-4e89-91a1-78efda63f531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971824c7-c9de-412e-8368-23c0d4e267af", "name": "network-vif-deleted", "tag": "ba7ea312-d565-4f8b-bfb0-b923476e5902"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:41.072139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e8459653-3487-466d-a434-abe0f482d1e4 req-668ba563-a854-4e89-91a1-78efda63f531 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.072602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e8459653-3487-466d-a434-abe0f482d1e4 req-668ba563-a854-4e89-91a1-78efda63f531 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.086691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e8459653-3487-466d-a434-abe0f482d1e4 req-668ba563-a854-4e89-91a1-78efda63f531 service nova] Creating event network-vif-deleted:ba7ea312-d565-4f8b-bfb0-b923476e5902 for instance 971824c7-c9de-412e-8368-23c0d4e267af on nch1-master-1 Mar 26 20:55:41.093148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e8459653-3487-466d-a434-abe0f482d1e4 req-668ba563-a854-4e89-91a1-78efda63f531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054700 Mar 26 20:55:41.096971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1134/2099] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:41.102612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.103548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:41.111524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.112778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.113665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.114568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.180548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:41.188164 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2612f1c0-a1e3-4311-8853-ab9adbac47f2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1220 microversion: 2.1 time: 0.089927 Mar 26 20:55:41.188676 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1135/2100] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:41 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:41.193079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.193698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:41.200264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.200747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.201523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.201970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.339994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:41.347639 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d41348ac-1e37-43cd-b951-2bef76d8e3e9 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.157996 Mar 26 20:55:41.348243 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1136/2101] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:41 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:41.492071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.492260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:41.498666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.499657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.500024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.500382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.525569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:41.531035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:41.553579 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1fec154-7e6c-4b92-a207-61bd9f5420c8 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.740838 Mar 26 20:55:41.553579 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 966/2102] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:40 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:41.559612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Action: 'create', calling method: .version_select at 0x7f6e5ece89d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1909440217"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:41.585808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:41.593191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:41.726812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:41.734899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a17587b5-feb7-4e19-8d50-724d66d2d57d tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.247802 Mar 26 20:55:41.735570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1137/2103] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:41 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:41.826989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.827710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:41.834398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.834955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.835857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.836996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.938494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:41.944107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Getting quotas for user a28808e1fc35495dac029a5c68ddcf8e and project 94d4dd31cb2f45ebbadb90d56b9b393d. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:41.971224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5015e0c4-2004-4f35-ae35-11f5062b255b tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.415145 Mar 26 20:55:41.976022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 967/2104] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:55:41 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:41.986460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:41.987086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:41.997209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.997628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:41.998426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:41.999023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.002220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:42.014683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] HTTP exception thrown: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. Mar 26 20:55:42.015503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Returning 404 to user: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:42.016383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4124d66-0deb-4db9-bf92-122c11b23540 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 404 len: 111 microversion: 2.21 time: 0.039602 Mar 26 20:55:42.017739 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 968/2105] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:41 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:55:42.020064 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7979d17-bbfa-475d-a719-ec18057eb352 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.199813 Mar 26 20:55:42.026698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.026698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.036768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.036768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.036768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.037085 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1138/2106] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:41 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:42.037184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.044182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0de78bc1-db11-43cd-a713-4d1189f0c571 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58c23040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.056669 ncdv-master-1 devstack@n-api.service[141581]: WARNING oslo_db.sqlalchemy.utils [None req-0de78bc1-db11-43cd-a713-4d1189f0c571 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 26 20:55:42.085602 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0de78bc1-db11-43cd-a713-4d1189f0c571 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1673 microversion: 2.1 time: 0.052046 Mar 26 20:55:42.088717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1139/2107] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/os-keypairs => generated 1673 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:42.103909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '.version_select at 0x7f6e58bd03a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.104640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.119238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.121886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.122787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.123399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.252954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f4042df-9676-4c73-926b-20e5c1e42749 tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.162831 Mar 26 20:55:42.253839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1140/2108] 10.222.0.16 () {60 vars in 1336 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af/os-instance-actions => generated 611 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 20:55:42.255018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:42.259685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e08a299b-c2a1-42a0-a8d5-b4f22c971e87 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58bd0160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.308647 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e08a299b-c2a1-42a0-a8d5-b4f22c971e87 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.053550 Mar 26 20:55:42.309581 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1141/2109] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:42.314973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a3d76308-d63e-4aba-af3c-c09fd05266c1 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58b523a0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.335510 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8b7baadd-ee3c-43fe-8d18-6dc348bc3f9f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.316495 Mar 26 20:55:42.349687 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 969/2110] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:42.350786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a3d76308-d63e-4aba-af3c-c09fd05266c1 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1909440217" status: 202 len: 0 microversion: 2.1 time: 0.039930 Mar 26 20:55:42.351699 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1142/2111] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 20:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1909440217 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:42.355755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.356421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.358473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.359193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.363237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.363773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.365134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.365419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.369716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.370382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.371378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.371823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.386843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] HTTP exception thrown: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. Mar 26 20:55:42.387457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Returning 404 to user: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:42.388522 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58168ad7-76d7-473d-90b7-7a2b5798fe1e tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "DELETE /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 404 len: 111 microversion: 2.21 time: 0.034796 Mar 26 20:55:42.390182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1143/2112] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:55:42 2022] DELETE /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:55:42.395985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e791045e-c964-489e-a4ef-b9ac201c0ef0 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e58c79310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.424263 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e791045e-c964-489e-a4ef-b9ac201c0ef0 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-84564008" status: 202 len: 0 microversion: 2.1 time: 0.032671 Mar 26 20:55:42.426647 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1144/2113] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-84564008 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:42.432674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.433862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.442832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.444147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.445995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.447167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.465608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:42.476022 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e928c65e-94b6-43b3-8701-8bf425f97c65 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1276 microversion: 2.1 time: 0.125132 Mar 26 20:55:42.476945 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 970/2114] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:42.491318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.491859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] [instance: 971824c7-c9de-412e-8368-23c0d4e267af] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.501400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.501517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.502487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.502827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.539459 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] HTTP exception thrown: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. Mar 26 20:55:42.539459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] Returning 404 to user: Instance 971824c7-c9de-412e-8368-23c0d4e267af could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:42.540990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23c2a91a-1606-4708-afa9-ad4c3d63de9f tempest-InstanceActionsV221TestJSON-1939018574 tempest-InstanceActionsV221TestJSON-1939018574-project] 10.222.0.16 "GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af" status: 404 len: 111 microversion: 2.21 time: 0.052467 Mar 26 20:55:42.541905 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 971/2115] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/971824c7-c9de-412e-8368-23c0d4e267af => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:55:42.547208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff78e665-e7b8-4f35-ba7f-8a3ace993016 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] Calling method '.version_select at 0x7f6e5ecf7d30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.570821 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff78e665-e7b8-4f35-ba7f-8a3ace993016 tempest-KeyPairsV2TestJSON-2058159113 tempest-KeyPairsV2TestJSON-2058159113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-963236772" status: 202 len: 0 microversion: 2.1 time: 0.027262 Mar 26 20:55:42.575966 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 972/2116] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-963236772 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:55:42.753399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:42.754750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:42.768001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.768650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.769628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:42.771700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:42.912625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:42.920654 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f31bea6d-6ec9-48d5-8cb1-39de53cd7490 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1477 microversion: 2.1 time: 0.492363 Mar 26 20:55:42.931525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1145/2117] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:43.049401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:43.050432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:43.058234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.059359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.060382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.060980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.557766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:43.571102 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60561305-d8e0-447d-80fd-b30d91e248ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.821768 Mar 26 20:55:43.572082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 973/2118] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:42 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:43.586268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2b1d3096-56e6-43e4-a263-6743fcbb6670 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e590af160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:43.634352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:43.644672 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15e1feea-cfc1-4ed7-a16b-74a7337aa41d tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.598672 Mar 26 20:55:43.645282 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1146/2119] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:43 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:43.659819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:43.660554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:43.671472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.671942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.672732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.673172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.684262 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2b1d3096-56e6-43e4-a263-6743fcbb6670 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.105878 Mar 26 20:55:43.685102 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 974/2120] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:43 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:43.698702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:43.740087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:43.740087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.740087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.740087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.741317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.801609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:43.810492 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e039b00-6cd2-45b3-b3d6-ee5d2a2eccce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1274 microversion: 2.1 time: 0.124458 Mar 26 20:55:43.811655 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 975/2121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:43 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:43.938786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:43.939222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:43.947141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.948308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:43.949356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:43.950034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.332116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:44.335897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b188ca4deda94cec85da4582a37fea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3ac21589f496b83c20104323f4bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:44.351086 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4fab7b50-4efd-4236-a1bb-ec0e9e85f6c5 tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 200 len: 1435 microversion: 2.1 time: 0.417406 Mar 26 20:55:44.357405 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 976/2122] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:43 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 1435 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:44.363628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-69eb0b8c-68a6-491c-905d-8fc1e2e6ddd3 req-6bee5437-7520-49ee-a881-9a58c01fc014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6bc3b-be73-4ff0-aae6-cc196c146232", "name": "network-vif-plugged", "status": "completed", "tag": "7ffc94eb-46a6-4da8-a517-632fac7bd7b9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:44.380286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2cb38a2-9b1f-4b5f-80f6-656aaa82f50a tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.731010 Mar 26 20:55:44.381994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1147/2123] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:43 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:44.387292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-69eb0b8c-68a6-491c-905d-8fc1e2e6ddd3 req-6bee5437-7520-49ee-a881-9a58c01fc014 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.388225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-69eb0b8c-68a6-491c-905d-8fc1e2e6ddd3 req-6bee5437-7520-49ee-a881-9a58c01fc014 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.421798 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-69eb0b8c-68a6-491c-905d-8fc1e2e6ddd3 req-6bee5437-7520-49ee-a881-9a58c01fc014 service nova] Creating event network-vif-plugged:7ffc94eb-46a6-4da8-a517-632fac7bd7b9 for instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 on nch1-master-1 Mar 26 20:55:44.434444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-69eb0b8c-68a6-491c-905d-8fc1e2e6ddd3 req-6bee5437-7520-49ee-a881-9a58c01fc014 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075413 Mar 26 20:55:44.436775 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 977/2124] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:44.568079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-275d9ab6-baa3-4148-94cc-73168a1321e1 req-6efe5c05-469b-424b-b0d7-9be680e147b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d629c1e-b428-4d65-9d91-f111668c4474", "name": "network-vif-deleted", "tag": "231a45bf-4b55-47bc-887f-02488ddbc3e0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:44.596252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:44.598103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:44.618906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-275d9ab6-baa3-4148-94cc-73168a1321e1 req-6efe5c05-469b-424b-b0d7-9be680e147b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.620657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-275d9ab6-baa3-4148-94cc-73168a1321e1 req-6efe5c05-469b-424b-b0d7-9be680e147b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.641898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.645343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.648781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.650300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.668430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-275d9ab6-baa3-4148-94cc-73168a1321e1 req-6efe5c05-469b-424b-b0d7-9be680e147b5 service nova] Creating event network-vif-deleted:231a45bf-4b55-47bc-887f-02488ddbc3e0 for instance 1d629c1e-b428-4d65-9d91-f111668c4474 on nch2-master-1 Mar 26 20:55:44.684100 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-275d9ab6-baa3-4148-94cc-73168a1321e1 req-6efe5c05-469b-424b-b0d7-9be680e147b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123019 Mar 26 20:55:44.698155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1148/2125] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:44.721000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:44.725267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:44.746478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.747321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.748892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:44.749556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:44.949239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:44.962408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cdeede99-24a7-4bb7-bf97-dcf7ac0600d3 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.376527 Mar 26 20:55:44.972579 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 978/2126] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:44 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:44.983957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce3d93aa-2d16-43e9-8ad4-960fe1968c95 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ecf9700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:45.070170 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce3d93aa-2d16-43e9-8ad4-960fe1968c95 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.093026 Mar 26 20:55:45.070858 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 979/2127] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:44 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:45.086787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:45.087458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:45.098820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.099279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.101361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.106183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.331033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:45.341871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc98c0d1-bbc5-4d01-8423-a3ed862769cb tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.638494 Mar 26 20:55:45.346230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1149/2128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:44 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:45.369338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:45.375895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] [instance: 1d629c1e-b428-4d65-9d91-f111668c4474] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:45.405624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.406097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.406936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.429771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.494119 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] HTTP exception thrown: Instance 1d629c1e-b428-4d65-9d91-f111668c4474 could not be found. Mar 26 20:55:45.494592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] Returning 404 to user: Instance 1d629c1e-b428-4d65-9d91-f111668c4474 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:45.495405 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74c57ed1-9882-4e63-88db-1aa03301884b tempest-ServersTestJSON-565652229 tempest-ServersTestJSON-565652229-project] 10.222.0.16 "GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474" status: 404 len: 111 microversion: 2.1 time: 0.130577 Mar 26 20:55:45.502436 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1150/2129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:45 2022] GET /compute/v2.1/servers/1d629c1e-b428-4d65-9d91-f111668c4474 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:45.513440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:45.520788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:45.521435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:45.522345 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6484fbb6-5df9-45bb-b61c-f76722c83a3b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.449803 Mar 26 20:55:45.527492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 980/2130] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:45 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:45.547804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.548312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.549116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:45.549559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:45.790733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:45.856322 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c172c2b6-dfd4-4f23-800d-974e2634cb8d tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.352704 Mar 26 20:55:45.865080 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1151/2131] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:45 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:45.980158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:45.980854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:46.003057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.006218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.007355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.010422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.084575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3422f31e-5bbf-4192-90c2-3fa88de3f699 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58bd0820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:46.162497 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3422f31e-5bbf-4192-90c2-3fa88de3f699 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.082303 Mar 26 20:55:46.166455 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1152/2132] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:46 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:46.364921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:46.369644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:46.377711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:46.379023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.380121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.381118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.381704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.390936 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31ad1175-60ad-42bc-a158-17eaddfd3a58 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1313 microversion: 2.1 time: 0.413579 Mar 26 20:55:46.394017 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 981/2133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:45 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:46.539899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:46.542282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:46.552763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.553589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.554543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.562648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.750681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:46.761839 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4da067e-9aa2-4c04-a230-1dfb91930505 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.225625 Mar 26 20:55:46.772977 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 982/2134] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:46 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:46.887561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:46.888501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:46.904220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.906409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:46.907488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:46.909770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.131797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:47.174919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:47.176245 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c693c0ff-e141-4989-b8e5-094a2ed96f83 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.294987 Mar 26 20:55:47.179422 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 983/2135] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:46 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:47.198183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6709c3f3-fdfd-4741-b21f-e1e5d7e27f7d tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ed2cc10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:47.198779 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b275cf6e-43a0-4b84-b853-99f685b8f7a4 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.834819 Mar 26 20:55:47.199417 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1153/2136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:46 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:47.288755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6709c3f3-fdfd-4741-b21f-e1e5d7e27f7d tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.107887 Mar 26 20:55:47.292737 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 984/2137] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:47 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:47.297118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7ad8053a-5f30-4993-abd8-2b87cb7063ff req-067d7bbe-fe6b-4fe0-bd13-0be2ae59878e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eb23ef-ff6c-425c-811a-1aa2cffe0aad", "name": "network-vif-plugged", "status": "completed", "tag": "f3c532be-691b-4c26-98db-d112c6a3c064"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:47.315416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7ad8053a-5f30-4993-abd8-2b87cb7063ff req-067d7bbe-fe6b-4fe0-bd13-0be2ae59878e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.315911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7ad8053a-5f30-4993-abd8-2b87cb7063ff req-067d7bbe-fe6b-4fe0-bd13-0be2ae59878e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.356308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7ad8053a-5f30-4993-abd8-2b87cb7063ff req-067d7bbe-fe6b-4fe0-bd13-0be2ae59878e service nova] Creating event network-vif-plugged:f3c532be-691b-4c26-98db-d112c6a3c064 for instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad on nch2-master-1 Mar 26 20:55:47.370516 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7ad8053a-5f30-4993-abd8-2b87cb7063ff req-067d7bbe-fe6b-4fe0-bd13-0be2ae59878e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076261 Mar 26 20:55:47.373839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1154/2138] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:47.411273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:47.411896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:47.433712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.434164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.435228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.435869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.786611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:47.787707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:47.801548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.806957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.807480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:47.808483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.811566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.824229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6fd35024-4d96-42d3-b874-c49abcf719c5 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1498 microversion: 2.1 time: 0.417729 Mar 26 20:55:47.827130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 985/2139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:47 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1498 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:47.857821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25b155e5-30a3-4939-afdb-160616980a80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:47.892613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.server_groups [None req-25b155e5-30a3-4939-afdb-160616980a80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Querying cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) for 1 instances {{(pid=141580) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 26 20:55:47.895408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25b155e5-30a3-4939-afdb-160616980a80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:47.897659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25b155e5-30a3-4939-afdb-160616980a80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:47.974666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25b155e5-30a3-4939-afdb-160616980a80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a" status: 200 len: 221 microversion: 2.1 time: 0.134804 Mar 26 20:55:47.976810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 986/2140] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:55:47 2022] GET /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a => generated 221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:55:47.999577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:48.000137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:48.013169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.014771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.016844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.027037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.101762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:55:48.304250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7943e9e-bc6c-4bb6-aa23-21a26ff1c48a tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 204 len: 0 microversion: 2.1 time: 0.318683 Mar 26 20:55:48.304863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 987/2141] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:47 2022] DELETE /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:48.319620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:48.321030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:48.345925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.346360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.347227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.347667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.365717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:48.391631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7805f23-7757-44cf-b3d5-e1afcdedc588 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.615480 Mar 26 20:55:48.416060 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1155/2142] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:47 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:55:48.426131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:48.427217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:48.436736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.437742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.438793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:48.439870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:48.864287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:48.970349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80aade56-7728-4c5b-89f8-4108fa8a3a7e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.662032 Mar 26 20:55:48.970745 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 988/2143] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:48 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:48.995632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3792cc4-d406-4fbc-8307-fecfc5aa9fd5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ed2cf70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:49.074331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3792cc4-d406-4fbc-8307-fecfc5aa9fd5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.083942 Mar 26 20:55:49.075441 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 989/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:48 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:49.083018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:49.083315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:49.095153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:49.095864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:49.096939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:49.097775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:49.318870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:49.329864 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bad39e96-d1a2-4466-abe6-7958f7c29f80 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1371 microversion: 2.1 time: 0.911407 Mar 26 20:55:49.330602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1156/2145] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:48 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1371 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:49.338124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-753e659e-2ce7-461c-b95f-c568d812953e req-5bc8e1c8-06fc-488d-ae22-153c4341fb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51099b7-6a2d-4a66-8a36-3b9b6c08e32e", "tag": "af98a4ed-6eab-45ad-b849-2a65a2546e72"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:49.362846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-753e659e-2ce7-461c-b95f-c568d812953e req-5bc8e1c8-06fc-488d-ae22-153c4341fb1d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:49.364975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-753e659e-2ce7-461c-b95f-c568d812953e req-5bc8e1c8-06fc-488d-ae22-153c4341fb1d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:49.395544 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-753e659e-2ce7-461c-b95f-c568d812953e req-5bc8e1c8-06fc-488d-ae22-153c4341fb1d service nova] Creating event network-changed:af98a4ed-6eab-45ad-b849-2a65a2546e72 for instance c51099b7-6a2d-4a66-8a36-3b9b6c08e32e on nch2-master-1 Mar 26 20:55:49.407005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-753e659e-2ce7-461c-b95f-c568d812953e req-5bc8e1c8-06fc-488d-ae22-153c4341fb1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073359 Mar 26 20:55:49.408287 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1157/2146] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:49.752500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:49.757837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2045972588", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "da61cd39-3e1b-4104-835e-2d58cdd32632"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:49.771394 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f3803cc-0d04-455c-991a-efe36e1f92ff tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1504 microversion: 2.1 time: 0.693706 Mar 26 20:55:49.772290 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 990/2147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:49 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1504 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:49.788533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:49.789453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:49.798277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:49.799080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:49.800213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:49.800876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:49.879549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] validate_networks() for [('da61cd39-3e1b-4104-835e-2d58cdd32632', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:50.372914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:50.380221 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f91d2521-f99c-432a-90eb-1c1cb928a427 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.606618 Mar 26 20:55:50.380796 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 991/2148] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:49 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:50.399612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:50.400258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:50.411707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:50.412175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:50.424474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:50.428733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:50.655047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:50.688232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-603edf7b-bb99-49e9-9b7e-fa93fc3a1fa6 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.306346 Mar 26 20:55:50.689237 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 992/2149] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:50 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:50.699081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10e7c0a7-54a9-49fe-aa52-70a775d46eec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ecf9550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:50.778298 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10e7c0a7-54a9-49fe-aa52-70a775d46eec tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.086425 Mar 26 20:55:50.780325 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 993/2150] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:50 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:50.791418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:50.792391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:50.812929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:50.813590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:50.814551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:50.815636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:51.206504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:51.233560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6adfddb-0c6b-4d7b-a53e-1b49353e31ca tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1558 microversion: 2.1 time: 0.452446 Mar 26 20:55:51.251042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 994/2151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:50 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1558 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:51.266594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:51.269617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:51.291634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:51.292286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:51.295060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:51.297861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.034161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c748958cc2c64a5c9f7af16cae37c969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dadd4e8f76f462b9f22b4211c7d5d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:52.060731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afe8b43d-6d3e-44d8-a1c9-54b699d64c9b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 200 len: 1504 microversion: 2.1 time: 0.808384 Mar 26 20:55:52.062188 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 995/2152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:51 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 1504 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:52.094749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:52.100242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:52.113049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.125673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.139190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.139814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.145071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:52.145563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:52.145972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:52.146703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:52.147120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:52.161942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.163761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.164677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.176103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.206127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:52.227023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for user 3c658c4a7b9c4d7886127c3e40f359f7 and project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:52.251784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:52.259296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:52.387689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7bb6e04-7826-474f-a6ee-d40285751a7b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.977850 Mar 26 20:55:52.393269 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1158/2153] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:52.406024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:52.406881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:52.429296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.430228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.437658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.439676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.524265 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d70e4965-6113-40fa-8967-b08c49c6e011 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.454351 Mar 26 20:55:52.525453 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 996/2154] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:55:52 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-interface => generated 285 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:52.535526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:52.536435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:52.550918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.551629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:52.552831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:52.559161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:53.072733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:53.085569 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a65965c-ee2a-4c0a-a25e-19da66584f27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.690906 Mar 26 20:55:53.086169 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1159/2155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:52 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:53.101445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93e593e0-356e-4694-94c5-524afa5f3f10 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58b1e550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:53.229328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93e593e0-356e-4694-94c5-524afa5f3f10 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.138992 Mar 26 20:55:53.237169 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1160/2156] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:53 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:53.258178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e8a16c1-4525-4803-9360-c18719fcc6ec tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58bb2940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:53.394602 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e8a16c1-4525-4803-9360-c18719fcc6ec tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3751315c-9dc4-4005-8125-589442d464ee" status: 200 len: 344 microversion: 2.1 time: 0.154013 Mar 26 20:55:53.395230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1161/2157] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:55:53 2022] GET /compute/v2.1/os-volumes/3751315c-9dc4-4005-8125-589442d464ee => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:53.405226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1900477425", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "da61cd39-3e1b-4104-835e-2d58cdd32632"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:53.577324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] validate_networks() for [('da61cd39-3e1b-4104-835e-2d58cdd32632', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:53.966115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:54.015383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-93c12992-f452-4130-9101-617dfbc7b27e tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 1.479043 Mar 26 20:55:54.016397 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 997/2158] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:52 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:54.030527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f34cc8d9-a049-4505-b0ef-5f9fabbcafa5 req-dc30a1b1-9904-4fc6-b4bb-db07923bda28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6bc3b-be73-4ff0-aae6-cc196c146232", "name": "network-vif-deleted", "tag": "7ffc94eb-46a6-4da8-a517-632fac7bd7b9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:54.059355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f34cc8d9-a049-4505-b0ef-5f9fabbcafa5 req-dc30a1b1-9904-4fc6-b4bb-db07923bda28 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.059824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f34cc8d9-a049-4505-b0ef-5f9fabbcafa5 req-dc30a1b1-9904-4fc6-b4bb-db07923bda28 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.090497 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f34cc8d9-a049-4505-b0ef-5f9fabbcafa5 req-dc30a1b1-9904-4fc6-b4bb-db07923bda28 service nova] Creating event network-vif-deleted:7ffc94eb-46a6-4da8-a517-632fac7bd7b9 for instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 on nch1-master-1 Mar 26 20:55:54.098801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f34cc8d9-a049-4505-b0ef-5f9fabbcafa5 req-dc30a1b1-9904-4fc6-b4bb-db07923bda28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074513 Mar 26 20:55:54.099771 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 998/2159] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:54.109031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:54.109740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:54.129115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.129574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.130371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.130817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.158449 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. Mar 26 20:55:54.159047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:54.159879 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-09711f5b-e31b-433c-b0a9-9e0a974fd716 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 404 len: 111 microversion: 2.1 time: 0.058979 Mar 26 20:55:54.165811 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 999/2160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:54 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:54.170568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:54.181025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:54.190187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.194452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.197141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.198596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.728349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:54.729040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:54.729742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:54.730345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:54.730956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:54.746533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.747128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.748086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:54.748676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:54.778813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:54.788205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for user 3c658c4a7b9c4d7886127c3e40f359f7 and project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:54.807574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:54.811406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:54.948373 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc123670-41d3-42aa-8009-98c0bd96463d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551686 Mar 26 20:55:54.949038 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1162/2161] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:54.963427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a5a4902f-5e70-4e9f-94ff-125e7c6d449c tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.040119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_groups [None req-a5a4902f-5e70-4e9f-94ff-125e7c6d449c tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Querying cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) for 1 instances {{(pid=141581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 26 20:55:55.041919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5a4902f-5e70-4e9f-94ff-125e7c6d449c tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.044517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5a4902f-5e70-4e9f-94ff-125e7c6d449c tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.092781 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a5a4902f-5e70-4e9f-94ff-125e7c6d449c tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.142594 Mar 26 20:55:55.093872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1163/2162] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:55:54 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:55.100112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-046d0bdb-0a27-4b9e-88bb-825b1d90fa5c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58b2adc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.162566 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-046d0bdb-0a27-4b9e-88bb-825b1d90fa5c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.066703 Mar 26 20:55:55.163732 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1164/2163] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:55 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:55.180256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.192689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:55.201009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.201832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.203046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.203759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.343026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:55.382595 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-789179c4-23b7-4521-b173-b4cc21dc6525 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 1.210837 Mar 26 20:55:55.385218 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1000/2164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:54 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:55.409427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-929032627", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "451", "networks": [{"uuid": "da61cd39-3e1b-4104-835e-2d58cdd32632"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:55.438100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:55.498377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2aaba580-34ac-4139-864c-5049f60b4847 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.333334 Mar 26 20:55:55.499620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1165/2165] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:55 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:55.516190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa2394c3-3efe-4c0a-b115-62eb45c25b42 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.551881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_groups [None req-aa2394c3-3efe-4c0a-b115-62eb45c25b42 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Querying cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) for 1 instances {{(pid=141581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 26 20:55:55.556090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa2394c3-3efe-4c0a-b115-62eb45c25b42 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.557976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa2394c3-3efe-4c0a-b115-62eb45c25b42 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.580084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] validate_networks() for [('da61cd39-3e1b-4104-835e-2d58cdd32632', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:55:55.582797 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa2394c3-3efe-4c0a-b115-62eb45c25b42 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a" status: 200 len: 183 microversion: 2.1 time: 0.081893 Mar 26 20:55:55.587950 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1166/2166] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:55:55 2022] GET /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:55.595356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebc8ebeb-b42e-496b-8674-465cb8efab43 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58c791f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.686941 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebc8ebeb-b42e-496b-8674-465cb8efab43 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01e091d3-23ed-4dd3-9ff0-6322c665775f" status: 200 len: 343 microversion: 2.1 time: 0.097621 Mar 26 20:55:55.687907 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1167/2167] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:55:55 2022] GET /compute/v2.1/os-volumes/01e091d3-23ed-4dd3-9ff0-6322c665775f => generated 343 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:55.692866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6cc1ea8c-e40e-4e07-8799-06232f73bdda req-13a96082-4c65-4dbb-8206-450090ecdde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89eb23ef-ff6c-425c-811a-1aa2cffe0aad", "tag": "f3c532be-691b-4c26-98db-d112c6a3c064"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:55:55.721500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6cc1ea8c-e40e-4e07-8799-06232f73bdda req-13a96082-4c65-4dbb-8206-450090ecdde1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.730494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6cc1ea8c-e40e-4e07-8799-06232f73bdda req-13a96082-4c65-4dbb-8206-450090ecdde1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.770777 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6cc1ea8c-e40e-4e07-8799-06232f73bdda req-13a96082-4c65-4dbb-8206-450090ecdde1 service nova] Creating event network-changed:f3c532be-691b-4c26-98db-d112c6a3c064 for instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad on nch2-master-1 Mar 26 20:55:55.801494 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6cc1ea8c-e40e-4e07-8799-06232f73bdda req-13a96082-4c65-4dbb-8206-450090ecdde1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104062 Mar 26 20:55:55.802746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1168/2168] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:55.818847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.819479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:55.843390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.843628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.844395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.844836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.890023 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. Mar 26 20:55:55.890651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:55.891551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcf5614d-b785-4c99-87f1-a83e21fe0d37 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 404 len: 111 microversion: 2.1 time: 0.087389 Mar 26 20:55:55.896341 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1169/2169] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:55:55 2022] DELETE /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:55.905116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:55.905732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] [instance: 46b6bc3b-be73-4ff0-aae6-cc196c146232] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:55.933112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.933688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.934531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:55.934974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:55.986910 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. Mar 26 20:55:55.987358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance 46b6bc3b-be73-4ff0-aae6-cc196c146232 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:55.988316 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3716a832-fbc6-43e9-aa53-50324341cb3b tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232" status: 404 len: 111 microversion: 2.1 time: 0.087088 Mar 26 20:55:55.989187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1170/2170] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:55 2022] GET /compute/v2.1/servers/46b6bc3b-be73-4ff0-aae6-cc196c146232 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:56.001407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb95c5d5-3514-4805-a35f-0d6ecf49fea1 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.036208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-eb95c5d5-3514-4805-a35f-0d6ecf49fea1 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance group eca75db1-3310-4a77-bb08-2eb987e6fcfe could not be found. Mar 26 20:55:56.036824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb95c5d5-3514-4805-a35f-0d6ecf49fea1 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance group eca75db1-3310-4a77-bb08-2eb987e6fcfe could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:56.043778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb95c5d5-3514-4805-a35f-0d6ecf49fea1 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/eca75db1-3310-4a77-bb08-2eb987e6fcfe" status: 404 len: 117 microversion: 2.1 time: 0.049187 Mar 26 20:55:56.047209 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1171/2171] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:55 2022] DELETE /compute/v2.1/os-server-groups/eca75db1-3310-4a77-bb08-2eb987e6fcfe => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:56.058288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cf6a9bf-d9b9-4377-8cb0-c1f2ee7483ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.097652 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9cf6a9bf-d9b9-4377-8cb0-c1f2ee7483ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance group bdd68873-ecf0-4db9-aef0-f462cf8972f8 could not be found. Mar 26 20:55:56.101511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cf6a9bf-d9b9-4377-8cb0-c1f2ee7483ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance group bdd68873-ecf0-4db9-aef0-f462cf8972f8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:56.102413 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9cf6a9bf-d9b9-4377-8cb0-c1f2ee7483ad tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/bdd68873-ecf0-4db9-aef0-f462cf8972f8" status: 404 len: 117 microversion: 2.1 time: 0.051308 Mar 26 20:55:56.110598 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1172/2172] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:56 2022] DELETE /compute/v2.1/os-server-groups/bdd68873-ecf0-4db9-aef0-f462cf8972f8 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:56.136232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebfa601e-2dad-4744-84d6-0aec70a01e80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.150950 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ebfa601e-2dad-4744-84d6-0aec70a01e80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance group 3c6913a0-e041-426b-9eb8-2069a156176e could not be found. Mar 26 20:55:56.154321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebfa601e-2dad-4744-84d6-0aec70a01e80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance group 3c6913a0-e041-426b-9eb8-2069a156176e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:56.155342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebfa601e-2dad-4744-84d6-0aec70a01e80 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/3c6913a0-e041-426b-9eb8-2069a156176e" status: 404 len: 117 microversion: 2.1 time: 0.041857 Mar 26 20:55:56.163202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1173/2173] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:56 2022] DELETE /compute/v2.1/os-server-groups/3c6913a0-e041-426b-9eb8-2069a156176e => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:56.171252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6922777-0212-4bd6-b30f-f687932bab88 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.192246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e6922777-0212-4bd6-b30f-f687932bab88 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] HTTP exception thrown: Instance group 21502234-9196-4ca8-94a7-06fc00ed0987 could not be found. Mar 26 20:55:56.195906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6922777-0212-4bd6-b30f-f687932bab88 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Returning 404 to user: Instance group 21502234-9196-4ca8-94a7-06fc00ed0987 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:55:56.201472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6922777-0212-4bd6-b30f-f687932bab88 tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/21502234-9196-4ca8-94a7-06fc00ed0987" status: 404 len: 117 microversion: 2.1 time: 0.036627 Mar 26 20:55:56.204934 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1174/2174] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:56 2022] DELETE /compute/v2.1/os-server-groups/21502234-9196-4ca8-94a7-06fc00ed0987 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:56.234564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a774b86c-679a-4e84-a7be-3644bcc30639 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ed53160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.343962 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a774b86c-679a-4e84-a7be-3644bcc30639 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.137515 Mar 26 20:55:56.345577 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1175/2175] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:56 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:56.352439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31add64a-f056-49ff-9e91-d2b757236ffe tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.409469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31add64a-f056-49ff-9e91-d2b757236ffe tempest-ServerGroupTestJSON-694495216 tempest-ServerGroupTestJSON-694495216-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a" status: 204 len: 0 microversion: 2.1 time: 0.061378 Mar 26 20:55:56.411846 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1176/2176] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:55:56 2022] DELETE /compute/v2.1/os-server-groups/d90df2d9-31f9-4437-8d2e-ad10e905702a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:55:56.426400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:56.429161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:56.443937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:56.444421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:56.448559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:56.449058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:57.474926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:57.490036 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e7def83-7056-435c-922f-80d87afc6804 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 1.076776 Mar 26 20:55:57.492603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1177/2177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:56 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:57.502600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:57.505656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:57.520471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:57.520967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:57.525753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:57.527705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:57.546952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:55:57.548285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:55:57.549182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:55:57.550694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:55:57.551384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:55:57.574286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:57.576322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:57.577478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:57.579665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:57.622014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:55:57.635422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Getting quotas for user 3c658c4a7b9c4d7886127c3e40f359f7 and project a6beb485658f40dc83598fd2e00800ad. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:55:57.671811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:55:57.680360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:55:57.801301 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eecaab7b-ffbe-418c-b3e2-3b9fb30a1657 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.410954 Mar 26 20:55:57.819172 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1001/2178] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:55:57.846603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:57.856290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e597a845-2afb-46b6-9cf9-6df76d7e9259 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ec40790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:57.953045 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e597a845-2afb-46b6-9cf9-6df76d7e9259 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.127967 Mar 26 20:55:57.953739 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1002/2179] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:57 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:57.963196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c259a5d1-c386-4bcc-a4b0-1467434312c0 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e59073940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:57.968686 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e230b2bc-1fdc-4139-adae-b68d9bb78dea tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.474260 Mar 26 20:55:57.969487 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1178/2180] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:57 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:58.029873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-422488cd-8410-4176-b06b-6151ff62c0d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:58.030503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-422488cd-8410-4176-b06b-6151ff62c0d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:58.145686 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c259a5d1-c386-4bcc-a4b0-1467434312c0 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5f974eea-182a-4b76-8962-63e03dfbfe94" status: 200 len: 344 microversion: 2.1 time: 0.189585 Mar 26 20:55:58.147400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1003/2181] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:55:57 2022] GET /compute/v2.1/os-volumes/5f974eea-182a-4b76-8962-63e03dfbfe94 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:58.164243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de6d8777-889e-4159-abb8-043dc42c01c3 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e5ed2ca60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:58.378560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-422488cd-8410-4176-b06b-6151ff62c0d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:55:58.388099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-422488cd-8410-4176-b06b-6151ff62c0d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1220 microversion: 2.1 time: 0.381419 Mar 26 20:55:58.388718 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1179/2182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:57 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1220 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:58.433032 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de6d8777-889e-4159-abb8-043dc42c01c3 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.278003 Mar 26 20:55:58.433611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1004/2183] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 20:55:58 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:58.448993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-09296075-8d7c-43e8-9d20-74eb924848f9 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58b2a0d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:58.508368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:58.509946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:58.527410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:58.533759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:58.536616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:58.539509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:58.690166 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-09296075-8d7c-43e8-9d20-74eb924848f9 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.246827 Mar 26 20:55:58.698717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1180/2184] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:55:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:58.703554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a96b8e19-3f1f-476c-9cea-d65d679aabce tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58acc1f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:58.950354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a96b8e19-3f1f-476c-9cea-d65d679aabce tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.250471 Mar 26 20:55:58.956629 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1181/2185] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 20:55:58 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:58.963862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-582bda16-cc9e-4f69-8966-d0258223155b tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58b2a280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:59.174995 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-582bda16-cc9e-4f69-8966-d0258223155b tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.216669 Mar 26 20:55:59.175590 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1182/2186] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:55:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:55:59.188696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edb3615b-d3c4-49c4-ba53-4a96718d4c36 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e58b1eee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:59.267749 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edb3615b-d3c4-49c4-ba53-4a96718d4c36 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.088983 Mar 26 20:55:59.269793 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1183/2187] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:59 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:55:59.288663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:59.291592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:59.311284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:59.311754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:59.312598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:59.313035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:59.514420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:55:59.567081 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3effaf6b-a954-45e2-a9de-bcb4da85fb6c tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.289177 Mar 26 20:55:59.573639 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1184/2188] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:55:59 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:55:59.578481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d37712b3-6359-46fe-a14d-670c6638d780 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58c794c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:59.769929 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d37712b3-6359-46fe-a14d-670c6638d780 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.194619 Mar 26 20:55:59.780168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1185/2189] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 20:55:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:55:59.785150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:55:59.785780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:55:59.822284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:59.823267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:55:59.824459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:55:59.825057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:00.019839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:00.029600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1671d610-4fac-4fe9-81e5-780bc3d0d960 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1272 microversion: 2.1 time: 0.248201 Mar 26 20:56:00.030202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1186/2190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:59 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:00.044568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbd5d0d7-6bbd-4d14-a369-292968c8588b tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58b2a0d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:00.063696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:00.091068 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-83ccdd60-9ba6-4699-9071-b9c774d81d42 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 1.570386 Mar 26 20:56:00.098163 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1005/2191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:55:58 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:00.114858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d76141be-6241-4e36-a9e7-c74734c2aa5e req-35f1aa78-9584-4d15-99b5-8e69887cef12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51099b7-6a2d-4a66-8a36-3b9b6c08e32e", "name": "network-vif-plugged", "status": "completed", "tag": "af98a4ed-6eab-45ad-b849-2a65a2546e72"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:00.133399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d76141be-6241-4e36-a9e7-c74734c2aa5e req-35f1aa78-9584-4d15-99b5-8e69887cef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:00.136855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d76141be-6241-4e36-a9e7-c74734c2aa5e req-35f1aa78-9584-4d15-99b5-8e69887cef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:00.166110 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d76141be-6241-4e36-a9e7-c74734c2aa5e req-35f1aa78-9584-4d15-99b5-8e69887cef12 service nova] Creating event network-vif-plugged:af98a4ed-6eab-45ad-b849-2a65a2546e72 for instance c51099b7-6a2d-4a66-8a36-3b9b6c08e32e on nch2-master-1 Mar 26 20:56:00.181850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d76141be-6241-4e36-a9e7-c74734c2aa5e req-35f1aa78-9584-4d15-99b5-8e69887cef12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079974 Mar 26 20:56:00.182476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1006/2192] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:00.283513 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bbd5d0d7-6bbd-4d14-a369-292968c8588b tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.247643 Mar 26 20:56:00.285108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1187/2193] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:56:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:00.299423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcaf94cd-df45-426b-be0c-3f78fb23f0d2 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e58b52040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:00.300491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b76188c-1a8b-4982-a4d6-7be8b6d3c175 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ecf7ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:00.370942 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b76188c-1a8b-4982-a4d6-7be8b6d3c175 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.089229 Mar 26 20:56:00.371536 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1007/2194] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:00 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:00.430868 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcaf94cd-df45-426b-be0c-3f78fb23f0d2 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.137284 Mar 26 20:56:00.431452 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1188/2195] 10.222.0.16 () {58 vars in 1187 bytes} [Sat Mar 26 20:56:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:00.443534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-143f5346-6dec-4932-bf73-419e2b1cfce0 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] Calling method '.version_select at 0x7f6e590738b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:00.583623 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-143f5346-6dec-4932-bf73-419e2b1cfce0 tempest-VolumesTestJSON-1881710145 tempest-VolumesTestJSON-1881710145-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.143938 Mar 26 20:56:00.589142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:00.590027 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1008/2196] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 20:56:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:00.590845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:00.611118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:00.612771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:00.613752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:00.614623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:00.863563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:00.895619 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b982d2c5-faaf-4e00-9a59-4cd12aa28085 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.310550 Mar 26 20:56:00.897546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1189/2197] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:00 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:01.054352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:01.056106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:01.068850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.073799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.075037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.077434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.118609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:01.119251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:01.138462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.138921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.139725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.140192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.225694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:01.255254 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9798335-24cd-4abf-9db1-e16e8f1d583b tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1278 microversion: 2.1 time: 0.205805 Mar 26 20:56:01.259882 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1009/2198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:01 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:01.386238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c17fe48-3347-4d49-9f9f-9454c51ebf12 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ecf7310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:01.483645 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c17fe48-3347-4d49-9f9f-9454c51ebf12 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.103176 Mar 26 20:56:01.484969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1010/2199] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:01 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:01.641940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:01.654807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f37dc781-c14c-400c-aadc-4206414ad0a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1316 microversion: 2.1 time: 0.545527 Mar 26 20:56:01.658151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1190/2200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:01 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:01.919014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:01.920025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:01.933923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.941404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.960636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:01.961925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:01.980180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cb96f21c-7a2a-4a2f-9705-983866bac263 req-13cf54c8-020c-40e5-b695-78c7e06ba10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c3cd28-3614-4e17-83c3-c0c6a41b5992", "tag": "e5c0bdb1-41fd-4c45-b5d0-737709a48337"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:02.007682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb96f21c-7a2a-4a2f-9705-983866bac263 req-13cf54c8-020c-40e5-b695-78c7e06ba10b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:02.011024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb96f21c-7a2a-4a2f-9705-983866bac263 req-13cf54c8-020c-40e5-b695-78c7e06ba10b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:02.047783 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cb96f21c-7a2a-4a2f-9705-983866bac263 req-13cf54c8-020c-40e5-b695-78c7e06ba10b service nova] Creating event network-changed:e5c0bdb1-41fd-4c45-b5d0-737709a48337 for instance 78c3cd28-3614-4e17-83c3-c0c6a41b5992 on nch1-master-1 Mar 26 20:56:02.058667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cb96f21c-7a2a-4a2f-9705-983866bac263 req-13cf54c8-020c-40e5-b695-78c7e06ba10b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087612 Mar 26 20:56:02.065940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1191/2201] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Mar 26 20:56:02.275970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:02.280617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:02.281473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:02.323796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3ea5f9d9-0935-4769-970f-74ec373aa2c9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.408994 Mar 26 20:56:02.325433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1011/2202] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:01 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:02.349528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:02.349979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:02.350836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:02.357696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:02.500614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-050640aa-c29c-4cda-9aa9-151f0d2bd575 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ec40670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:02.621701 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-050640aa-c29c-4cda-9aa9-151f0d2bd575 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.127644 Mar 26 20:56:02.622988 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1012/2203] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:02 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:02.674668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:02.675300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:02.694087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:02.696972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:02.698416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:02.698873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:03.581710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:03.595954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6de1f05e-72b6-4355-80db-3b6b75afd10e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1278 microversion: 2.1 time: 1.320673 Mar 26 20:56:03.597877 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1192/2204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:02 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1278 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:03.624168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:03.626567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:03.653217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:03.659596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:03.660844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:03.661512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:03.693088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:03.708721 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb4f5d51-97e8-4bbd-8605-24e2033560ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1466 microversion: 2.1 time: 1.038603 Mar 26 20:56:03.710826 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1013/2205] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:02 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1466 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:03.725644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ae17ebb-f1a1-44d6-83ce-9319fbc904d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ec405e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:03.828466 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ae17ebb-f1a1-44d6-83ce-9319fbc904d6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.112858 Mar 26 20:56:03.830250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1014/2206] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:03 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:03.889610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:03.955899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a35f7117-e01b-4919-9cb1-0232a417a0af tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.344302 Mar 26 20:56:03.970450 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1193/2207] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:03 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:04.236027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:04.237061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:04.244225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:04.244950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:04.245987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:04.246658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:04.619687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:04.620889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:04.640326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:04.640791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:04.645534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:04.646006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:05.456441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d22e3e15-4cd1-4fb6-ad55-d474da4649b2 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1617 microversion: 2.1 time: 1.621151 Mar 26 20:56:05.458970 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1015/2208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:03 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1617 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:05.477166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f25e6ef-24bc-4432-b4b4-b74de3c3f7df tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ec9b550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:05.551157 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4f25e6ef-24bc-4432-b4b4-b74de3c3f7df tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.089535 Mar 26 20:56:05.551767 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1016/2209] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:05 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:05.562274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:05.563303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:05.580783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:05.581611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:05.583994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:05.585561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:05.656330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:05.706784 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-703b6e81-fd9f-4b41-a806-3f7c3eb04697 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 1.093546 Mar 26 20:56:05.719441 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1194/2210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:04 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:05.733699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: .version_select at 0x7f6e58b02700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1022004739", "policies": ["affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:05.787230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:05.791427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:05.807448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:05.840502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6458f604-4690-464f-9870-434be7f465f2 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.287109 Mar 26 20:56:05.844068 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1017/2211] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:05 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:05.895204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:05.906029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:05.925114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbe727e2-488f-4a6d-9ebb-8e9a69bbe10c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.202651 Mar 26 20:56:05.925721 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1195/2212] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 20:56:05 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:06.130637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a968b513-40d2-45ac-b284-fb3c92edcc8e req-6f3ed9aa-44bd-4816-9000-90e045f8e956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6833d6e-98a8-45aa-b478-03846a702b18", "tag": "2da49cd1-c1ff-4ee7-ae87-4672c4430a08"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:06.147629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: .version_select at 0x7f6e5ec9b160>, body: {"keypair": {"name": "tempest-keypair-1228724138"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:06.166711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a968b513-40d2-45ac-b284-fb3c92edcc8e req-6f3ed9aa-44bd-4816-9000-90e045f8e956 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:06.167219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a968b513-40d2-45ac-b284-fb3c92edcc8e req-6f3ed9aa-44bd-4816-9000-90e045f8e956 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:06.197587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:06.215286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a968b513-40d2-45ac-b284-fb3c92edcc8e req-6f3ed9aa-44bd-4816-9000-90e045f8e956 service nova] Creating event network-changed:2da49cd1-c1ff-4ee7-ae87-4672c4430a08 for instance e6833d6e-98a8-45aa-b478-03846a702b18 on nch1-master-1 Mar 26 20:56:06.220922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:06.231999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a968b513-40d2-45ac-b284-fb3c92edcc8e req-6f3ed9aa-44bd-4816-9000-90e045f8e956 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107837 Mar 26 20:56:06.238255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1196/2213] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:06.254702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-731810358", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a02d23dc-1421-4fe9-a394-81571343007e"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:06.358709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:06.425460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:06.432527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:06.455066 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d1aae3f9-1588-4d14-8b4b-47033385c5aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.609371 Mar 26 20:56:06.463146 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1018/2214] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:56:05 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:06.564441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd34b9ac-311d-402b-98dc-95a67dff8e71 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ebfd310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:06.647491 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bd34b9ac-311d-402b-98dc-95a67dff8e71 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1424 microversion: 2.1 time: 0.087092 Mar 26 20:56:06.648383 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1019/2215] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:06 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:06.726560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:06.729365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:06.736889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:06.737266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:06.738102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:06.751832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:07.528349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:07.528899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:07.529240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:07.529654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:07.530067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:07.561686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:07.570835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82442bf2-7966-4f57-bc2b-5d966112e77c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.849342 Mar 26 20:56:07.588344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:07.588813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:07.589622 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1020/2216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:06 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:07.593432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:07.596862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:07.599570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:07.606311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:07.632195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:07.632670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:07.633536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:07.633991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:07.669163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:07.693805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:07.728394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 2 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:07.744668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:07.826744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141581) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Mar 26 20:56:07.872541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:07.886252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:07.979804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:08.000695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:08.011586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:08.027314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d33f0ee9-b54d-40ee-bad4-b08b37086f5b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1929 microversion: 2.75 time: 0.436521 Mar 26 20:56:08.028690 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1021/2217] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:07 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1929 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:08.041398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc1eb9b1-10ce-458f-a327-f303e3736ac5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ed500d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.050959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=110b4849-d543-4a97-a107-aefdf033c2b0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:08.125484 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc1eb9b1-10ce-458f-a327-f303e3736ac5 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1433 microversion: 2.1 time: 0.094385 Mar 26 20:56:08.126453 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1022/2218] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:08.136906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4daffdc5-9926-4799-80ce-940421f7d614 req-90143303-1655-4f84-8b20-a93cff3ac864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2531d82d-f786-4c55-ae92-5dd6abe2083b", "tag": "56d251dd-2d4d-4ce8-9b31-52c7c34abe80"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:08.151678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4daffdc5-9926-4799-80ce-940421f7d614 req-90143303-1655-4f84-8b20-a93cff3ac864 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.152849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4daffdc5-9926-4799-80ce-940421f7d614 req-90143303-1655-4f84-8b20-a93cff3ac864 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.182283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:08.190337 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4daffdc5-9926-4799-80ce-940421f7d614 req-90143303-1655-4f84-8b20-a93cff3ac864 service nova] Creating event network-changed:56d251dd-2d4d-4ce8-9b31-52c7c34abe80 for instance 2531d82d-f786-4c55-ae92-5dd6abe2083b on nch2-master-1 Mar 26 20:56:08.196707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:08.200764 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4daffdc5-9926-4799-80ce-940421f7d614 req-90143303-1655-4f84-8b20-a93cff3ac864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072736 Mar 26 20:56:08.206092 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1023/2219] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:08.217020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbce4e6b-4750-40f3-a2ff-332b44baaff0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e59408ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.300980 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbce4e6b-4750-40f3-a2ff-332b44baaff0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 200 len: 1433 microversion: 2.1 time: 0.093157 Mar 26 20:56:08.301748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1024/2220] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 1433 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:08.303350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:08.313932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.315861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:08.320012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:08.341718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.342525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.344741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.346788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.424656 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c553bb97-9c43-4658-92da-70288b0c095c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.178848 Mar 26 20:56:08.430105 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1197/2221] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 2185 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Mar 26 20:56:08.438514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.442467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:08.443605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Searching by: {'deleted': False, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:08.463224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.464133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.465191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.465946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.501058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:08.551105 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74c4327b-cf6f-480d-b62d-acd8bffbfe07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.119097 Mar 26 20:56:08.552724 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1198/2222] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/servers => generated 1001 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:08.566952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ade52154-f179-4d78-9d04-3cf561064946 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.567899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ade52154-f179-4d78-9d04-3cf561064946 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:08.780661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ade52154-f179-4d78-9d04-3cf561064946 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:08.793221 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ade52154-f179-4d78-9d04-3cf561064946 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1218 microversion: 2.1 time: 0.230891 Mar 26 20:56:08.793798 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1199/2223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:08.818232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:08.835582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:08.852817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.853735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:08.856172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:08.862172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:09.106679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:09.135400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-613c0e5b-7565-4d84-8e53-8981f87d0b73 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1466 microversion: 2.1 time: 0.824685 Mar 26 20:56:09.138433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1025/2224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1466 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:09.163286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:09.170158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:09.181944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:09.182670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:09.183859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:09.184569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:09.539809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:09.552937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:09.568741 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b6a1d808-dbc7-4add-a1f7-a0664f7373a8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.757380 Mar 26 20:56:09.571932 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1121562a-bb7d-44ca-94e8-5638415b275f tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1935 microversion: 2.75 time: 0.431498 Mar 26 20:56:09.573870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1026/2225] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:09 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1935 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:09.579662 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1200/2226] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:08 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:09.594129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8da7aebc-9b9a-4af6-85c8-b5b678f1a28c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e5ec9b550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:09.975083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2147170273", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:10.098087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] validate_networks() for [('be591c69-cd3a-488a-85f8-878cc8898e3b', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:10.726076 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8da7aebc-9b9a-4af6-85c8-b5b678f1a28c tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "DELETE /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16" status: 204 len: 0 microversion: 2.1 time: 1.150736 Mar 26 20:56:10.726644 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1027/2227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:09 2022] DELETE /compute/v2.1/images/23225b09-f6d3-438d-9937-96cd3e19fe16 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:56:10.732252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:10.733114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:10.740418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:10.741134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:10.742090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:10.742710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:10.864111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:10.873317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13240688-9064-4a07-bdcc-821a0fa374f7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1270 microversion: 2.1 time: 0.145492 Mar 26 20:56:10.874634 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1028/2228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:10 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:10.881931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:10.882746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:10.889691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:10.891122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:10.892598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:10.893244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.184605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:11.194380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e2a7bf2d-a63c-407e-a5f4-b53b3314c0b5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.318401 Mar 26 20:56:11.201519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1029/2229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:10 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:11.216339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:11.218773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:11.238687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.239483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.240538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.243456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.386969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:11.410253 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7eb3170-39cf-4869-a30f-3f70b61539b9 tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1935 microversion: 2.75 time: 0.207338 Mar 26 20:56:11.413576 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1030/2230] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:11 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1935 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:11.420109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd4a0242-b8a3-4896-8a8e-57cdb894e0ce tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '.version_select at 0x7f6e59408dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:11.489164 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-bd4a0242-b8a3-4896-8a8e-57cdb894e0ce tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] HTTP exception thrown: Image not found. Mar 26 20:56:11.490655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd4a0242-b8a3-4896-8a8e-57cdb894e0ce tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:11.491956 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bd4a0242-b8a3-4896-8a8e-57cdb894e0ce tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "DELETE /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b" status: 404 len: 62 microversion: 2.1 time: 0.076520 Mar 26 20:56:11.494445 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1031/2231] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:11 2022] DELETE /compute/v2.1/images/00d7f682-6536-490a-be90-3ff7650c1a7b => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:56:11.500525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7fd1dbac-5103-4f90-86f3-636cab15336c req-0e0396ae-645f-4d8a-b14f-db12af0d41e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-unplugged", "status": "completed", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:11.512051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7fd1dbac-5103-4f90-86f3-636cab15336c req-0e0396ae-645f-4d8a-b14f-db12af0d41e8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.512856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7fd1dbac-5103-4f90-86f3-636cab15336c req-0e0396ae-645f-4d8a-b14f-db12af0d41e8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.533556 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7fd1dbac-5103-4f90-86f3-636cab15336c req-0e0396ae-645f-4d8a-b14f-db12af0d41e8 service nova] Creating event network-vif-unplugged:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:56:11.542978 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7fd1dbac-5103-4f90-86f3-636cab15336c req-0e0396ae-645f-4d8a-b14f-db12af0d41e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046191 Mar 26 20:56:11.544851 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1032/2232] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:11.552143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:11.552754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:11.562517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.562991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.563788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.564266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.601034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:56:11.739042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5112d987-fbf4-47ab-b0fc-3e110abca2af tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "DELETE /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 204 len: 0 microversion: 2.1 time: 0.191874 Mar 26 20:56:11.740171 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1033/2233] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:56:11 2022] DELETE /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:56:11.749643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:11.750682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:11.758659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.759383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:11.760754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:11.761556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.060203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:12.061634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:12.063380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:12.064146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:12.065023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:12.066429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b424d3ed-8bbd-4bbc-85b5-47fecf191a5e tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1472 microversion: 2.1 time: 0.321376 Mar 26 20:56:12.066942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1034/2234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:11 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:12.076087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:12.078609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:12.079235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:12.094801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.094801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.095161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.097696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.146897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.149651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.156061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.156544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.195390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Getting quotas for project 1e309921cfc047bda328e3ad23aa5e7a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:12.211448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Getting quotas for user 563bce524229478faa4886b1d2285114 and project 1e309921cfc047bda328e3ad23aa5e7a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:12.242412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:12.248696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:12.338599 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f63a372-512b-4a3d-9746-e23962d0288d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.757578 Mar 26 20:56:12.339241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1201/2235] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:56:12.367207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:12.367887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:12.387865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.388601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.390739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.399744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.616502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:12.624994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e2a8196-d2a5-49a5-8c70-68715c21e6d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.556063 Mar 26 20:56:12.628373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1035/2236] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:12 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:12.634222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24bc97ed-1b38-4493-a24c-9a5e131389a7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:12.634851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24bc97ed-1b38-4493-a24c-9a5e131389a7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:12.748644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24bc97ed-1b38-4493-a24c-9a5e131389a7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:12.762302 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24bc97ed-1b38-4493-a24c-9a5e131389a7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1224 microversion: 2.1 time: 0.132789 Mar 26 20:56:12.763684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1036/2237] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:12 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:12.770447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:12.771253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:12.780498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.781224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.783033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:12.783676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:12.964703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:12.975093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] Lazy-loading 'services' on Instance uuid 144e3453-826b-4d91-88a0-21a8a961b3ab {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:12.981786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8cdcc89-a4bc-4f3a-9110-2fef0a99a2ff tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.629207 Mar 26 20:56:12.985144 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1202/2238] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:12 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:13.029427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2b9d8a45-b0e3-4263-bc2a-8f69bdfb216b tempest-ServersAdmin275Test-845881470 tempest-ServersAdmin275Test-845881470-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1920 microversion: 2.75 time: 0.263961 Mar 26 20:56:13.030257 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1037/2239] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:12 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1920 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:13.060687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:13.061258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:13.072098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.072720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.076768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.077328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.084924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:13.089021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:13.113783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.119294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.121765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.125907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.198871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:56:13.401352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ea5ba43-ed1f-4e72-aaf7-5d40acefc20e tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "DELETE /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 204 len: 0 microversion: 2.75 time: 0.348999 Mar 26 20:56:13.403557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1203/2240] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:56:13 2022] DELETE /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:56:13.417499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:13.418281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:13.427041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.427883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.428955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.429557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.529742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:13.575286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:13.580556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:13.607776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76f85d2c-fcb3-45f9-9614-d9791900d885 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1444 microversion: 2.75 time: 0.198387 Mar 26 20:56:13.629044 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1204/2241] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:13 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:13.645382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:13.651240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-84038768-2641-4cdb-9976-2b5832e2f68e req-0bc11d33-a231-4405-be28-1ea75245e325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c3cd28-3614-4e17-83c3-c0c6a41b5992", "name": "network-vif-plugged", "status": "completed", "tag": "e5c0bdb1-41fd-4c45-b5d0-737709a48337"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:13.654562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4648db8b-5494-4a8d-bad7-8d6aea83ddb0 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1472 microversion: 2.1 time: 0.575221 Mar 26 20:56:13.658207 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1038/2242] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:13 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:13.666374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-84038768-2641-4cdb-9976-2b5832e2f68e req-0bc11d33-a231-4405-be28-1ea75245e325 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.667481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-84038768-2641-4cdb-9976-2b5832e2f68e req-0bc11d33-a231-4405-be28-1ea75245e325 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.673511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:13.674336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:13.685520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.685761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-84038768-2641-4cdb-9976-2b5832e2f68e req-0bc11d33-a231-4405-be28-1ea75245e325 service nova] Creating event network-vif-plugged:e5c0bdb1-41fd-4c45-b5d0-737709a48337 for instance 78c3cd28-3614-4e17-83c3-c0c6a41b5992 on nch1-master-1 Mar 26 20:56:13.686589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.687726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.690006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.698383 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-84038768-2641-4cdb-9976-2b5832e2f68e req-0bc11d33-a231-4405-be28-1ea75245e325 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063890 Mar 26 20:56:13.716669 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1205/2243] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:13.781100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:13.781470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:13.795234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.797387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:13.799655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:13.800732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.053691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.061972 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1656c82d-7bd4-47c0-a953-2fef8239ad37 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.399814 Mar 26 20:56:14.062762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1039/2244] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:13 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:14.073147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:14.073783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:14.093015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.093486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.094289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.094769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.246596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.265178 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e90cab62-06d6-4b1c-b4aa-02cd0e4517c5 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1276 microversion: 2.1 time: 0.485851 Mar 26 20:56:14.266357 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1206/2245] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:13 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1276 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:14.280030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2102032935", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6"}], "security_groups": [{"name": "tempest-securitygroup--1323266235"}], "key_name": "tempest-keypair-1228724138", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:14.587272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] validate_networks() for [('30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:14.588254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.615333 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d26f0c98-98ca-49e2-93ac-642bab44246a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.545429 Mar 26 20:56:14.617837 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1040/2246] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:14 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:14.640832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:14.643546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:14.655356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.656322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.658503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.661459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.819330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.830233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.832340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d3b74fb605347bcbe8359165aaa0c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a4be7864234e8f93a10896a309e6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:14.838514 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-359d407e-cfc6-4389-b9a8-71a21c1bab70 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 200 len: 1444 microversion: 2.75 time: 0.206609 Mar 26 20:56:14.851449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1041/2247] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:14 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 1444 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:56:14.856787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:14.857682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:14.864621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.865329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:14.866546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:14.867156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.757286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864b039c62424775834b1294a6725d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:15.764867 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e169ebd-a607-44a1-98c6-5e5002251074 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 200 len: 1472 microversion: 2.1 time: 0.911866 Mar 26 20:56:15.765877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1042/2248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:14 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 1472 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:15.779665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e4898202-5fb6-49ba-906d-3ecc6a740d3e req-94d2a2f7-71fa-4d4f-abad-5ad877321c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29af921-dbed-4407-aaca-4ec0f73bb9d7", "tag": "bf789619-a9ce-493c-8d5d-f02e2ecd718b"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:15.788382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e4898202-5fb6-49ba-906d-3ecc6a740d3e req-94d2a2f7-71fa-4d4f-abad-5ad877321c03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:15.789081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e4898202-5fb6-49ba-906d-3ecc6a740d3e req-94d2a2f7-71fa-4d4f-abad-5ad877321c03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.808478 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e4898202-5fb6-49ba-906d-3ecc6a740d3e req-94d2a2f7-71fa-4d4f-abad-5ad877321c03 service nova] Creating event network-changed:bf789619-a9ce-493c-8d5d-f02e2ecd718b for instance e29af921-dbed-4407-aaca-4ec0f73bb9d7 on nch2-master-1 Mar 26 20:56:15.814194 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e4898202-5fb6-49ba-906d-3ecc6a740d3e req-94d2a2f7-71fa-4d4f-abad-5ad877321c03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046978 Mar 26 20:56:15.815005 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1043/2249] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:15.821261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:15.822523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:15.830295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:15.830936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.832217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:15.832994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.924306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:15.924834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:15.925443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:15.926025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:15.926533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:15.956110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:15.956890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.958093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:15.958923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:15.997902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:16.008487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:16.025256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:16.027732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:16.134146 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a418dfd-daeb-4206-b968-6879a4ee3d01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.866472 Mar 26 20:56:16.139931 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1207/2250] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:56:16.161185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:16.171771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:16.179786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.180436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.182101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.183705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.533468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:16.556398 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0d2c93a-3fa2-44a0-86de-4b26199d1017 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.414973 Mar 26 20:56:16.557012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1208/2251] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:16 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:16.599853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:16.605189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:16.618466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.618878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.619660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.638940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.693257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:16.703657 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5fff0de1-2c7b-4818-90eb-e8e5756886b7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.887225 Mar 26 20:56:16.705962 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1044/2252] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:15 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:16.719399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d8d2538f-3aa0-4b36-8c72-9c30abb5b08c req-5c654b57-3512-41da-89a1-4dead70891b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2531d82d-f786-4c55-ae92-5dd6abe2083b", "name": "network-vif-plugged", "status": "completed", "tag": "56d251dd-2d4d-4ce8-9b31-52c7c34abe80"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:16.737221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d8d2538f-3aa0-4b36-8c72-9c30abb5b08c req-5c654b57-3512-41da-89a1-4dead70891b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.740420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d8d2538f-3aa0-4b36-8c72-9c30abb5b08c req-5c654b57-3512-41da-89a1-4dead70891b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.768328 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d8d2538f-3aa0-4b36-8c72-9c30abb5b08c req-5c654b57-3512-41da-89a1-4dead70891b6 service nova] Creating event network-vif-plugged:56d251dd-2d4d-4ce8-9b31-52c7c34abe80 for instance 2531d82d-f786-4c55-ae92-5dd6abe2083b on nch2-master-1 Mar 26 20:56:16.794162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d8d2538f-3aa0-4b36-8c72-9c30abb5b08c req-5c654b57-3512-41da-89a1-4dead70891b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085348 Mar 26 20:56:16.797336 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1045/2253] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:16.832219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:16.836419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] [instance: 144e3453-826b-4d91-88a0-21a8a961b3ab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:16.871142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.873621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.876096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.878040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.915932 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] HTTP exception thrown: Instance 144e3453-826b-4d91-88a0-21a8a961b3ab could not be found. Mar 26 20:56:16.917685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] Returning 404 to user: Instance 144e3453-826b-4d91-88a0-21a8a961b3ab could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:16.920559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-366bd7a2-c18d-4a07-93ca-f479dbb6b5a6 tempest-ServersAdmin275Test-509189039 tempest-ServersAdmin275Test-509189039-project] 10.222.0.16 "GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab" status: 404 len: 111 microversion: 2.75 time: 0.110073 Mar 26 20:56:16.921961 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1046/2254] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:56:16 2022] GET /compute/v2.1/servers/144e3453-826b-4d91-88a0-21a8a961b3ab => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:56:16.931335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d3ae43b1-7eb9-4793-a3ec-1606612f9e35 req-cab1dc77-635a-4327-afc7-e6ddf18b3bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386db953-92ff-4474-82f4-4c2a258c5ce5", "name": "network-vif-deleted", "tag": "8491fb69-6e99-47b9-a3c5-6b4de5daf667"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:16.943788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d3ae43b1-7eb9-4793-a3ec-1606612f9e35 req-cab1dc77-635a-4327-afc7-e6ddf18b3bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:16.945261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d3ae43b1-7eb9-4793-a3ec-1606612f9e35 req-cab1dc77-635a-4327-afc7-e6ddf18b3bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:16.980436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d3ae43b1-7eb9-4793-a3ec-1606612f9e35 req-cab1dc77-635a-4327-afc7-e6ddf18b3bfc service nova] Creating event network-vif-deleted:8491fb69-6e99-47b9-a3c5-6b4de5daf667 for instance 386db953-92ff-4474-82f4-4c2a258c5ce5 on nch2-master-1 Mar 26 20:56:16.992527 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d3ae43b1-7eb9-4793-a3ec-1606612f9e35 req-cab1dc77-635a-4327-afc7-e6ddf18b3bfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068835 Mar 26 20:56:16.994955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1047/2255] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:17.012624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:17.016071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:17.029287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.032728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.035385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.036944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.276519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:17.283897 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b8ee2c0-4dce-415e-a74e-c48453551635 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.711008 Mar 26 20:56:17.286896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1209/2256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:16 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:17.292072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:17.292684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] [instance: 386db953-92ff-4474-82f4-4c2a258c5ce5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:17.312453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.312915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.313706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.317909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.340598 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] HTTP exception thrown: Instance 386db953-92ff-4474-82f4-4c2a258c5ce5 could not be found. Mar 26 20:56:17.341454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] Returning 404 to user: Instance 386db953-92ff-4474-82f4-4c2a258c5ce5 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:17.342702 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a39d59c5-cb65-4258-8c40-ff8d1f4117a6 tempest-ImagesOneServerTestJSON-54252431 tempest-ImagesOneServerTestJSON-54252431-project] 10.222.0.16 "GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5" status: 404 len: 111 microversion: 2.1 time: 0.054858 Mar 26 20:56:17.343496 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1210/2257] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:17 2022] GET /compute/v2.1/servers/386db953-92ff-4474-82f4-4c2a258c5ce5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:17.472583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:17.486551 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f7c15682-4fd5-46aa-8bea-acc7d601ccfd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1243 microversion: 2.1 time: 0.487174 Mar 26 20:56:17.489809 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1048/2258] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:16 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1243 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:17.573540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:17.574470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:17.593212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.594150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.595059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.595579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.722961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:17.723898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:17.739225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.741201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:17.744935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:17.748664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.050303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:18.058630 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff70949e-25d0-4dfd-8a6c-58faf544e4f8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.340409 Mar 26 20:56:18.068433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1049/2259] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:17 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:18.113231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7e1c9e2f-0614-44b5-a943-8cc68a80d447 req-553a67ee-2b45-4565-b413-9d8e64e05927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdb5d09-e152-4bff-bb4d-d7aec5494519", "tag": "9eb6cb36-804c-41b3-a477-f3c09fc288ee"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:18.129974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e1c9e2f-0614-44b5-a943-8cc68a80d447 req-553a67ee-2b45-4565-b413-9d8e64e05927 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.132863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e1c9e2f-0614-44b5-a943-8cc68a80d447 req-553a67ee-2b45-4565-b413-9d8e64e05927 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.146425 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7e1c9e2f-0614-44b5-a943-8cc68a80d447 req-553a67ee-2b45-4565-b413-9d8e64e05927 service nova] Creating event network-changed:9eb6cb36-804c-41b3-a477-f3c09fc288ee for instance dbdb5d09-e152-4bff-bb4d-d7aec5494519 on nch1-master-1 Mar 26 20:56:18.163101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7e1c9e2f-0614-44b5-a943-8cc68a80d447 req-553a67ee-2b45-4565-b413-9d8e64e05927 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052981 Mar 26 20:56:18.167338 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1050/2260] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:18.308720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:18.309700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:18.317530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.317995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.319171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.320108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.553485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:18.575401 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fe858895-565b-4edf-b2d4-6cef287a0a22 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 1.005868 Mar 26 20:56:18.576324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1211/2261] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:17 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:18.582967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:18.586541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:18.594714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.595439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.596434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.597046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.609001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:18.616063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9268ae19-62ad-4dc6-924a-5669330d207e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1320 microversion: 2.1 time: 0.316839 Mar 26 20:56:18.620251 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1051/2262] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:18 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:18.788367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:18.802875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbb1280c-5c5a-4c04-8167-73256d3f0980 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1297 microversion: 2.1 time: 0.222473 Mar 26 20:56:18.804586 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1212/2263] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:18 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:18.821949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-99011718-d7e2-4490-9cc5-d3e761a0599a req-b996cc2c-3207-4a17-b94e-830a140503b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6833d6e-98a8-45aa-b478-03846a702b18", "name": "network-vif-plugged", "status": "completed", "tag": "2da49cd1-c1ff-4ee7-ae87-4672c4430a08"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:18.836337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-99011718-d7e2-4490-9cc5-d3e761a0599a req-b996cc2c-3207-4a17-b94e-830a140503b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:18.837449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-99011718-d7e2-4490-9cc5-d3e761a0599a req-b996cc2c-3207-4a17-b94e-830a140503b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:18.853288 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-99011718-d7e2-4490-9cc5-d3e761a0599a req-b996cc2c-3207-4a17-b94e-830a140503b5 service nova] Creating event network-vif-plugged:2da49cd1-c1ff-4ee7-ae87-4672c4430a08 for instance e6833d6e-98a8-45aa-b478-03846a702b18 on nch1-master-1 Mar 26 20:56:18.859366 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-99011718-d7e2-4490-9cc5-d3e761a0599a req-b996cc2c-3207-4a17-b94e-830a140503b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041001 Mar 26 20:56:18.864452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1052/2264] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:19.025139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c5c78f0a-49c9-4300-b9e4-2654da15df10 req-86a1daca-df47-439f-91b0-8b4c47b23c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110b4849-d543-4a97-a107-aefdf033c2b0", "tag": "56ab69ae-c6fc-4468-8bb0-3885983fca3e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:19.035636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c5c78f0a-49c9-4300-b9e4-2654da15df10 req-86a1daca-df47-439f-91b0-8b4c47b23c36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.036424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c5c78f0a-49c9-4300-b9e4-2654da15df10 req-86a1daca-df47-439f-91b0-8b4c47b23c36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.051719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c5c78f0a-49c9-4300-b9e4-2654da15df10 req-86a1daca-df47-439f-91b0-8b4c47b23c36 service nova] Creating event network-changed:56ab69ae-c6fc-4468-8bb0-3885983fca3e for instance 110b4849-d543-4a97-a107-aefdf033c2b0 on nch2-master-1 Mar 26 20:56:19.058417 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c5c78f0a-49c9-4300-b9e4-2654da15df10 req-86a1daca-df47-439f-91b0-8b4c47b23c36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038520 Mar 26 20:56:19.059181 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1213/2265] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:19.078349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:19.081378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:19.098526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.100326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.104621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.105399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.499713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:19.508200 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa0025dd-603b-4ae2-9574-6efd44a33033 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.437095 Mar 26 20:56:19.509851 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1053/2266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:19 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:19.597042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:19.597770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:19.615363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.615826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.616796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.617246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.637963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:19.638587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:19.648081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.648331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:19.648973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:19.649419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.151507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:20.165572 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-294d4602-7142-4548-a356-f6cb32da6c96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1511 microversion: 2.1 time: 0.532411 Mar 26 20:56:20.168191 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1054/2267] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:19 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:20.180960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:20.182800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:20.184975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:20.197224 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c71a05a9-3d14-4400-8921-e88ce1f74c98 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.609802 Mar 26 20:56:20.201140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1214/2268] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:19 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:20.208254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.209480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.214609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.217097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:20.218125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.220361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:20.238678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.242218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.244262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.244731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.606064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:20.619407 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c5b95f2-2f22-45b9-9461-618a75253e26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.449813 Mar 26 20:56:20.620569 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1055/2269] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:20 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:20.625608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:20.626229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:20.636996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.637946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.638755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:20.639202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:20.851332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:20.864141 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1519e795-5528-4526-a4c4-f649dffaca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.241492 Mar 26 20:56:20.864876 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1056/2270] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:20 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:21.059469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:21.072630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e72ae4e0-88a5-49e0-8976-b5ef2f149dd8 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1512 microversion: 2.1 time: 0.869631 Mar 26 20:56:21.073804 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1215/2271] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:20 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1512 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:21.091575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:21.095214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:21.105645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.106259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.107170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.108091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.279421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] Calling method '.version_select at 0x7f6e5ebef160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:21.305900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.307477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.308628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.309381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.353994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d4a2cd3-ba8e-46e3-adfa-63ada8042686 tempest-AbsoluteLimitsTestJSON-1618085929 tempest-AbsoluteLimitsTestJSON-1618085929-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.487835 Mar 26 20:56:21.356646 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1057/2272] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:20 2022] GET /compute/v2.1/limits => generated 511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:21.369709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:21.370334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:21.385388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.385641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.386437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.387028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.492970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:21.505238 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b8eba389-7de7-4ebb-ac9f-f7ca67517a9e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1513 microversion: 2.1 time: 0.419502 Mar 26 20:56:21.507350 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1216/2273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:21 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:21.523572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:21.527673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:21.530825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:21.553495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.553964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.554818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.555362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.781928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:21.972671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:21.981006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:21.988543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:21.989005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:21.991603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11118dd4-f18c-4fcd-8329-58109feff9d7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.630907 Mar 26 20:56:21.993659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1058/2274] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:21 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:22.014837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:22.015589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:22.042860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.043325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.046602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.048966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.335360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1cac7ca4-f416-4824-ba4c-4b39ac77391a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.815632 Mar 26 20:56:22.337141 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1217/2275] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 20:56:21 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:22.342450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-71fc4ec1-f22a-4fb5-8367-80631f0eb375 req-e824a09c-f9e8-488d-87cb-f13c12a19d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29af921-dbed-4407-aaca-4ec0f73bb9d7", "name": "network-vif-plugged", "status": "completed", "tag": "bf789619-a9ce-493c-8d5d-f02e2ecd718b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:22.362576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-71fc4ec1-f22a-4fb5-8367-80631f0eb375 req-e824a09c-f9e8-488d-87cb-f13c12a19d52 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.364835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-71fc4ec1-f22a-4fb5-8367-80631f0eb375 req-e824a09c-f9e8-488d-87cb-f13c12a19d52 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.372296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:22.383862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-71fc4ec1-f22a-4fb5-8367-80631f0eb375 req-e824a09c-f9e8-488d-87cb-f13c12a19d52 service nova] Creating event network-vif-plugged:bf789619-a9ce-493c-8d5d-f02e2ecd718b for instance e29af921-dbed-4407-aaca-4ec0f73bb9d7 on nch2-master-1 Mar 26 20:56:22.388009 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d389249a-0279-4a72-b243-990273e10872 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.387485 Mar 26 20:56:22.389970 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-71fc4ec1-f22a-4fb5-8367-80631f0eb375 req-e824a09c-f9e8-488d-87cb-f13c12a19d52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051392 Mar 26 20:56:22.390826 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1218/2276] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:22.396958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c98573b3-8e4c-4376-bbd1-f36ed58b0379 req-787263d6-e38f-4945-972b-67ae946c80d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:22.398304 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1059/2277] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:21 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:22.405151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:22.407712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c98573b3-8e4c-4376-bbd1-f36ed58b0379 req-787263d6-e38f-4945-972b-67ae946c80d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.408463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c98573b3-8e4c-4376-bbd1-f36ed58b0379 req-787263d6-e38f-4945-972b-67ae946c80d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.418532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:22.429071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.431645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c98573b3-8e4c-4376-bbd1-f36ed58b0379 req-787263d6-e38f-4945-972b-67ae946c80d1 service nova] Creating event network-changed:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:56:22.432498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.433541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.435810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.442600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c98573b3-8e4c-4376-bbd1-f36ed58b0379 req-787263d6-e38f-4945-972b-67ae946c80d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050096 Mar 26 20:56:22.444162 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1219/2278] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:22.453968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:22.469373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:22.471266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2045972588', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:22.483571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.485841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.488545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.489627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:22.627039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:22.723750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:22.731970 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-49ede7c1-d48f-44f6-bcc3-66d9eeb0c4a9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.330974 Mar 26 20:56:22.732962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:22.733419 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1060/2279] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:22 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:22.749858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:22.755237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.045359 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c60b7a08-2b5f-4562-bd1d-7f98a856ae4c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2045972588" status: 200 len: 1515 microversion: 2.1 time: 0.599068 Mar 26 20:56:23.046676 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1220/2280] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:56:22 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2045972588 => generated 1515 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:23.053337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.055023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:23.067288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.067739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca29c9b7-af8f-4cdc-a82e-70514c145405 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.068307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.069441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.070273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.083398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca29c9b7-af8f-4cdc-a82e-70514c145405 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.346641 Mar 26 20:56:23.084032 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1061/2281] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:56:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:23.093347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.102947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.103901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:23.109313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.109749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.110731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.111351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.263293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:23.375703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.389811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.390396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.537668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.553615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-333ac1fb-c8a9-486d-b19d-361528b60419 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.505654 Mar 26 20:56:23.554565 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1221/2282] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:23.559868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.560688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:23.579652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.580183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.580997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.581446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.608945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27144de6-fd20-4c29-8208-8d28bef18ec5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.523825 Mar 26 20:56:23.609545 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1062/2283] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:23.636886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.645048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.645567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.servers [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Removing options 'limit' from query {{(pid=141580) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 26 20:56:23.646328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:23.656032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.657284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.658762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.659533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.700059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.707036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.708223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.860471 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6c88ab7c-f73f-4008-8113-2e6c30dc058d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.234983 Mar 26 20:56:23.861069 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1063/2284] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:23.876077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.876697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:23.887862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.888581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.890619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.891260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.908845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.917527 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79dac9b1-ee99-4f12-bbb0-887a9f31baca tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.361773 Mar 26 20:56:23.918342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1222/2285] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:23.940351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:23.944273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:23.945311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:23.951767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.952651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:23.953710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:23.954427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.006933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:24.048488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9acbaf1-e09c-4b9d-9e9d-aeeb7aa2c2ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.118055 Mar 26 20:56:24.049358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1223/2286] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:24.056850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86395f97-0b0b-4a87-8a81-fb0b8baf1ed0 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1036242822", "imageRef": "8faedb00-1d46-4711-b5a9-24f57bb251d5", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:24.100766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.110970 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a78665a6-f88d-4369-9094-20c703970fd0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1318 microversion: 2.1 time: 0.247951 Mar 26 20:56:24.111555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1064/2287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:23 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:24.117033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.117530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-86395f97-0b0b-4a87-8a81-fb0b8baf1ed0 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:24.121873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.122326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.servers [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Removing options 'limit' from query {{(pid=141580) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 26 20:56:24.122978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:24.128780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.129469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.131476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.132126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.177206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:24.212842 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-593011b3-3248-49ff-af79-f3c34edc2276 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.100207 Mar 26 20:56:24.214155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1065/2288] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:24.231120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.241179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.243594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:24.254487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.254954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.257007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.257525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.306176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:24.359553 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-86395f97-0b0b-4a87-8a81-fb0b8baf1ed0 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] HTTP exception thrown: Flavor's memory is too small for requested image. Mar 26 20:56:24.360209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86395f97-0b0b-4a87-8a81-fb0b8baf1ed0 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:24.361273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-86395f97-0b0b-4a87-8a81-fb0b8baf1ed0 tempest-FlavorsV2NegativeTest-389890795 tempest-FlavorsV2NegativeTest-389890795-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.310685 Mar 26 20:56:24.362233 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1224/2289] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:24 2022] POST /compute/v2.1/servers => generated 93 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:24.370645 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ede7c43d-397c-496f-a4dc-4a9156191e3a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.150094 Mar 26 20:56:24.372622 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1066/2290] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:24.387486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.393155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.393906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:24.417604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ae80999c-e198-4288-9528-8225189e6c59 req-518e2310-f6b2-48eb-a80b-7cebf2771c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110b4849-d543-4a97-a107-aefdf033c2b0", "name": "network-vif-plugged", "status": "completed", "tag": "56ab69ae-c6fc-4468-8bb0-3885983fca3e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:24.424007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.424623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.428228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.431430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.434889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ae80999c-e198-4288-9528-8225189e6c59 req-518e2310-f6b2-48eb-a80b-7cebf2771c30 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.436519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ae80999c-e198-4288-9528-8225189e6c59 req-518e2310-f6b2-48eb-a80b-7cebf2771c30 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.462808 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ae80999c-e198-4288-9528-8225189e6c59 req-518e2310-f6b2-48eb-a80b-7cebf2771c30 service nova] Creating event network-vif-plugged:56ab69ae-c6fc-4468-8bb0-3885983fca3e for instance 110b4849-d543-4a97-a107-aefdf033c2b0 on nch2-master-1 Mar 26 20:56:24.470529 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ae80999c-e198-4288-9528-8225189e6c59 req-518e2310-f6b2-48eb-a80b-7cebf2771c30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057925 Mar 26 20:56:24.472984 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1067/2291] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:24.581935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:24.668329 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53d016ad-7265-4e70-8cb6-9f0fd8ea68dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.289679 Mar 26 20:56:24.672168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1225/2292] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:24.678806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.679444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:24.686549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.687678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.688801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.689519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.856678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.871034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Calling method '.version_select at 0x7f6e5ec5c310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.875289 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb9a9ce0-bf5f-489c-aab6-1840db3be6a1 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.191813 Mar 26 20:56:24.875849 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1226/2293] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:24.885053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.889379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.889758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.890563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.891003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.895708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.896207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.servers [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Removing options 'limit' from query {{(pid=141581) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 26 20:56:24.899957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:24.909459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.910145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.910971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.911438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.932052 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9a3a962-acfb-4a1d-8666-d635e919e2ad tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.428290 Mar 26 20:56:24.932713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1068/2294] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:24.951592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.952887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:24.957590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1445af10-e3a2-4dc0-a36e-ff5e5b842175 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.080611 Mar 26 20:56:24.958174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1227/2295] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:24.959418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.959882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.960717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.961164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.974297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:24.979566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:24.980985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2045972588', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:24.987772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.988581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:24.990336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:24.991106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.110373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:25.120529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:25.130353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-943c12fa-90b7-4c0b-9df8-2849943a1701 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.184613 Mar 26 20:56:25.131135 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1069/2296] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:25.136740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1725553789", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:25.179698 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-800d7921-f1da-4d8d-bc4f-352d5db563a2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2045972588" status: 200 len: 346 microversion: 2.1 time: 0.213356 Mar 26 20:56:25.186838 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1228/2297] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:56:24 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2045972588 => generated 346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:25.192232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:25.192989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:25.195096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:25.200694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.201786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.203097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.204648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.381305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:25.389704 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4de519a0-3fb6-4d45-b55c-e7bdcd79689a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1468 microversion: 2.1 time: 0.207351 Mar 26 20:56:25.390900 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1229/2298] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:25 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:25.407256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1259810c-2ad6-4c1a-a0fe-c30f9431b731 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:25.416449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1259810c-2ad6-4c1a-a0fe-c30f9431b731 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.417249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1259810c-2ad6-4c1a-a0fe-c30f9431b731 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.443571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Getting quotas for project 5c5461353bca4916933328b9729676cf. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:25.447806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1259810c-2ad6-4c1a-a0fe-c30f9431b731 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 20:56:25.449354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Getting quotas for user 3338788eae464112b4a5a2475157ca74 and project 5c5461353bca4916933328b9729676cf. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:25.462312 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Mar 26 20:56:25.463119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:25.464257 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1e1d90b-3ca8-468e-a8f6-2e31f4afe5cf tempest-AbsoluteLimitsNegativeTestJSON-63957751 tempest-AbsoluteLimitsNegativeTestJSON-63957751-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.331868 Mar 26 20:56:25.465152 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1070/2299] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Mar 26 20:56:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 333 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:56:25.472888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:25.473911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:25.480978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.481634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.482552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.482990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.509464 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1259810c-2ad6-4c1a-a0fe-c30f9431b731 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "POST /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992/action" status: 202 len: 0 microversion: 2.1 time: 0.105379 Mar 26 20:56:25.510218 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1230/2300] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:56:25 2022] POST /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:56:25.520481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:25.521230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:25.528726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.529397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.530379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.530929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.785505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:25.802076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a8f3f1d-3483-4ac5-bf2c-e5f8914bd53e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.284104 Mar 26 20:56:25.802797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1231/2301] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:25 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:25.892335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:25.892943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:25.899885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.902377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.904568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:25.905809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:25.966623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:25.976383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-543d90fe-87e6-47af-a8c5-13a6357591e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 200 len: 1318 microversion: 2.1 time: 0.509785 Mar 26 20:56:25.986547 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1071/2302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:25 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:26.113772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:26.129478 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-63b7412f-9448-41ae-9322-e50036c7c002 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.241107 Mar 26 20:56:26.139063 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1232/2303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:25 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:26.166713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:26.168359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:26.176646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:26.177331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:26.178580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:26.179199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:26.413077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:26.425291 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df114ee1-6cdf-4c04-b797-bda068c98556 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.279746 Mar 26 20:56:26.440148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1072/2304] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:26 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:26.499305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-442be739-5f03-46b0-b901-582dbbe9ccb1 req-698e727c-192b-46d9-bddb-54fc49f78fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdb5d09-e152-4bff-bb4d-d7aec5494519", "name": "network-vif-plugged", "status": "completed", "tag": "9eb6cb36-804c-41b3-a477-f3c09fc288ee"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:26.510150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-442be739-5f03-46b0-b901-582dbbe9ccb1 req-698e727c-192b-46d9-bddb-54fc49f78fb6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:26.510589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-442be739-5f03-46b0-b901-582dbbe9ccb1 req-698e727c-192b-46d9-bddb-54fc49f78fb6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:26.523150 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-442be739-5f03-46b0-b901-582dbbe9ccb1 req-698e727c-192b-46d9-bddb-54fc49f78fb6 service nova] Creating event network-vif-plugged:9eb6cb36-804c-41b3-a477-f3c09fc288ee for instance dbdb5d09-e152-4bff-bb4d-d7aec5494519 on nch1-master-1 Mar 26 20:56:26.528199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-442be739-5f03-46b0-b901-582dbbe9ccb1 req-698e727c-192b-46d9-bddb-54fc49f78fb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Mar 26 20:56:26.529403 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1233/2305] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:26.823278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:26.824210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:26.833876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:26.834340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:26.835799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:26.836495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:26.995096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:26.995823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:27.003291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.003783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.009638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.010114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.087773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.097321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8e8e39f-df70-4be3-87ea-0f4b6bc38771 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.279081 Mar 26 20:56:27.100281 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1073/2306] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:26 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:27.146409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.147165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:27.155129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.155850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.160073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.160708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.247216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.256137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e99ee289-003e-4ceb-9bfa-8e1056da961c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 200 len: 1468 microversion: 2.1 time: 0.266166 Mar 26 20:56:27.259772 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1234/2307] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:26 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 1468 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:27.278345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.288616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.290055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Searching by: {'reservation_id': 'r-37m49m0i', 'deleted': False, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:27.308731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.309489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.310929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.311637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.349258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.358513 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-831d4c68-8e25-4c7a-94b7-3f31f44af681 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1324 microversion: 2.1 time: 0.215798 Mar 26 20:56:27.364686 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1074/2308] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:27.431685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:27.448333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.449188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:27.458429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.459419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.460541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.461167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.502726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.511978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.512608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.641979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:27.650906 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5bba0554-9749-4787-8f98-ea856949c708 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.209311 Mar 26 20:56:27.656035 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1075/2309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:27.672214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c273adc7-73c5-43ef-91a0-e4a9bd6fb4bf tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-37m49m0i" status: 200 len: 2929 microversion: 2.1 time: 0.399975 Mar 26 20:56:27.684016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1235/2310] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-37m49m0i => generated 2929 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:27.692987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a6a74c9-c4ee-409e-b5ba-bad02f6d7c07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.709691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_groups [None req-5a6a74c9-c4ee-409e-b5ba-bad02f6d7c07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Querying cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) for 2 instances {{(pid=141581) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 26 20:56:27.710635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6a74c9-c4ee-409e-b5ba-bad02f6d7c07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.711361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6a74c9-c4ee-409e-b5ba-bad02f6d7c07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.734701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a6a74c9-c4ee-409e-b5ba-bad02f6d7c07 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/a02d23dc-1421-4fe9-a394-81571343007e" status: 200 len: 266 microversion: 2.1 time: 0.047781 Mar 26 20:56:27.735330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1236/2311] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/os-server-groups/a02d23dc-1421-4fe9-a394-81571343007e => generated 266 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:27.745700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.747284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:27.753756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.754278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.755158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.755844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.840678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:27.842530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.843473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.844875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:27.845530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:27.872890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1d41f4bd-54d7-49f7-bb8d-15f97d435e1f tempest-AZV2TestJSON-2066875118 tempest-AZV2TestJSON-2066875118-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.219683 Mar 26 20:56:27.874030 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1076/2312] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:56:28.041503 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f15b3afb-8394-421f-a144-74c353aa1495 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 200 len: 1619 microversion: 2.1 time: 0.299989 Mar 26 20:56:28.043305 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1237/2313] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:27 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 1619 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:28.060734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:28.061651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:28.084373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.085304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.086228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.087059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.120431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:28.120866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:28.142526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.142981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.152438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.152822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.375153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-06c66b17-14ed-4bea-a392-4e402d10b1af tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 200 len: 1619 microversion: 2.1 time: 0.318691 Mar 26 20:56:28.376311 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1077/2314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:28 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 1619 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:28.381360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:28.382170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:28.398456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.401759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.404250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.405086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.519354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:28.531342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-89d8db60-e391-4144-97e3-d6f1a7708dac tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.417196 Mar 26 20:56:28.541670 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1238/2315] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:28 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:28.541670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: .version_select at 0x7f6e5ebf24c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1312260843", "policies": ["anti-affinity"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:28.575064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:28.580677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:28.648494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:28.661956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:28.662559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:28.678307 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce7ab3f2-e54d-461c-9b5f-e6f85d9ad012 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1519 microversion: 2.1 time: 0.300897 Mar 26 20:56:28.679182 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1078/2316] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:28 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1519 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:28.689397 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b0a9c45-221e-4843-912c-4621189286ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.156339 Mar 26 20:56:28.690645 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1239/2317] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 20:56:28 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:28.695396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:28.696281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:28.703295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.704022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.705278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.705474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7d6fc843-cce7-4e1a-8217-41af85d01fcb req-f23ebfeb-7554-4cfa-b6d4-502fe25bc779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-plugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:28.706653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.731504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7d6fc843-cce7-4e1a-8217-41af85d01fcb req-f23ebfeb-7554-4cfa-b6d4-502fe25bc779 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:28.732023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7d6fc843-cce7-4e1a-8217-41af85d01fcb req-f23ebfeb-7554-4cfa-b6d4-502fe25bc779 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:28.760451 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7d6fc843-cce7-4e1a-8217-41af85d01fcb req-f23ebfeb-7554-4cfa-b6d4-502fe25bc779 service nova] Creating event network-vif-plugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:56:28.768000 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7d6fc843-cce7-4e1a-8217-41af85d01fcb req-f23ebfeb-7554-4cfa-b6d4-502fe25bc779 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065482 Mar 26 20:56:28.769040 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1079/2318] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:28.903348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-533913393", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c729502b-28d5-49c5-875a-c17fbdb10f5d"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.031640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:29.068927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:29.082328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f0c53d3c-2c49-4a1f-bd0f-d715b6ff353a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.390388 Mar 26 20:56:29.087335 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1240/2319] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:28 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:29.099348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49f3ce2f-14d2-41ca-ac49-e05e93d19443 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300424654", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.100434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49f3ce2f-14d2-41ca-ac49-e05e93d19443 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.101283 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49f3ce2f-14d2-41ca-ac49-e05e93d19443 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011862 Mar 26 20:56:29.106153 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1241/2320] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:29 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:56:29.116585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-179252cf-22cd-4ac4-9dbc-02f74582fb32 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:29.117087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-179252cf-22cd-4ac4-9dbc-02f74582fb32 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: 5837289d-fb79-47ea-815e-2759a55a1aa4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:29.136801 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-179252cf-22cd-4ac4-9dbc-02f74582fb32 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] HTTP exception thrown: Instance 5837289d-fb79-47ea-815e-2759a55a1aa4 could not be found. Mar 26 20:56:29.137398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-179252cf-22cd-4ac4-9dbc-02f74582fb32 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 404 to user: Instance 5837289d-fb79-47ea-815e-2759a55a1aa4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.138236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-179252cf-22cd-4ac4-9dbc-02f74582fb32 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/5837289d-fb79-47ea-815e-2759a55a1aa4/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025547 Mar 26 20:56:29.150996 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1242/2321] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:56:29 2022] GET /compute/v2.1/servers/5837289d-fb79-47ea-815e-2759a55a1aa4/metadata => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:29.396025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0e1b057-6a00-4d50-bdc8-b11c183010a0 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1421821790", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.397850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0e1b057-6a00-4d50-bdc8-b11c183010a0 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.398889 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0e1b057-6a00-4d50-bdc8-b11c183010a0 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.007545 Mar 26 20:56:29.399866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1243/2322] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:29 2022] POST /compute/v2.1/servers => generated 687 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 20:56:29.450273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:29.451945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:29.452833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:29.453515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:29.454457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:29.478759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9322b720-1af4-4d87-abf6-b3853363ad5b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2131726440", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.481057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9322b720-1af4-4d87-abf6-b3853363ad5b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.482197 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9322b720-1af4-4d87-abf6-b3853363ad5b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.008064 Mar 26 20:56:29.483438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1244/2323] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:29 2022] POST /compute/v2.1/servers => generated 689 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 20:56:29.487765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:29.488502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:29.489826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:29.490338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:29.514762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:29.521372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:29.536964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 2 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:29.539838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:29.550193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:29.550916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:29.565031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:29.565497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:29.566586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:29.567064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:29.657422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:29.670626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:29.750106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:29.757171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:29.775119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=0df72bb8-2c08-42da-b528-003cdaec7d4e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:29.855121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:29.865009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:29.899363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:29.909351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-926922c3-0cb1-4c4d-8201-bc219a8bb45c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.363406 Mar 26 20:56:29.910393 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1245/2324] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:29 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:29.916211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4dbfe0f4-aa49-4939-98e9-bac11d1864f6 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1301740778", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.918068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4dbfe0f4-aa49-4939-98e9-bac11d1864f6 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.918885 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4dbfe0f4-aa49-4939-98e9-bac11d1864f6 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.007320 Mar 26 20:56:29.919404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1246/2325] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:29 2022] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 26 20:56:29.950272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:29.961008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'server_group_members'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:29.988012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7dc76bb3-8e9c-444d-be0e-1051276725c7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-512953580", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "be591c69-cd3a-488a-85f8-878cc8898e3b"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:29.990104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7dc76bb3-8e9c-444d-be0e-1051276725c7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:29.991231 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7dc76bb3-8e9c-444d-be0e-1051276725c7 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.008111 Mar 26 20:56:29.993166 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1247/2326] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Mar 26 20:56:29 2022] POST /compute/v2.1/servers => generated 2221 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 26 20:56:30.006555 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1727a17-f58b-4ce9-b854-c1348bb4e36c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.108257 Mar 26 20:56:30.007726 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1080/2327] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Mar 26 20:56:30.031863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.041369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c6caaae-4608-45d0-9568-505285c46f8d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.041883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c6caaae-4608-45d0-9568-505285c46f8d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: 5dbb8bae-4733-49f1-bfb2-11888206c662] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.053275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:30.054149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Searching by: {'deleted': False, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:30.059747 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5c6caaae-4608-45d0-9568-505285c46f8d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] HTTP exception thrown: Instance 5dbb8bae-4733-49f1-bfb2-11888206c662 could not be found. Mar 26 20:56:30.060472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c6caaae-4608-45d0-9568-505285c46f8d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 404 to user: Instance 5dbb8bae-4733-49f1-bfb2-11888206c662 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:30.074582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c6caaae-4608-45d0-9568-505285c46f8d tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/5dbb8bae-4733-49f1-bfb2-11888206c662/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.053035 Mar 26 20:56:30.075199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1248/2328] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 20:56:29 2022] GET /compute/v2.1/servers/5dbb8bae-4733-49f1-bfb2-11888206c662/metadata/test2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:30.099849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.100388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.110122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.110915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.112068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.112687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.150751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.152371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.154484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.155966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.159538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:56:30.252838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:30.321781 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc69c98f-836d-4658-b52e-388fb100a049 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.303288 Mar 26 20:56:30.325892 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1081/2329] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:56:30 2022] GET /compute/v2.1/servers => generated 1661 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:30.329658 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88eb3618-cdfe-4c20-b1af-1c8b10c38604 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 204 len: 0 microversion: 2.1 time: 0.233349 Mar 26 20:56:30.330766 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1249/2330] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:56:30 2022] DELETE /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:56:30.344529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.345155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44824bfb-0854-4156-a29d-b5c28bc8f7b5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.346170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44824bfb-0854-4156-a29d-b5c28bc8f7b5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.348338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.371105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.371602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.378920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.380148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.600614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44824bfb-0854-4156-a29d-b5c28bc8f7b5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:30.607856 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44824bfb-0854-4156-a29d-b5c28bc8f7b5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1218 microversion: 2.1 time: 0.273917 Mar 26 20:56:30.625930 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1250/2331] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:30 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:30.651528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:30.653003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.658817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:30.662498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.663200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.664407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.665057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.671457 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1db7fa2c-ebe0-4dee-bede-a049fe252b42 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1365 microversion: 2.1 time: 0.339774 Mar 26 20:56:30.680439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1082/2332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:30 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:30.743270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:30.745255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:30.754197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.755198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:30.756629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:30.757352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.142528 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eace188b-beaf-4ffe-a79f-381c8641ab46 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "POST /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404686 Mar 26 20:56:31.149679 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1083/2333] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 20:56:30 2022] POST /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:31.170430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:31.171530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:31.193370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.193828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.194620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.195062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.542085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:31.557032 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2821233-88ba-4839-b911-45ea057c9fce tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.398711 Mar 26 20:56:31.558386 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1084/2334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:31 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:31.631983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:31.632960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:31.668959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.670850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.673639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.674302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.808279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:31.817662 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d3457a1-1360-4a7e-bf63-60d4cd5c8e9a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1214 microversion: 2.1 time: 0.189045 Mar 26 20:56:31.819887 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1085/2335] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:31 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:31.841129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:31.841766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:31.861600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.862073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:31.864197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:31.869555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.306998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:32.326254 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2424d436-6133-43cb-bb40-46251699de15 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1552 microversion: 2.1 time: 0.503434 Mar 26 20:56:32.328718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:32.338145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3bb8eb2c-6c14-4bf3-81c0-5a3ed680dd65 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1525 microversion: 2.1 time: 1.707424 Mar 26 20:56:32.339956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1251/2336] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:30 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1525 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:32.350402 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1086/2337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:31 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1552 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:32.368393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:32.372856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:32.386154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.397031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.401904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.402474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.573826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:32.574352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:32.588737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.589186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.589981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.590407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.883994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ec77d615-4caf-4fcc-b393-a6d6608b971f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.538938 Mar 26 20:56:32.885217 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1087/2338] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:56:32 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/os-interface => generated 285 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:32.896548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:32.897465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:32.906472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.907724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:32.908771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:32.909391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:33.058680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:33.066526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a920539-92b5-466b-9dad-6f8fb4a69bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1288 microversion: 2.1 time: 0.179938 Mar 26 20:56:33.067106 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1088/2339] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:32 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1288 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:33.360063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:33.361677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:33.375138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:33.379073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:33.382543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:33.384477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:33.850596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:33.859791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22ee07e5-cc6f-4f8f-b885-32ff05c576c8 tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1525 microversion: 2.1 time: 0.505622 Mar 26 20:56:33.870787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1089/2340] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:33 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1525 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:33.908992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:33.918727 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f723cd30-ca9d-4490-aab4-4e477de5c9dc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 1.349129 Mar 26 20:56:33.929011 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1252/2341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:32 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:34.085959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:34.088370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:34.096099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:34.096666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:34.099658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:34.100236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:34.214869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:34.231303 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98ea0297-bc4d-4987-bf0b-16e96fc623b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1276 microversion: 2.1 time: 0.148145 Mar 26 20:56:34.240451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1090/2342] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:34 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:34.683336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ac2960a9-0455-49d8-9ac3-da206a5c1f96 req-1e0963b4-a97b-4e84-a422-f99225d6abd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdb5d09-e152-4bff-bb4d-d7aec5494519", "name": "network-vif-deleted", "tag": "9eb6cb36-804c-41b3-a477-f3c09fc288ee"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:34.747378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac2960a9-0455-49d8-9ac3-da206a5c1f96 req-1e0963b4-a97b-4e84-a422-f99225d6abd2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:34.749208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac2960a9-0455-49d8-9ac3-da206a5c1f96 req-1e0963b4-a97b-4e84-a422-f99225d6abd2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:34.777245 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ac2960a9-0455-49d8-9ac3-da206a5c1f96 req-1e0963b4-a97b-4e84-a422-f99225d6abd2 service nova] Creating event network-vif-deleted:9eb6cb36-804c-41b3-a477-f3c09fc288ee for instance dbdb5d09-e152-4bff-bb4d-d7aec5494519 on nch1-master-1 Mar 26 20:56:34.806235 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ac2960a9-0455-49d8-9ac3-da206a5c1f96 req-1e0963b4-a97b-4e84-a422-f99225d6abd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134687 Mar 26 20:56:34.824979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-521891100", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b274787f-eb87-4a7c-9beb-3380dad64ccb"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:34.828631 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1091/2343] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:34.883282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:34.885500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:34.895467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:34.896229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:34.904646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:34.905509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:34.950199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] validate_networks() for [('b274787f-eb87-4a7c-9beb-3380dad64ccb', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:35.005171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.014197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.015238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lazy-loading 'fault' on Instance uuid dbdb5d09-e152-4bff-bb4d-d7aec5494519 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:35.107655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563bce524229478faa4886b1d2285114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e309921cfc047bda328e3ad23aa5e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:35.118463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8d99d5d-d272-49fe-9857-78ac0e7e359b tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 200 len: 1314 microversion: 2.1 time: 0.242821 Mar 26 20:56:35.121163 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1092/2344] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:34 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:35.143358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:35.143901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:35.157991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.163703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.164912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.165538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.418169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:35.427966 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90662139-f1b1-4ea4-8586-a89a29e37e75 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.297298 Mar 26 20:56:35.428611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1093/2345] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:35 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:35.442720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:35.443545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:35.468452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.469437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.471961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.476581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.561365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:35.569331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-78afbf7e-cbae-48d0-bdf1-1258c3cdf7de tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1276 microversion: 2.1 time: 0.139203 Mar 26 20:56:35.569906 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1094/2346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:35 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:35.782410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:35.783768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:35.798774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.802078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.804486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.806613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.850669 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-30bfd37d-e779-4dc0-92ab-0317b216bee0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080625 Mar 26 20:56:35.851741 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1095/2347] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:56:35 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:35.862364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:35.863084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:35.871074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.871981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.873478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:35.874109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:35.977534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lazy-loading 'services' on Instance uuid 89eb23ef-ff6c-425c-811a-1aa2cffe0aad {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:56:36.078162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-887e2f06-2bb0-4b4a-8f11-acc9d44d48e9 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments/ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75" status: 202 len: 0 microversion: 2.1 time: 0.219335 Mar 26 20:56:36.079649 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1096/2348] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 20:56:35 2022] DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments/ed5641ea-35e5-4ba2-8ec2-f8f0658d4d75 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:56:36.145697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:36.146426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] [instance: dbdb5d09-e152-4bff-bb4d-d7aec5494519] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:36.172933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.173426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.174259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.181280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.258273 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] HTTP exception thrown: Instance dbdb5d09-e152-4bff-bb4d-d7aec5494519 could not be found. Mar 26 20:56:36.258886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] Returning 404 to user: Instance dbdb5d09-e152-4bff-bb4d-d7aec5494519 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:36.259729 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-650ae345-ada0-4e39-827f-61440e255c6a tempest-ServerMetadataNegativeTestJSON-2092259675 tempest-ServerMetadataNegativeTestJSON-2092259675-project] 10.222.0.16 "GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519" status: 404 len: 111 microversion: 2.1 time: 0.125555 Mar 26 20:56:36.273217 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1097/2349] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:36 2022] GET /compute/v2.1/servers/dbdb5d09-e152-4bff-bb4d-d7aec5494519 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:36.446885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:36.447515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:36.454499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.454954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.460204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.460757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.720064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:36.721145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:36.722233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:36.722884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:36.723527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:36.737122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.740332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.743671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.744446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.791960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Getting quotas for project 79effa8b201c422cb22e57efa4c8892a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:36.801213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Getting quotas for user ab0c5bde8c054cbcbc19291778a9511b and project 79effa8b201c422cb22e57efa4c8892a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:36.816739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:36.819947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:36.911931 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17930f24-1e89-4f2d-9b2b-a2bfba82f16b tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418982 Mar 26 20:56:36.913794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1253/2350] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:56:36.930592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:36.930592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:36.962558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.964844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:36.965956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:36.966860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:37.491198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:37.501988 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69f53029-70f2-4f91-8ce1-6f7eb255208f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 1.060394 Mar 26 20:56:37.512218 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1098/2351] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:36 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:37.518982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99bbcbbe-a307-4397-b1c7-5ab93c9da47e tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:37.520098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99bbcbbe-a307-4397-b1c7-5ab93c9da47e tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:37.650477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99bbcbbe-a307-4397-b1c7-5ab93c9da47e tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:37.662463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99bbcbbe-a307-4397-b1c7-5ab93c9da47e tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1224 microversion: 2.1 time: 0.145757 Mar 26 20:56:37.665066 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1099/2352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:37 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:37.683629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:37.686797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:37.703738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:37.706669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:37.708032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:37.709711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:37.802946 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87445eb4-7fea-4d50-a2b9-1edcc54ec75f tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136394 Mar 26 20:56:37.803771 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1100/2353] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:56:37 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:56:37.929804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:37.962661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:37.995388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:37.997110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:37.998253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.001586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.059526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3ab7372-3d80-4449-acd0-7ba14b092a98 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154568 Mar 26 20:56:38.066123 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1101/2354] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 20:56:37 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:56:38.074198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c52becf8-4576-4b8c-ab2a-4c7434f270d6 req-667ffab3-ec95-4bed-ae37-95ebb7c90a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df72bb8-2c08-42da-b528-003cdaec7d4e", "tag": "2393d24c-c12f-4ced-b0e6-3cc4d6bcca51"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:38.087339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c52becf8-4576-4b8c-ab2a-4c7434f270d6 req-667ffab3-ec95-4bed-ae37-95ebb7c90a99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.088355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c52becf8-4576-4b8c-ab2a-4c7434f270d6 req-667ffab3-ec95-4bed-ae37-95ebb7c90a99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.104327 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c52becf8-4576-4b8c-ab2a-4c7434f270d6 req-667ffab3-ec95-4bed-ae37-95ebb7c90a99 service nova] Creating event network-changed:2393d24c-c12f-4ced-b0e6-3cc4d6bcca51 for instance 0df72bb8-2c08-42da-b528-003cdaec7d4e on nch1-master-1 Mar 26 20:56:38.111368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c52becf8-4576-4b8c-ab2a-4c7434f270d6 req-667ffab3-ec95-4bed-ae37-95ebb7c90a99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043676 Mar 26 20:56:38.114468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1102/2355] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:38.121588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:38.122576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:38.146840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.152471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.156224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.156671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.395495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:38.406102 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60cc1702-41c0-4a96-82cd-fca12e1bae53 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 1.490814 Mar 26 20:56:38.406935 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1254/2356] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:36 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:38.412615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a463171b-7872-43df-8706-02f733c13286 req-39f3e66e-bc01-47c5-ae8c-3f3437d113d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:38.425951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a463171b-7872-43df-8706-02f733c13286 req-39f3e66e-bc01-47c5-ae8c-3f3437d113d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.426714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a463171b-7872-43df-8706-02f733c13286 req-39f3e66e-bc01-47c5-ae8c-3f3437d113d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.443386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a463171b-7872-43df-8706-02f733c13286 req-39f3e66e-bc01-47c5-ae8c-3f3437d113d9 service nova] Creating event network-changed:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:56:38.451600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a463171b-7872-43df-8706-02f733c13286 req-39f3e66e-bc01-47c5-ae8c-3f3437d113d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042056 Mar 26 20:56:38.453386 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1255/2357] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:38.462326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:38.463202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:38.471347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.472315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.473305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.474115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.507360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:56:38.854845 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31dd959f-e782-4385-afc0-fea36a8ceb5b tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 204 len: 0 microversion: 2.1 time: 0.399547 Mar 26 20:56:38.856265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1256/2358] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:56:38 2022] DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:56:38.862642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:38.863777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:38.883635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.884523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.885705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.886381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.906126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:38.922678 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af0e6986-80dd-4020-958b-95d53c4d1083 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1552 microversion: 2.1 time: 0.806693 Mar 26 20:56:38.928762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1103/2359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:38 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1552 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:38.941838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:38.944732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:38.969898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.980452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:38.981524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:38.982174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:39.301298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:39.310879 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4d8b43c-3cd2-4b21-92bb-ded8427d49d0 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1284 microversion: 2.1 time: 0.380734 Mar 26 20:56:39.311487 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1104/2360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:38 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1284 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:39.329045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:39.330090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:39.340754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:39.342724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:39.344736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:39.346459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:39.768168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:39.777133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38d431e6-fd8c-4bfc-a213-1b1a9ce494cc tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.919244 Mar 26 20:56:39.778601 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1257/2361] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:38 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:39.792692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:39.793812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:39.809009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:39.809993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:39.811252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:39.811906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:39.996874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:40.012682 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0753be6b-2159-4fe9-8719-f53b262c935a tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1682 microversion: 2.1 time: 0.693347 Mar 26 20:56:40.026454 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1105/2362] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:39 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1682 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:40.031559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:40.033572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:40.051250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.053170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.054235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.054988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.478484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:40.487904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-21bb2c3d-5da0-4319-b9b2-5aa41d92711f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1552 microversion: 2.1 time: 0.706180 Mar 26 20:56:40.488762 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1258/2363] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:39 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1552 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:40.503072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:40.504059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:40.511138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.511972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.512986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.514322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.781494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:40.806864 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e94e457e-7659-43c9-9d02-c9a01c2e53ab tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1282 microversion: 2.1 time: 0.307712 Mar 26 20:56:40.807797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1259/2364] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:40 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:40.814335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7157e66e-4def-4d13-a2a4-838c54f111ee req-79c9db4d-4d22-49ce-81be-d29c1a04ab0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db", "tag": "9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:40.852700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7157e66e-4def-4d13-a2a4-838c54f111ee req-79c9db4d-4d22-49ce-81be-d29c1a04ab0f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.854954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7157e66e-4def-4d13-a2a4-838c54f111ee req-79c9db4d-4d22-49ce-81be-d29c1a04ab0f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.888734 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7157e66e-4def-4d13-a2a4-838c54f111ee req-79c9db4d-4d22-49ce-81be-d29c1a04ab0f service nova] Creating event network-changed:9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca for instance f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db on nch2-master-1 Mar 26 20:56:40.894838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7157e66e-4def-4d13-a2a4-838c54f111ee req-79c9db4d-4d22-49ce-81be-d29c1a04ab0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085397 Mar 26 20:56:40.896056 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1260/2365] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:40.907540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:40.908926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:40.921175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.922176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.924181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:40.925088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:40.958318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:40.973289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61686487-cfb0-4792-95ac-06dd8bca1a97 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.945677 Mar 26 20:56:40.978279 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1106/2366] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:40 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:41.029310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:41.030082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:41.036079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.036542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:41.037334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.037777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:41.612842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:41.626254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f1c549b1-67c0-48a6-9e13-19da1bee89ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.727987 Mar 26 20:56:41.629300 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1261/2367] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:40 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:41.640290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:41.641595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:41.661798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.663637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:41.667519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.668380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:41.933358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:41.945285 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9772898-20be-4c65-93e7-3cd9874993a0 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1682 microversion: 2.1 time: 0.919738 Mar 26 20:56:41.946928 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1107/2368] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:41 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1682 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:41.952484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:41.954487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:41.962105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.962727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:41.963846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:41.964483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.308839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:42.316296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d7ee7ac-9f2a-4049-94c2-457552bbb61f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.367870 Mar 26 20:56:42.319597 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1108/2369] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:41 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:42.329144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:42.331072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:42.349752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.350536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.351523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.352198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.634617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:42.648439 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ba0fe58-d0fc-4fe4-afec-ae6097658bc8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.016838 Mar 26 20:56:42.650437 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1262/2370] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:41 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:42.658600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:42.659809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:42.669781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.670521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.679094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.680645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.689778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:42.701442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-83abade5-2a1a-484a-a5e0-c73f4199a641 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.380416 Mar 26 20:56:42.703555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1109/2371] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:42 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:42.710926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:42.711954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:42.748547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.749442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:42.752926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:42.753698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.149328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:43.161585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7b83b23-2eb1-4d5b-a449-1e79ede14f74 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.456604 Mar 26 20:56:43.162511 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1110/2372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:42 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:43.177355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:43.177979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:43.184967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.185588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.186517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.187239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.306900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:43.327060 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36a801c5-28e8-4d32-95b4-4dad2c14664d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 0.674965 Mar 26 20:56:43.329704 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1263/2373] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:42 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:43.334761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-728500137"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:43.336153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:43.349786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.350277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.351069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.351849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.593574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:43.611524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-04bfb640-5a55-4aa6-bcf8-01357a348630 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1682 microversion: 2.1 time: 0.447783 Mar 26 20:56:43.623673 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1111/2374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:43 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1682 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:43.630810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-aa41bc69-e840-4a50-a81f-9103079c1edf req-b9594142-b65d-4bc7-8751-3123d76fcd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8c33f0-5c7d-465c-aa83-7270c46d87bc", "tag": "5d9bf69f-609d-48c4-baa5-cb7b9c6889d2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:43.641525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-aa41bc69-e840-4a50-a81f-9103079c1edf req-b9594142-b65d-4bc7-8751-3123d76fcd70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.643651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-aa41bc69-e840-4a50-a81f-9103079c1edf req-b9594142-b65d-4bc7-8751-3123d76fcd70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.662138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-aa41bc69-e840-4a50-a81f-9103079c1edf req-b9594142-b65d-4bc7-8751-3123d76fcd70 service nova] Creating event network-changed:5d9bf69f-609d-48c4-baa5-cb7b9c6889d2 for instance ea8c33f0-5c7d-465c-aa83-7270c46d87bc on nch1-master-1 Mar 26 20:56:43.674782 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-aa41bc69-e840-4a50-a81f-9103079c1edf req-b9594142-b65d-4bc7-8751-3123d76fcd70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049092 Mar 26 20:56:43.676157 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1112/2375] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:43.683836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:43.685071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:43.695515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.697118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.698600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.700080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.728125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-892bcf51-f1aa-4fb9-997f-2ee635e8eb9b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.396528 Mar 26 20:56:43.729018 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1264/2376] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:56:43 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 26 20:56:43.737403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:43.739102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:43.749743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.750866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:43.752675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:43.753398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.262602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:44.276292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b1f93df-5c54-407c-83e0-f9b73fdec073 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.595675 Mar 26 20:56:44.277582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1113/2377] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:43 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:44.325178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:44.335485 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53612b8c-bb73-49c1-9724-922fe6fca472 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.603154 Mar 26 20:56:44.337479 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1265/2378] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:43 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:44.353325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:44.354247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:44.362088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:44.362938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.364141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:44.390290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.630070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:44.631077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:44.663128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:44.666466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.671371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:44.672263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.843662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e806dbaedc49e395b7d6b374ca2fec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e51fbb6333452b84c0c77d29b423b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:44.858069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9926b7c-bf64-4a05-8dc8-f38cea91ee77 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 200 len: 1615 microversion: 2.1 time: 0.231841 Mar 26 20:56:44.858712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1266/2379] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:44 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 1615 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:44.869029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-57fc2117-7dde-4940-a1db-69dcb40bccf6 req-a075f3ba-b7d4-4d7a-9726-95a4b8245e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df72bb8-2c08-42da-b528-003cdaec7d4e", "name": "network-vif-plugged", "status": "completed", "tag": "2393d24c-c12f-4ced-b0e6-3cc4d6bcca51"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:44.890042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-57fc2117-7dde-4940-a1db-69dcb40bccf6 req-a075f3ba-b7d4-4d7a-9726-95a4b8245e46 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:44.892464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-57fc2117-7dde-4940-a1db-69dcb40bccf6 req-a075f3ba-b7d4-4d7a-9726-95a4b8245e46 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:44.911507 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-57fc2117-7dde-4940-a1db-69dcb40bccf6 req-a075f3ba-b7d4-4d7a-9726-95a4b8245e46 service nova] Creating event network-vif-plugged:2393d24c-c12f-4ced-b0e6-3cc4d6bcca51 for instance 0df72bb8-2c08-42da-b528-003cdaec7d4e on nch1-master-1 Mar 26 20:56:44.916909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-57fc2117-7dde-4940-a1db-69dcb40bccf6 req-a075f3ba-b7d4-4d7a-9726-95a4b8245e46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056826 Mar 26 20:56:44.917556 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1267/2380] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:45.084061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-16365798", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "1d0343d0-ee1e-46f6-ac18-c82566fa23cb"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:45.155556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] validate_networks() for [('1d0343d0-ee1e-46f6-ac18-c82566fa23cb', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:45.356026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:45.366377 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e7692e76-9945-445d-ba2f-d901b269ec96 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1522 microversion: 2.1 time: 1.020976 Mar 26 20:56:45.366989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1114/2381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:44 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1522 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:45.380262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2ea0307c-c6f3-4fee-ade0-358d8876c925 req-b41972bd-10b7-4381-be1b-a8af8d24bb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eb23ef-ff6c-425c-811a-1aa2cffe0aad", "name": "network-vif-deleted", "tag": "f3c532be-691b-4c26-98db-d112c6a3c064"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:45.398574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ea0307c-c6f3-4fee-ade0-358d8876c925 req-b41972bd-10b7-4381-be1b-a8af8d24bb8f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:45.401623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ea0307c-c6f3-4fee-ade0-358d8876c925 req-b41972bd-10b7-4381-be1b-a8af8d24bb8f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:45.437465 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2ea0307c-c6f3-4fee-ade0-358d8876c925 req-b41972bd-10b7-4381-be1b-a8af8d24bb8f service nova] Creating event network-vif-deleted:f3c532be-691b-4c26-98db-d112c6a3c064 for instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad on nch2-master-1 Mar 26 20:56:45.443696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2ea0307c-c6f3-4fee-ade0-358d8876c925 req-b41972bd-10b7-4381-be1b-a8af8d24bb8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071155 Mar 26 20:56:45.444996 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1115/2382] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:45.452835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:45.453819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:45.463042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:45.463861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:45.464977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:45.465587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.381689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:46.395156 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a705dd73-19a9-4260-8070-863c5035032a tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.945657 Mar 26 20:56:46.405093 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1116/2383] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:45 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:46.409883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:46.410543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:46.423819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.424454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.425506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.426440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.483645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:46.484937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:46.485852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:46.487330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:46.488164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:46.504523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.505317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.507095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.509112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.532183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Getting quotas for project 7150c612879247208855ce511f95a5a2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:46.538530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Getting quotas for user a01a3991559f4738b240874a96dd5ad6 and project 7150c612879247208855ce511f95a5a2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:46.555599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:46.559959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:46.687909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e90b593e-596e-43f5-8bf8-f56fb22a352b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768916 Mar 26 20:56:46.696613 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1268/2384] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:56:46.706638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:46.707588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:46.724424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.725096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.726085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:46.726906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:46.747721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] HTTP exception thrown: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. Mar 26 20:56:46.748662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Returning 404 to user: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:46.749862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-545ece66-004a-40a3-97ad-4333edd56ece tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 404 len: 111 microversion: 2.1 time: 0.052330 Mar 26 20:56:46.750955 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1269/2385] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:46 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:46.842125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-693921743", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "b59a59cb-5fd5-418b-a9be-152d6c763ec9"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:46.931901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] validate_networks() for [('b59a59cb-5fd5-418b-a9be-152d6c763ec9', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:56:46.998583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:47.017255 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3ab3f818-d924-4919-aa29-a84c0c852cd5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.619958 Mar 26 20:56:47.020409 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1117/2386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:46 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:47.031756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:47.032806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:47.050686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.051427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.056364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.057608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.592664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:47.609357 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e058617c-0433-4104-af27-967bd99ab3af tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1499 microversion: 2.1 time: 0.586185 Mar 26 20:56:47.611808 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1118/2387] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:47 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1499 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:47.619903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:47.621169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:47.647475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.647475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.654209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.655068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.764884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:47.802551 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a32c8a6-ed29-4d19-a339-abd59d48dc39 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1234 microversion: 2.1 time: 0.188012 Mar 26 20:56:47.805294 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1119/2388] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:47 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1234 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:47.817950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-082d8829-154b-457a-abfd-a2831c8db5bc tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '.version_select at 0x7f6e5ecf7280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:47.892120 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-082d8829-154b-457a-abfd-a2831c8db5bc tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075983386" status: 202 len: 0 microversion: 2.1 time: 0.084061 Mar 26 20:56:47.912151 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1120/2389] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 20:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075983386 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:56:47.931036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:47.933222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:47.941595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:56:47.942680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:56:47.943390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:56:47.944701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:56:47.945942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:56:47.950423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.950914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.953982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.956178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.962176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.966294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:47.968644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:47.972584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.019817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Getting quotas for project 3797b42bf82b407abdd1fabd06dbe141. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:56:48.046246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Getting quotas for user 387ac2e169914b57991e4c1c45937e73 and project 3797b42bf82b407abdd1fabd06dbe141. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:56:48.078390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:56:48.088518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:56:48.192415 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-260fd155-7b70-4269-8735-c4d1015915d8 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440149 Mar 26 20:56:48.196056 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1270/2390] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:56:48.206511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:48.210584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:48.212584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:48.219486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:48.219970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.220986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:48.222199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.252344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:48.281846 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7cd92fdb-eec6-4a14-a8b3-4447ed6e3041 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.084534 Mar 26 20:56:48.283079 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1271/2391] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Mar 26 20:56:48 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:48.287989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:48.288849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:48.295039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:48.295709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.296709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:48.297327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.615377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:48.630372 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1c96e039-c7a9-4da5-a3fe-6406aa27b94d tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.716932 Mar 26 20:56:48.632596 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1121/2392] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:47 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:48.641737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b85cc156-7840-4d6f-a771-b593a522c1d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:48.646392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b85cc156-7840-4d6f-a771-b593a522c1d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:48.749557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:48.757756 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a72be6b-b8e8-4811-949d-19be74262716 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.473360 Mar 26 20:56:48.763236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1272/2393] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:48 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:48.771866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e3ce7b58-951b-422c-ae12-9dd12fc320ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:48.793764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3ce7b58-951b-422c-ae12-9dd12fc320ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:48.797406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3ce7b58-951b-422c-ae12-9dd12fc320ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:48.844042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e3ce7b58-951b-422c-ae12-9dd12fc320ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 20:56:48.939148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e3ce7b58-951b-422c-ae12-9dd12fc320ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "POST /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992/action" status: 202 len: 0 microversion: 2.1 time: 0.173935 Mar 26 20:56:48.940174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1273/2394] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:56:48 2022] POST /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:56:48.968492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:48.970954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:49.006313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.006780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.007581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.008051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.259860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:49.276817 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b54e54b-3c57-4607-8c2e-f2d19a931252 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1288 microversion: 2.1 time: 0.333770 Mar 26 20:56:49.290016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1274/2395] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:48 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1288 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:49.295548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:49.296276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:49.321444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.322054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.324344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.324872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.746935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:49.757133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66c4a0d6-7db5-49f1-bfb1-3c7ab9dbfbd5 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1508 microversion: 2.1 time: 0.473594 Mar 26 20:56:49.759382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1275/2396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:49 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:49.764095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:49.764714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:49.804413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.806566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.807624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:49.812100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:49.979372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b85cc156-7840-4d6f-a771-b593a522c1d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:49.989116 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b85cc156-7840-4d6f-a771-b593a522c1d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1215 microversion: 2.1 time: 1.355222 Mar 26 20:56:50.001274 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1122/2397] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:48 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1215 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:50.035083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:50.036042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:50.045458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.045927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:50.046730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.052018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:50.304688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:50.322191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dce8d930-8966-4f5e-831a-16db7fbcb833 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.561318 Mar 26 20:56:50.323679 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1276/2398] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:49 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:50.345058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:50.345955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:50.366711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.372452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:50.375193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.376993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:50.749255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:50.773027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4003fe2c-c5be-43ec-a5ec-ba93aff371b6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.433671 Mar 26 20:56:50.786051 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1277/2399] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:50 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:50.793197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:50.796676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:50.819028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.827510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:50.828794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:50.829424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:51.659811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:51.671316 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f89908d7-2588-4a32-82a7-ccab639491d7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 1.668596 Mar 26 20:56:51.676286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1123/2400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:50 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:51.687155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:51.688204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:51.707294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:51.708222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:51.710086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:51.712829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:51.734771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:51.746443 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-821ea66e-efb3-4100-9a42-15f7a283d63d tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1508 microversion: 2.1 time: 0.956617 Mar 26 20:56:51.748162 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1278/2401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:50 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1508 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:51.766783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5ffc9938-a9e7-4489-a82d-e08d1ad1fbfb req-e60e773c-0a20-4209-8ebc-4a5d3d54a9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-plugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:51.800661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5ffc9938-a9e7-4489-a82d-e08d1ad1fbfb req-e60e773c-0a20-4209-8ebc-4a5d3d54a9da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:51.802228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5ffc9938-a9e7-4489-a82d-e08d1ad1fbfb req-e60e773c-0a20-4209-8ebc-4a5d3d54a9da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:51.835424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5ffc9938-a9e7-4489-a82d-e08d1ad1fbfb req-e60e773c-0a20-4209-8ebc-4a5d3d54a9da service nova] Creating event network-vif-plugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:56:51.848749 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5ffc9938-a9e7-4489-a82d-e08d1ad1fbfb req-e60e773c-0a20-4209-8ebc-4a5d3d54a9da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096175 Mar 26 20:56:51.849959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1279/2402] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:51.857831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:51.858821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:51.873113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:51.875298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:51.877711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:51.879700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.150267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:52.159859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e2f1e4a3-9cd9-4821-83d7-e6f7944161d9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1273 microversion: 2.1 time: 0.482121 Mar 26 20:56:52.160762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1124/2403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:51 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:52.177554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:52.178507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:52.188699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.189464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.190476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.191228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.286233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:52.295786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-288cdfce-de2b-4c84-9e57-f9f51ab5d5f4 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.444405 Mar 26 20:56:52.307166 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1280/2404] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:51 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:52.524714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0817aa50-918c-4039-9b5c-08a4fc81831e req-b03c8f67-9aaf-4b6e-8687-e0254c426078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff07ab6-31a1-447f-99dc-e6f97b468d08", "tag": "99c505bb-f97f-4e98-9619-8702a96345b6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:52.563786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0817aa50-918c-4039-9b5c-08a4fc81831e req-b03c8f67-9aaf-4b6e-8687-e0254c426078 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.570960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0817aa50-918c-4039-9b5c-08a4fc81831e req-b03c8f67-9aaf-4b6e-8687-e0254c426078 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.593969 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0817aa50-918c-4039-9b5c-08a4fc81831e req-b03c8f67-9aaf-4b6e-8687-e0254c426078 service nova] Creating event network-changed:99c505bb-f97f-4e98-9619-8702a96345b6 for instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 on nch2-master-1 Mar 26 20:56:52.600855 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0817aa50-918c-4039-9b5c-08a4fc81831e req-b03c8f67-9aaf-4b6e-8687-e0254c426078 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084418 Mar 26 20:56:52.602576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1281/2405] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:56:52.693181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:52.694573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:52.710391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.711698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.712784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.713601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.866802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:52.909966 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ec43b370-5683-49e9-a936-0c428993acbb tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.737367 Mar 26 20:56:52.912121 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1125/2406] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:52 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:52.928456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:52.931718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:52.966668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.973232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:52.975022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:52.982957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:53.388797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:53.400214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b61bd535-5d0c-47b3-a425-5086c8ff1fae tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1508 microversion: 2.1 time: 0.486338 Mar 26 20:56:53.403353 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1126/2407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:52 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:53.423507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:53.424490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:53.451817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:53.452325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:53.453152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:53.453594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:53.555625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:53.576382 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8498514-de9b-4e52-8571-6e15326cc818 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.875276 Mar 26 20:56:53.590915 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1282/2408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:52 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:53.596074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:53.596710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:53.611639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:53.612156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:53.612963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:53.613418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:53.957182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:53.970981 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef824849-5e58-44c0-9bd8-74c1eef8a91a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.566321 Mar 26 20:56:53.975084 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1127/2409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:53 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:53.986865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db", "name": "network-vif-plugged", "status": "completed", "tag": "9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca"}, {"server_uuid": "ea8c33f0-5c7d-465c-aa83-7270c46d87bc", "name": "network-vif-plugged", "status": "completed", "tag": "5d9bf69f-609d-48c4-baa5-cb7b9c6889d2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:54.015674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.027111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.053083 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] Creating event network-vif-plugged:9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca for instance f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db on nch2-master-1 Mar 26 20:56:54.056549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] Creating event network-vif-plugged:5d9bf69f-609d-48c4-baa5-cb7b9c6889d2 for instance ea8c33f0-5c7d-465c-aa83-7270c46d87bc on nch1-master-1 Mar 26 20:56:54.078849 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4bee8f48-4621-40a6-8584-d7a8aaecb8e8 req-d720c743-73ca-4b26-a3ec-707894571f26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102245 Mar 26 20:56:54.080183 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1128/2410] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:54.087225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:54.088243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:54.113705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.114647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.115755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.118673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.137321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:54.150525 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-972f0c12-8cb8-4e8a-abf4-77035bb0c062 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.558228 Mar 26 20:56:54.158106 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1283/2411] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:53 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:54.421189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:54.422068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:54.437325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.443148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.446515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.451331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.669437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:54.677054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e5824857-7b3f-47dd-8101-70d119fd225e tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.595462 Mar 26 20:56:54.686774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1129/2412] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:54 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:54.692092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:54.692973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:54.708549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.709261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.710229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:54.710882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:54.975444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:54.984422 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3309c770-92b2-481f-bdd0-f4b7817a7a71 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1512 microversion: 2.1 time: 0.567754 Mar 26 20:56:54.988195 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1284/2413] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:54 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:56:54.998580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.000725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:55.024897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.025452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.027606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.028650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.158474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:55.168345 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b73de7b-d2ac-489e-9dfb-19504a065c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1318 microversion: 2.1 time: 0.480063 Mar 26 20:56:55.168923 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1130/2414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:54 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:55.182118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.185824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:55.189662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.servers [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Removing options 'limit' from query {{(pid=141580) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 26 20:56:55.190404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:55.191680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.192162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.193501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.193501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.195357 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-997f0433-fa71-4119-b19e-68d0fff84705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022797 Mar 26 20:56:55.203757 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1131/2415] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 20:56:55 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:56:55.215762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.216812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:55.228788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.230334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.231146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.231595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.525086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:55.532770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1631d970-fbc1-47cd-8661-8b5510d44f7b tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.543269 Mar 26 20:56:55.533625 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1285/2416] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:54 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:55.550325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.551297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:55.559632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.560172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.561096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.561421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.902219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:55.916445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3416fe29-bf0a-477b-83cd-2ab0c87f0bda tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1324 microversion: 2.1 time: 0.708230 Mar 26 20:56:55.919468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1132/2417] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:55 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:55.926535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.927542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:55.937812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.938282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.942187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.943744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.972556 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] HTTP exception thrown: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. Mar 26 20:56:55.973161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Returning 404 to user: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:55.974154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4090066-6933-4194-9540-a317005b5ae2 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 404 len: 111 microversion: 2.1 time: 0.053554 Mar 26 20:56:55.975122 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1133/2418] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:56:55 2022] DELETE /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:55.981062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:55.981692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:55.988534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.989996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:55.992728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:55.993360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.106067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:56.119821 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb57be34-623d-4458-ad13-6d3239b7234f tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1512 microversion: 2.1 time: 0.570128 Mar 26 20:56:56.121070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1286/2419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:55 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1512 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:56.129300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:56.134487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] [instance: 89eb23ef-ff6c-425c-811a-1aa2cffe0aad] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:56.147017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.147657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.152107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.152785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.183087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] HTTP exception thrown: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. Mar 26 20:56:56.188066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] Returning 404 to user: Instance 89eb23ef-ff6c-425c-811a-1aa2cffe0aad could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:56.189211 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37db455d-99d1-4699-b91c-129239482667 tempest-AttachSCSIVolumeTestJSON-1163101248 tempest-AttachSCSIVolumeTestJSON-1163101248-project] 10.222.0.16 "GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad" status: 404 len: 111 microversion: 2.1 time: 0.065752 Mar 26 20:56:56.196129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1287/2420] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:56 2022] GET /compute/v2.1/servers/89eb23ef-ff6c-425c-811a-1aa2cffe0aad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:56.205918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:56.208241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:56.220761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.222408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.226640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.227335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.584869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:56.600926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-381b13c2-474e-4525-9799-8cdfb9d3e320 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.624461 Mar 26 20:56:56.614108 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1134/2421] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:55 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:56.626660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0e63058c-4cf9-409d-a2c6-5fff2d4082ca req-a7d08435-1742-4199-9b0f-620542f23439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10263b9e-d54b-43f2-a45a-83603dc51b2c", "tag": "4c536011-78ac-4759-af99-8fc9826030cd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:56:56.655067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0e63058c-4cf9-409d-a2c6-5fff2d4082ca req-a7d08435-1742-4199-9b0f-620542f23439 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.658387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0e63058c-4cf9-409d-a2c6-5fff2d4082ca req-a7d08435-1742-4199-9b0f-620542f23439 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.677506 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0e63058c-4cf9-409d-a2c6-5fff2d4082ca req-a7d08435-1742-4199-9b0f-620542f23439 service nova] Creating event network-changed:4c536011-78ac-4759-af99-8fc9826030cd for instance 10263b9e-d54b-43f2-a45a-83603dc51b2c on nch1-master-1 Mar 26 20:56:56.685433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0e63058c-4cf9-409d-a2c6-5fff2d4082ca req-a7d08435-1742-4199-9b0f-620542f23439 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069235 Mar 26 20:56:56.687165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1135/2422] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:56.695220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:56.696803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:56.707378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.708240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.709463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:56.710145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:56.987952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:56.998370 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2884b2a-dd56-4b10-98e4-efb38bf077b9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1468 microversion: 2.1 time: 0.309716 Mar 26 20:56:57.011996 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1136/2423] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:56 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:57.011996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:57.016653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:57.034555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.034555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:57.034555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.034555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:57.140649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:57.150073 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-21c41c47-3c99-48b4-b0a8-3904d4dc164c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1513 microversion: 2.1 time: 0.952551 Mar 26 20:56:57.156280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1288/2424] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:56 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1513 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:57.167085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:57.177568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:57.197907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.199158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:57.200038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.200497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:57.545187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:57.558001 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b59a5d8-1530-472e-8661-9e58e8c9d6e3 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.549877 Mar 26 20:56:57.572116 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1137/2425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:57 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:57.581844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:57.584657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:57.606759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.607866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:57.615494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:57.616234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.039642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.048519 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b95909a1-f0f4-45eb-be09-c8574d4b8b0f tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1522 microversion: 2.1 time: 0.890367 Mar 26 20:56:58.052859 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1289/2426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:57 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1522 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:58.057652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:58.062403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:58.073626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.074452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.075503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.076210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.154707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.164689 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1539e8d-22c8-4e2e-bd88-a469f40d7d6b tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e" status: 200 len: 1467 microversion: 2.1 time: 0.590565 Mar 26 20:56:58.176107 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1138/2427] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:57 2022] GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e => generated 1467 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:58.181296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:58.182205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:58.193658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.196794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.198636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.202237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.400319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.411437 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-969634d5-36e1-4c26-9b46-54323816d819 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1511 microversion: 2.1 time: 0.357392 Mar 26 20:56:58.412960 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1290/2428] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:58 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:58.426887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:58.431963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:58.452774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.456230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.462301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.463545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.521274 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] HTTP exception thrown: Action 999 not found Mar 26 20:56:58.523304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Returning 404 to user: Action 999 not found {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:58.525610 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36578a0e-4176-44d1-8c0c-758e9a49bc9c tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.110815 Mar 26 20:56:58.526719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1291/2429] 10.222.0.16 () {58 vars in 1307 bytes} [Sat Mar 26 20:56:58 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc/os-instance-actions/999 => generated 66 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:56:58.534205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:58.542722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.544210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Searching by: {'reservation_id': 'r-6kwgy7l3', 'deleted': False, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:58.552392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.553168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.554578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.556573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:58.696925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:58.805699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.818410 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99e3d47b-4b29-40a1-9a0b-2849f11ab69a tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.639566 Mar 26 20:56:58.832052 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1139/2430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:58 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:58.842918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:58.850362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.853092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:56:58.860527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:58.868816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:58.869636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.299659 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e53fe950-8211-4695-9618-60a117c601da tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-6kwgy7l3" status: 200 len: 2928 microversion: 2.1 time: 0.771270 Mar 26 20:56:59.311944 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1292/2431] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Mar 26 20:56:58 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6kwgy7l3 => generated 2928 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:59.311944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfee6fcd-3d06-4280-b920-b4c0389961db tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '.version_select at 0x7f6e594b41f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.313560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.313560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.313560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.313560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.319132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dfee6fcd-3d06-4280-b920-b4c0389961db tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: 4f0555ef-8de3-499d-88c5-88b125ee6084] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:59.338705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-dfee6fcd-3d06-4280-b920-b4c0389961db tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] HTTP exception thrown: Instance 4f0555ef-8de3-499d-88c5-88b125ee6084 could not be found. Mar 26 20:56:59.343365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfee6fcd-3d06-4280-b920-b4c0389961db tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Returning 404 to user: Instance 4f0555ef-8de3-499d-88c5-88b125ee6084 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:56:59.345767 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dfee6fcd-3d06-4280-b920-b4c0389961db tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/4f0555ef-8de3-499d-88c5-88b125ee6084/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044099 Mar 26 20:56:59.352661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1293/2432] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 20:56:59 2022] GET /compute/v2.1/servers/4f0555ef-8de3-499d-88c5-88b125ee6084/os-instance-actions => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:59.358857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.371551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:59.410208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.411514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.412640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.413323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.563043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:56:59.625971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1aabd4e0-95ac-44c2-862c-06f7c393d509 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.792594 Mar 26 20:56:59.627018 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1140/2433] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Mar 26 20:56:58 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:59.631858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bca1d43-21c2-4594-8e27-fc3f8998e275 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.649060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.server_groups [None req-3bca1d43-21c2-4594-8e27-fc3f8998e275 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Querying cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) for 2 instances {{(pid=141580) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 26 20:56:59.650327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bca1d43-21c2-4594-8e27-fc3f8998e275 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.651019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bca1d43-21c2-4594-8e27-fc3f8998e275 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.683350 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bca1d43-21c2-4594-8e27-fc3f8998e275 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/c729502b-28d5-49c5-875a-c17fbdb10f5d" status: 200 len: 271 microversion: 2.1 time: 0.054961 Mar 26 20:56:59.684685 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1141/2434] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:56:59 2022] GET /compute/v2.1/os-server-groups/c729502b-28d5-49c5-875a-c17fbdb10f5d => generated 271 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:56:59.689796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.690679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:59.700248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.701096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.702190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.702874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.736640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:56:59.903403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-28611873-bf13-4f38-8439-06b281936045 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 204 len: 0 microversion: 2.1 time: 0.216713 Mar 26 20:56:59.904382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:56:59.905554 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1142/2435] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:56:59 2022] DELETE /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:56:59.913787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.915541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:59.923103 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-166c4272-b40c-493a-8f40-2f55bcd8316f tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.568911 Mar 26 20:56:59.923959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1294/2436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:59 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:56:59.925338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.926131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.927238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.927944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.945987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:56:59.948392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:56:59.966928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.967149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:56:59.968184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:56:59.969237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.260270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:00.273846 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38dce2e4-0ed6-4a29-add1-1811482031c4 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1512 microversion: 2.1 time: 0.364563 Mar 26 20:57:00.275900 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1143/2437] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:59 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:00.282937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:00.284247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:00.299664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.300424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.301451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.302066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.446020 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99aa1761-6ebf-4a15-a260-cf2a41ea7649 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e" status: 200 len: 1618 microversion: 2.1 time: 0.506538 Mar 26 20:57:00.447194 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1295/2438] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:59 2022] GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e => generated 1618 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:00.452399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:00.453933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:00.461807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.462270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.463062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.463709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.656959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:00.666464 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2e10018-594d-4f74-8d1e-f193da650927 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1528 microversion: 2.1 time: 0.217906 Mar 26 20:57:00.668270 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1296/2439] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:00 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1528 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:00.674538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:00.675657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:00.683598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.684104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.685546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.686003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.810486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:00.834818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-428f6689-af01-4ffb-96b7-bda40b3a98c5 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.556719 Mar 26 20:57:00.835366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1144/2440] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:00 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:00.857564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:00.858389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:00.864825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.865292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.866104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.866659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.920748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:00.929096 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-485b252b-2cc3-496e-acd6-72f08bba57ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1513 microversion: 2.1 time: 0.259549 Mar 26 20:57:00.929857 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1297/2441] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:00 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:00.940591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:00.941303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:00.952647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.953845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:00.955394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:00.956898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:01.151005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:01.161895 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af5aaa5c-6b41-4222-9bb9-e0630cec0f55 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.225621 Mar 26 20:57:01.172314 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1298/2442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:00 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:01.177420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:01.178139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:01.185002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:01.185458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:01.186230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:01.186897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:01.379419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d9c551c-51f8-4e21-8f90-d1f334ed3471 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1619 microversion: 2.1 time: 0.521492 Mar 26 20:57:01.380697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1145/2443] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:00 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1619 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:01.587357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-452437504", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c51099b7-6a2d-4a66-8a36-3b9b6c08e32e"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:01.700579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:01.876713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:01.885321 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1088cc9c-3655-4d09-953c-4efd41eba6c6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1511 microversion: 2.1 time: 0.711633 Mar 26 20:57:01.890312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1299/2444] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:01 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1511 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:01.899538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:01.900197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:01.917881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:01.918338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:01.919133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:01.919572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.182379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:02.197198 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91eaf6b8-c71f-4da5-b13c-8bd681a6ed24 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1528 microversion: 2.1 time: 0.304479 Mar 26 20:57:02.201414 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1300/2445] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:01 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:02.213839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:02.214394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:02.230505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.230965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.233898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.235861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.621539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:02.622456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:02.623124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:02.623703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:02.624309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:02.645623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.646441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.648073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.649240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.700176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:02.702553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:02.708721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:02.713425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07eb5396-467f-407d-a9af-d22a92ea076b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.507400 Mar 26 20:57:02.713984 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1301/2446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:02 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:02.726594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:02.733304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:02.735411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:02.747671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:02.750095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:02.750797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.751359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.755549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.759100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.831013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:02.849650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9332e0f6-a628-400c-976a-560a612128ab tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266466 Mar 26 20:57:02.854915 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1146/2447] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:57:02.867408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:02.868320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:02.885325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.886004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.888736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.890839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:02.927954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:02.943621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:02.944180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.583252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:03.603716 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40ee3012-2c2f-41ce-9275-6f013ae499ae tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.742358 Mar 26 20:57:03.605392 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1147/2448] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:02 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:03.626105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e60a3b67-2c67-4e0a-a28f-ee952bf988b9 req-c51c71ef-6e95-4708-9a23-e4e1eec59683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff07ab6-31a1-447f-99dc-e6f97b468d08", "name": "network-vif-plugged", "status": "completed", "tag": "99c505bb-f97f-4e98-9619-8702a96345b6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:03.663369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e60a3b67-2c67-4e0a-a28f-ee952bf988b9 req-c51c71ef-6e95-4708-9a23-e4e1eec59683 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.664252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e60a3b67-2c67-4e0a-a28f-ee952bf988b9 req-c51c71ef-6e95-4708-9a23-e4e1eec59683 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.691547 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e60a3b67-2c67-4e0a-a28f-ee952bf988b9 req-c51c71ef-6e95-4708-9a23-e4e1eec59683 service nova] Creating event network-vif-plugged:99c505bb-f97f-4e98-9619-8702a96345b6 for instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 on nch2-master-1 Mar 26 20:57:03.703663 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e60a3b67-2c67-4e0a-a28f-ee952bf988b9 req-c51c71ef-6e95-4708-9a23-e4e1eec59683 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082641 Mar 26 20:57:03.720369 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1148/2449] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:03.726921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:03.728099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:03.741958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.744165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.745259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.745948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.842800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:03.850516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-75c4f3eb-d13c-4ca6-9bc8-ac2e23c25b52 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1220 microversion: 2.1 time: 0.128461 Mar 26 20:57:03.854605 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1149/2450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:03 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:03.868565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:03.876797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:03.883765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.886490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.887541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.888260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.927235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:03.927998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:03.928649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lazy-loading 'fault' on Instance uuid ea8c33f0-5c7d-465c-aa83-7270c46d87bc {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:57:03.981698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:04.007810 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d10252f-62d3-4549-97cb-0c10850eebe7 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1314 microversion: 2.1 time: 0.130992 Mar 26 20:57:04.009122 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1150/2451] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:03 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:04.015484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-430f4c46-aac9-4b17-8af9-e9af908b42bd req-5add58e7-f5dc-4d6e-975d-d2fc94a8f592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8c33f0-5c7d-465c-aa83-7270c46d87bc", "name": "network-vif-deleted", "tag": "5d9bf69f-609d-48c4-baa5-cb7b9c6889d2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:04.039591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-430f4c46-aac9-4b17-8af9-e9af908b42bd req-5add58e7-f5dc-4d6e-975d-d2fc94a8f592 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.040363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-430f4c46-aac9-4b17-8af9-e9af908b42bd req-5add58e7-f5dc-4d6e-975d-d2fc94a8f592 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.054999 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-430f4c46-aac9-4b17-8af9-e9af908b42bd req-5add58e7-f5dc-4d6e-975d-d2fc94a8f592 service nova] Creating event network-vif-deleted:5d9bf69f-609d-48c4-baa5-cb7b9c6889d2 for instance ea8c33f0-5c7d-465c-aa83-7270c46d87bc on nch1-master-1 Mar 26 20:57:04.061411 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-430f4c46-aac9-4b17-8af9-e9af908b42bd req-5add58e7-f5dc-4d6e-975d-d2fc94a8f592 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050126 Mar 26 20:57:04.063623 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1151/2452] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:04.068301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:04.068967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:04.077225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.078622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.078931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.079547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.151829 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e705610a-cc54-4e38-8784-61e0d6a1e09a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 1.436717 Mar 26 20:57:04.158918 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1302/2453] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 20:57:02 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:04.177693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:04.181786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:04.182555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:04.308909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:04.319174 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-deaff40b-8281-41ff-bfb6-13d1262b1a5b tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1330 microversion: 2.1 time: 0.254915 Mar 26 20:57:04.320986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1152/2454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:04 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1330 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:04.582110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.583022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.584928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.585539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.623702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:04.624440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:04.640835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.645912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.649367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.650030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.840206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:04.920910 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9279738-6285-48a5-8a0b-5677796544ca tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.746625 Mar 26 20:57:04.922144 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1303/2455] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Mar 26 20:57:04 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:04.930082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:04.931097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:04.942262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.943070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:04.944335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:04.945677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.420923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:05.436753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-28b98e95-c571-4983-92c3-7ba34f5dcbf2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1268 microversion: 2.1 time: 0.508505 Mar 26 20:57:05.441217 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1304/2456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:04 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1268 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:05.453918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:05.467504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:05.473976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:05.488876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.493558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.498530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.501586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.503462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:05.511616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bde038e-36a0-43f0-a8dd-1cd10110c3e9 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.892835 Mar 26 20:57:05.530434 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1153/2457] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:04 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:05.536265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:05.537087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:05.543999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.544740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.545708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.546313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.602515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.603307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.604003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lazy-loading 'fault' on Instance uuid ea8c33f0-5c7d-465c-aa83-7270c46d87bc {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:57:05.822322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0c5bde8c054cbcbc19291778a9511b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79effa8b201c422cb22e57efa4c8892a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:05.840402 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6825dcae-0be7-49e3-9760-f1d3fae80567 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 200 len: 1314 microversion: 2.1 time: 0.308525 Mar 26 20:57:05.842070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1154/2458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:05 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:05.851453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:05.852113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:05.859266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:05.871726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.872421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:05.873387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:05.874019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.019228 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e514f7fc-ba4a-4a25-9291-e959c66b4a4a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.575184 Mar 26 20:57:06.024016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1305/2459] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Mar 26 20:57:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:06.041952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-160ea99a-2889-4358-be12-1f5e95c4276d req-86b4c118-51d6-46a7-bfd4-c215a0aaf36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10263b9e-d54b-43f2-a45a-83603dc51b2c", "name": "network-vif-plugged", "status": "completed", "tag": "4c536011-78ac-4759-af99-8fc9826030cd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:06.057575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-160ea99a-2889-4358-be12-1f5e95c4276d req-86b4c118-51d6-46a7-bfd4-c215a0aaf36c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.058070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-160ea99a-2889-4358-be12-1f5e95c4276d req-86b4c118-51d6-46a7-bfd4-c215a0aaf36c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.074375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-160ea99a-2889-4358-be12-1f5e95c4276d req-86b4c118-51d6-46a7-bfd4-c215a0aaf36c service nova] Creating event network-vif-plugged:4c536011-78ac-4759-af99-8fc9826030cd for instance 10263b9e-d54b-43f2-a45a-83603dc51b2c on nch1-master-1 Mar 26 20:57:06.080206 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-160ea99a-2889-4358-be12-1f5e95c4276d req-86b4c118-51d6-46a7-bfd4-c215a0aaf36c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055359 Mar 26 20:57:06.081197 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1306/2460] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:06.087291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:06.091027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:06.091789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:06.099351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.099763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.101079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.101079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.225582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:06.335611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2730fc3e-4aa1-4a03-b47a-451a7c2640ed tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.253104 Mar 26 20:57:06.336630 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1307/2461] 10.222.0.16 () {58 vars in 1195 bytes} [Sat Mar 26 20:57:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:06.352928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:06.357625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:06.357943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': '2045972588', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:06.366671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.366671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.366671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.366671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.466639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:06.642888 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f62ff4c-42b3-4251-9607-a7ddb9e140ad tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=2045972588" status: 200 len: 346 microversion: 2.1 time: 0.298458 Mar 26 20:57:06.644599 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1308/2462] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Mar 26 20:57:06 2022] GET /compute/v2.1/servers?name=2045972588 => generated 346 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:06.653748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:06.654762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:06.666289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.667658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.671544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.672373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.786635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:06.821966 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1255e2e-6447-4770-907b-b3adaa9ff113 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1274 microversion: 2.1 time: 0.175726 Mar 26 20:57:06.825553 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1309/2463] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:06 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:06.837634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:06.840007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:06.848144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.848836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.849864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.850496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.899217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:06.907460 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8a037005-926a-4fa3-9e3e-d23183c1c17f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1535 microversion: 2.1 time: 1.064320 Mar 26 20:57:06.910574 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1155/2464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:05 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1535 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:06.918571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:06.923096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:06.924327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:06.931016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.932332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:06.934186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:06.935067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.065732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:07.178607 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e1538f4-fcf3-437c-a560-643700362087 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.266739 Mar 26 20:57:07.180413 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1156/2465] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Mar 26 20:57:06 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:07.185842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:07.186708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] [instance: ea8c33f0-5c7d-465c-aa83-7270c46d87bc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:07.193994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.194689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.195742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.196689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.213158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] HTTP exception thrown: Instance ea8c33f0-5c7d-465c-aa83-7270c46d87bc could not be found. Mar 26 20:57:07.214002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] Returning 404 to user: Instance ea8c33f0-5c7d-465c-aa83-7270c46d87bc could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:07.215134 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-901599cf-bd47-403e-a02d-c847725a4267 tempest-InstanceActionsNegativeTestJSON-2095367009 tempest-InstanceActionsNegativeTestJSON-2095367009-project] 10.222.0.16 "GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc" status: 404 len: 111 microversion: 2.1 time: 0.033520 Mar 26 20:57:07.215878 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1157/2466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:07 2022] GET /compute/v2.1/servers/ea8c33f0-5c7d-465c-aa83-7270c46d87bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:07.221344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f370da61-0717-4b40-b421-53c98fa6ddf6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'create', calling method: .version_select at 0x7f6e5ece8ca0>, body: {"pool": "339cc6ca-e602-48a0-984b-bc0e7f2b3b82"} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:07.415827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:07.430852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-742b69eb-e325-450f-ba7c-ff447f1d1d89 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1315 microversion: 2.1 time: 0.602846 Mar 26 20:57:07.432190 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1310/2467] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:06 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:07.438972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:07.446485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:07.447626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-204597258', 'deleted': False, 'project_id': 'a6beb485658f40dc83598fd2e00800ad'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:07.456125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.456866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.458288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.458992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.599169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:07.702585 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba8a7c4e-da8b-4010-b3d0-2a56db683696 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-204597258" status: 200 len: 346 microversion: 2.1 time: 0.268926 Mar 26 20:57:07.710552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1311/2468] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Mar 26 20:57:07 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-204597258 => generated 346 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:07.716450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:07.717213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:07.724382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.725154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.726189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.726862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.763988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:07.925109 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72be347a-4fd8-4805-a3c0-96f5a582c1d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 204 len: 0 microversion: 2.1 time: 0.207650 Mar 26 20:57:07.932439 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1312/2469] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:07 2022] DELETE /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:07.940836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:07.942708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:07.953528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.954273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:07.955214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:07.956023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:08.987113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:09.001652 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70e37ef1-6883-4fe9-b860-a55a24a3ca2a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 1.064152 Mar 26 20:57:09.003237 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1313/2470] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:07 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:09.014732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:09.016640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:09.043979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:09.044592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:09.045499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:09.046309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:09.628856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:09.643311 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f218aa4c-4a10-48a4-a055-ab1fc87de48c tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1517 microversion: 2.1 time: 0.638217 Mar 26 20:57:09.653758 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1314/2471] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:09 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1517 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:09.656867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:09.657618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:09.665647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:09.666107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:09.666888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:09.667328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.223820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:10.235534 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4cbcb975-8c40-4576-b0cb-4f545bfdc153 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1504 microversion: 2.1 time: 0.588438 Mar 26 20:57:10.237014 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1315/2472] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:09 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:10.243770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:10.244660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:10.255414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.256245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.258562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.259639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.649929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:10.657690 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52453df3-2af7-416c-afb2-d62e536507ed tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.419395 Mar 26 20:57:10.658289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1316/2473] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:10 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:10.672199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:10.673128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:10.693046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.693767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.694694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.696531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.940940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f370da61-0717-4b40-b421-53c98fa6ddf6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.723798 Mar 26 20:57:10.941545 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1158/2474] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:57:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:10.947900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:10.948764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:10.964240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.964777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:10.965865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:10.966533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.090990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8bf648f9-c45b-4136-9837-e11bd5c52ce4 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.148170 Mar 26 20:57:11.091635 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1159/2475] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 20:57:10 2022] DELETE /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c/os-server-password => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:11.101924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:11.102580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:11.116254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:11.117543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.120739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.122128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.125125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.134758 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4ff5cf07-d6f1-4df3-a26f-cd6f433779d0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.468667 Mar 26 20:57:11.159152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1317/2476] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:10 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:11.167203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1334276079"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:11.169281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:11.182288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.183055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.184408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.185018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.660933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:11.672426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2615e26-0a0f-421a-bb78-218e0cdf2c42 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 200 len: 1517 microversion: 2.1 time: 0.579380 Mar 26 20:57:11.684391 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1160/2477] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:11 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 1517 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:11.708937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.237"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:11.710444 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea415d9f-e534-431d-b75c-fc4d8f57784a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.549669 Mar 26 20:57:11.713958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1318/2478] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:11 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 26 20:57:11.724738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:11.756794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.757392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.761738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:11.763303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:11.763504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.768266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.779149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.780083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.782707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.784251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.824744 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6fa556f9-802c-497a-94fd-472b9c45d6d6 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.092965 Mar 26 20:57:11.826034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1319/2479] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 20:57:11 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c/os-server-password => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:57:11.850911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1b3dc17a-c20c-4213-ac10-828fa0c2eeb2 req-8c4b1b6c-fe06-4bd5-8331-a4ffcb1982e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b90cee9-9904-41f7-95a5-d6ed889e27ed", "tag": "aa18c074-3c50-4a11-9055-0c0910e8dd41"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:11.888742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Acquired lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:57:11.891720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1b3dc17a-c20c-4213-ac10-828fa0c2eeb2 req-8c4b1b6c-fe06-4bd5-8331-a4ffcb1982e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.892216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1b3dc17a-c20c-4213-ac10-828fa0c2eeb2 req-8c4b1b6c-fe06-4bd5-8331-a4ffcb1982e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.908608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1b3dc17a-c20c-4213-ac10-828fa0c2eeb2 req-8c4b1b6c-fe06-4bd5-8331-a4ffcb1982e9 service nova] Creating event network-changed:aa18c074-3c50-4a11-9055-0c0910e8dd41 for instance 5b90cee9-9904-41f7-95a5-d6ed889e27ed on nch1-master-1 Mar 26 20:57:11.916707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1b3dc17a-c20c-4213-ac10-828fa0c2eeb2 req-8c4b1b6c-fe06-4bd5-8331-a4ffcb1982e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088475 Mar 26 20:57:11.917855 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1320/2480] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:11.950010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:11.953110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:11.966222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.967474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:11.968868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:11.969733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.006606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:12.169614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8d1a2f9-4a6e-4fb5-97b2-bec2cb1c5f3c tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 204 len: 0 microversion: 2.1 time: 0.241828 Mar 26 20:57:12.170432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1321/2481] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:11 2022] DELETE /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:12.186805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:12.186805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:12.214029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.214403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.215185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.215625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.383722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:12.393098 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3349e81-b8da-48c4-b77d-bc9ad1158ec6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.215792 Mar 26 20:57:12.396600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1322/2482] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:12 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:12.401445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:12.402068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:12.408583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.409038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.409829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.410268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.594994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:12.606947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bf22da6-b5ae-4ac5-924b-236eb7252c66 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1510 microversion: 2.1 time: 0.209157 Mar 26 20:57:12.618331 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1323/2483] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:12 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:12.692128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:12.694122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 2531d82d-f786-4c55-ae92-5dd6abe2083b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:12.702151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.702849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.703948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.704545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.721965 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] HTTP exception thrown: Instance 2531d82d-f786-4c55-ae92-5dd6abe2083b could not be found. Mar 26 20:57:12.723307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Returning 404 to user: Instance 2531d82d-f786-4c55-ae92-5dd6abe2083b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:12.724499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aac89ec5-bd8b-4b1e-971d-bda733860a57 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b" status: 404 len: 111 microversion: 2.1 time: 0.037769 Mar 26 20:57:12.729044 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1324/2484] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:12 2022] GET /compute/v2.1/servers/2531d82d-f786-4c55-ae92-5dd6abe2083b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:57:12.734363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:12.735178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:12.745059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.745762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.746546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.747681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.793765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:12.906787 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0995638b-147f-4f0e-aa84-d1f891ac4e49 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 204 len: 0 microversion: 2.1 time: 0.175798 Mar 26 20:57:12.910263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1325/2485] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:12 2022] DELETE /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:12.928563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:12.929567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:12.938218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.938948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:12.939988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:12.941236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.120375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:13.128456 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-877b7a62-4075-44db-9daf-8a3f66ce52ea tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1519 microversion: 2.1 time: 0.206284 Mar 26 20:57:13.138719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1326/2486] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:12 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:13.410159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:13.411026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:13.417724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:13.418325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.419127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:13.419500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.592646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:13.608427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a4c3994-d70d-4f67-8358-145c362a3fa7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.201916 Mar 26 20:57:13.609806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1327/2487] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:13 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:57:13.623785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:13.625927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:13.633968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:13.634833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.636005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:13.636608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.815596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:13.832562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d9227a4-530a-486c-ab10-4e250bddb0ad tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1510 microversion: 2.1 time: 0.212287 Mar 26 20:57:13.833998 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1328/2488] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:13 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:13.967778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8e7f70bb-23dd-4dcb-9d54-f0066eeaa89f req-5023a84a-2017-4332-a677-80cf563027a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2531d82d-f786-4c55-ae92-5dd6abe2083b", "name": "network-vif-deleted", "tag": "56d251dd-2d4d-4ce8-9b31-52c7c34abe80"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:13.977095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8e7f70bb-23dd-4dcb-9d54-f0066eeaa89f req-5023a84a-2017-4332-a677-80cf563027a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:13.977553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8e7f70bb-23dd-4dcb-9d54-f0066eeaa89f req-5023a84a-2017-4332-a677-80cf563027a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:13.990277 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8e7f70bb-23dd-4dcb-9d54-f0066eeaa89f req-5023a84a-2017-4332-a677-80cf563027a6 service nova] Creating event network-vif-deleted:56d251dd-2d4d-4ce8-9b31-52c7c34abe80 for instance 2531d82d-f786-4c55-ae92-5dd6abe2083b on nch2-master-1 Mar 26 20:57:13.995622 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8e7f70bb-23dd-4dcb-9d54-f0066eeaa89f req-5023a84a-2017-4332-a677-80cf563027a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031445 Mar 26 20:57:13.996258 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1329/2489] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:57:14.145479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:14.146211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:14.152386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.152844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.153638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.154658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.529470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:14.541550 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-929f6754-5ff5-4e53-b198-ca81af6b7330 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1519 microversion: 2.1 time: 0.399567 Mar 26 20:57:14.551722 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1330/2490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:14 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:57:14.626133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:14.626780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:14.632719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.633443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.634217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.634651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.792800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:14.800736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d96c38d4-7d19-4b4a-bd4b-1f6c65a589e7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.178498 Mar 26 20:57:14.801679 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1331/2491] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:14 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:57:14.852361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9b26c390-17ef-43fc-9670-ccdfc24d118c req-4d43e382-1348-40eb-bbc6-2f868cc8e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-unplugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:14.867714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9b26c390-17ef-43fc-9670-ccdfc24d118c req-4d43e382-1348-40eb-bbc6-2f868cc8e1fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.868469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9b26c390-17ef-43fc-9670-ccdfc24d118c req-4d43e382-1348-40eb-bbc6-2f868cc8e1fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.879765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9b26c390-17ef-43fc-9670-ccdfc24d118c req-4d43e382-1348-40eb-bbc6-2f868cc8e1fc service nova] Creating event network-vif-unplugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:57:14.885312 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9b26c390-17ef-43fc-9670-ccdfc24d118c req-4d43e382-1348-40eb-bbc6-2f868cc8e1fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041228 Mar 26 20:57:14.885913 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1332/2492] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:14.892785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:14.893701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:14.900636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.901095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:14.901878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:14.902505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:15.052853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:15.061400 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3905e9a0-1735-45b5-bea6-b3125a39ab32 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1510 microversion: 2.1 time: 0.174018 Mar 26 20:57:15.061999 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1333/2493] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:14 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:15.563711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:15.564984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:15.577283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:15.577674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:15.578466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:15.578911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:16.062498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:16.071718 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73fe1fac-1221-4209-b5bc-02f915dc30e6 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 200 len: 1519 microversion: 2.1 time: 0.516037 Mar 26 20:57:16.081492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1334/2494] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:15 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:16.086956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:16.087577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:16.094513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:16.094971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:16.095747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:16.096210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:16.580076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:16.587574 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1c82c3ae-0ba2-4931-8409-21b201a1a3ad tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.504883 Mar 26 20:57:16.588210 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1335/2495] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:16 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:16.600313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:16.606976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:16.618419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:16.619101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:16.620116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:16.621995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Building network info cache for instance {{(pid=141580) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:57:16.623439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:17.326467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387ac2e169914b57991e4c1c45937e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3797b42bf82b407abdd1fabd06dbe141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:17.349032 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f6422376-3e56-4bb8-993a-b02c0f700e4a tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 200 len: 1510 microversion: 2.1 time: 0.752661 Mar 26 20:57:17.350033 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1336/2496] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:16 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 1510 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:17.369195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-842e2684-c368-483a-8fd9-7c23bb2b82f8 req-46c33255-3ffb-42aa-bbe2-bcb85e51349f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff07ab6-31a1-447f-99dc-e6f97b468d08", "tag": "99c505bb-f97f-4e98-9619-8702a96345b6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:17.411196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-842e2684-c368-483a-8fd9-7c23bb2b82f8 req-46c33255-3ffb-42aa-bbe2-bcb85e51349f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:17.411643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-842e2684-c368-483a-8fd9-7c23bb2b82f8 req-46c33255-3ffb-42aa-bbe2-bcb85e51349f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:17.451719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-842e2684-c368-483a-8fd9-7c23bb2b82f8 req-46c33255-3ffb-42aa-bbe2-bcb85e51349f service nova] Creating event network-changed:99c505bb-f97f-4e98-9619-8702a96345b6 for instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 on nch2-master-1 Mar 26 20:57:17.462937 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-842e2684-c368-483a-8fd9-7c23bb2b82f8 req-46c33255-3ffb-42aa-bbe2-bcb85e51349f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108870 Mar 26 20:57:17.463818 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1337/2497] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:17.741561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-822836107", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e576dcd8-f5e7-40ea-bc9e-ff386ea0e139"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:17.878544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] validate_networks() for [('e576dcd8-f5e7-40ea-bc9e-ff386ea0e139', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:19.192410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Updating instance_info_cache with network_info: [{"id": "99c505bb-f97f-4e98-9619-8702a96345b6", "address": "fa:16:3e:3d:e5:7d", "network": {"id": "1d0343d0-ee1e-46f6-ac18-c82566fa23cb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1411116242-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7150c612879247208855ce511f95a5a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99c505bb-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:57:19.221435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Releasing lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:57:19.222585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbc3ee66-84ad-415b-a261-7e01fef9627f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 202 len: 0 microversion: 2.1 time: 7.536672 Mar 26 20:57:19.223399 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1161/2498] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:11 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 0 bytes in 7538 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:57:19.232249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:19.238068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: e6833d6e-98a8-45aa-b478-03846a702b18] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:19.250795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.251755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.258859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.259335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.275368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:19.277011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:19.277690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:19.278301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:19.280189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:19.285727 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] HTTP exception thrown: Instance e6833d6e-98a8-45aa-b478-03846a702b18 could not be found. Mar 26 20:57:19.286345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Returning 404 to user: Instance e6833d6e-98a8-45aa-b478-03846a702b18 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:19.287191 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-70dc1597-27d8-49c8-bff7-631b2fcd93d2 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18" status: 404 len: 111 microversion: 2.1 time: 0.062651 Mar 26 20:57:19.289126 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1162/2499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:19 2022] GET /compute/v2.1/servers/e6833d6e-98a8-45aa-b478-03846a702b18 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:19.300984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3a0554c5-93c2-4e8a-ba4a-ed9b3fc0e7e5 req-b8674696-d1c8-4020-8c5a-27aa60fa9cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6833d6e-98a8-45aa-b478-03846a702b18", "name": "network-vif-deleted", "tag": "2da49cd1-c1ff-4ee7-ae87-4672c4430a08"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:19.301575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.302235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.303593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.305489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.318657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3a0554c5-93c2-4e8a-ba4a-ed9b3fc0e7e5 req-b8674696-d1c8-4020-8c5a-27aa60fa9cc8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.319419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3a0554c5-93c2-4e8a-ba4a-ed9b3fc0e7e5 req-b8674696-d1c8-4020-8c5a-27aa60fa9cc8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.346080 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3a0554c5-93c2-4e8a-ba4a-ed9b3fc0e7e5 req-b8674696-d1c8-4020-8c5a-27aa60fa9cc8 service nova] Creating event network-vif-deleted:2da49cd1-c1ff-4ee7-ae87-4672c4430a08 for instance e6833d6e-98a8-45aa-b478-03846a702b18 on nch1-master-1 Mar 26 20:57:19.359245 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3a0554c5-93c2-4e8a-ba4a-ed9b3fc0e7e5 req-b8674696-d1c8-4020-8c5a-27aa60fa9cc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061957 Mar 26 20:57:19.363783 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1163/2500] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:19.370348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Getting quotas for project c7b56cae79f846b5b6f3700480cfc811. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:19.386013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:19.386733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:19.390283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Getting quotas for user 75cdd0c73bcc473081b65958a7b1fbe6 and project c7b56cae79f846b5b6f3700480cfc811. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:19.410774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.416571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.417414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.417861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.423672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Going to run 2 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:19.426925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 8368aa61-964c-40fc-b08f-5369b1915410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:19.488361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=8368aa61-964c-40fc-b08f-5369b1915410,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:19.633222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fee079d-be5f-4048-a292-3e327cad2c31 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168096 Mar 26 20:57:19.637889 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1338/2501] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:57:19.662680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:19.663288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] [instance: 10263b9e-d54b-43f2-a45a-83603dc51b2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:19.680280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.680737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.686282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.686939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.723337 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] HTTP exception thrown: Instance 10263b9e-d54b-43f2-a45a-83603dc51b2c could not be found. Mar 26 20:57:19.727465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] Returning 404 to user: Instance 10263b9e-d54b-43f2-a45a-83603dc51b2c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:19.728769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70bb6d9c-e9db-4f41-9666-ccebd7f8c364 tempest-ServerPasswordTestJSON-1607106164 tempest-ServerPasswordTestJSON-1607106164-project] 10.222.0.16 "GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c" status: 404 len: 111 microversion: 2.1 time: 0.089209 Mar 26 20:57:19.736687 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1339/2502] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:19 2022] GET /compute/v2.1/servers/10263b9e-d54b-43f2-a45a-83603dc51b2c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:19.742954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8c6a49e-edaa-4a04-b3fa-5195e44657f6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'create', calling method: .version_select at 0x7f6e59529310>, body: {"pool": "339cc6ca-e602-48a0-984b-bc0e7f2b3b82"} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:19.860223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:19.869495 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-54923c91-29aa-4c55-bb0b-0c02a2db8de8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.504058 Mar 26 20:57:19.870091 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1164/2503] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:19 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:19.884544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:19.897597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:19.917813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.922550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.927520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:19.928239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:19.996532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:20.244778 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9efecea1-730a-4815-acb0-0710cd101f6a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 204 len: 0 microversion: 2.1 time: 0.367659 Mar 26 20:57:20.248529 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1165/2504] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:19 2022] DELETE /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:20.269939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3d69074f-e174-4983-a62c-0e489e5ab502 req-adf15661-366c-4c15-be7b-a2c29ebe1c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10263b9e-d54b-43f2-a45a-83603dc51b2c", "name": "network-vif-deleted", "tag": "4c536011-78ac-4759-af99-8fc9826030cd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:20.296293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d69074f-e174-4983-a62c-0e489e5ab502 req-adf15661-366c-4c15-be7b-a2c29ebe1c39 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:20.298841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d69074f-e174-4983-a62c-0e489e5ab502 req-adf15661-366c-4c15-be7b-a2c29ebe1c39 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:20.352321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3d69074f-e174-4983-a62c-0e489e5ab502 req-adf15661-366c-4c15-be7b-a2c29ebe1c39 service nova] Creating event network-vif-deleted:4c536011-78ac-4759-af99-8fc9826030cd for instance 10263b9e-d54b-43f2-a45a-83603dc51b2c on nch1-master-1 Mar 26 20:57:20.364634 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3d69074f-e174-4983-a62c-0e489e5ab502 req-adf15661-366c-4c15-be7b-a2c29ebe1c39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111705 Mar 26 20:57:20.367713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1166/2505] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:20.384316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:20.397208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:20.398422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Searching by: {'deleted': False, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:20.466291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:20.467782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:20.470480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:20.471274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:20.510633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7af2c2d7-ceb7-4f2b-8df4-df51c1bb80b1 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.137957 Mar 26 20:57:20.511736 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1167/2506] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:57:20 2022] GET /compute/v2.1/servers => generated 675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:20.521807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:20.523432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:20.533147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:20.534002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:20.535983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:20.537492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:21.375260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:21.406289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dfd0dda9-401d-4fc3-abe1-f9ddfd3e4028 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1518 microversion: 2.1 time: 0.893158 Mar 26 20:57:21.412452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1168/2507] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:20 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1518 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:21.442216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:21.452118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:21.494003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:21.494819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:21.498193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:21.499065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:21.708240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:21.723398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66521a9b-0171-4437-93a0-5c9c258df3ca tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1223 microversion: 2.1 time: 0.307944 Mar 26 20:57:21.728634 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1169/2508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:21 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1223 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:21.750292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:21.752693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:21.769144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:21.770154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:21.771513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:21.772466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:22.355243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:22.370455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe085bef-1082-4a6f-b0f6-b5bb4c144765 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.638081 Mar 26 20:57:22.372942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1170/2509] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:21 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:22.379730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f7f7bc47-1456-4537-8c7f-ac427e2b6d6a req-eec5706c-45a9-4f2e-a7f6-31be5852c5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b90cee9-9904-41f7-95a5-d6ed889e27ed", "name": "network-vif-plugged", "status": "completed", "tag": "aa18c074-3c50-4a11-9055-0c0910e8dd41"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:22.418151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7f7bc47-1456-4537-8c7f-ac427e2b6d6a req-eec5706c-45a9-4f2e-a7f6-31be5852c5aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:22.423791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7f7bc47-1456-4537-8c7f-ac427e2b6d6a req-eec5706c-45a9-4f2e-a7f6-31be5852c5aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:22.466972 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f7f7bc47-1456-4537-8c7f-ac427e2b6d6a req-eec5706c-45a9-4f2e-a7f6-31be5852c5aa service nova] Creating event network-vif-plugged:aa18c074-3c50-4a11-9055-0c0910e8dd41 for instance 5b90cee9-9904-41f7-95a5-d6ed889e27ed on nch1-master-1 Mar 26 20:57:22.487041 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f7f7bc47-1456-4537-8c7f-ac427e2b6d6a req-eec5706c-45a9-4f2e-a7f6-31be5852c5aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111188 Mar 26 20:57:22.491904 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1171/2510] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:22.504087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:22.516647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:22.540338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:22.540822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:22.545370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:22.545875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:23.715059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:23.724503 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-311af370-ac24-4dc1-8e7d-3b71550cc705 tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1518 microversion: 2.1 time: 1.228496 Mar 26 20:57:23.733353 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1172/2511] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:22 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1518 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:23.745311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:23.746838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:23.769158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:23.772576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:23.775003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:23.777639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:23.936275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:23.945076 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-252328c8-3696-480c-a29f-22ad8f29a5ef tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1277 microversion: 2.1 time: 0.210746 Mar 26 20:57:23.948749 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1173/2512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:23 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:23.958214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:23.959227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:23.973254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:23.975379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:23.978529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:23.980460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:24.288594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:24.300003 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-633ba390-463f-4a28-8d51-330f0854650d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1316 microversion: 2.1 time: 0.349790 Mar 26 20:57:24.301696 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1174/2513] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:23 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:24.842479 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8c6a49e-edaa-4a04-b3fa-5195e44657f6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.104343 Mar 26 20:57:24.846771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1340/2514] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:57:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:24.862886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ad0f814f-4a85-4e57-ab0e-1ace0c6f00bc req-b78462c1-cfd8-4e62-80a7-94eb2d0c79c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c3cd28-3614-4e17-83c3-c0c6a41b5992", "name": "network-vif-deleted", "tag": "e5c0bdb1-41fd-4c45-b5d0-737709a48337"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:24.893209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-376943723", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:24.902562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ad0f814f-4a85-4e57-ab0e-1ace0c6f00bc req-b78462c1-cfd8-4e62-80a7-94eb2d0c79c1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:24.903025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ad0f814f-4a85-4e57-ab0e-1ace0c6f00bc req-b78462c1-cfd8-4e62-80a7-94eb2d0c79c1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:24.926824 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ad0f814f-4a85-4e57-ab0e-1ace0c6f00bc req-b78462c1-cfd8-4e62-80a7-94eb2d0c79c1 service nova] Creating event network-vif-deleted:e5c0bdb1-41fd-4c45-b5d0-737709a48337 for instance 78c3cd28-3614-4e17-83c3-c0c6a41b5992 on nch1-master-1 Mar 26 20:57:24.934923 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ad0f814f-4a85-4e57-ab0e-1ace0c6f00bc req-b78462c1-cfd8-4e62-80a7-94eb2d0c79c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086266 Mar 26 20:57:24.936037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1341/2515] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:24.942497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-162b665f-b593-423f-b663-9fabecf7e646 req-3669010a-6771-49ae-ac86-7e7d35736ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-plugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:24.952521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-162b665f-b593-423f-b663-9fabecf7e646 req-3669010a-6771-49ae-ac86-7e7d35736ddd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:24.953285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-162b665f-b593-423f-b663-9fabecf7e646 req-3669010a-6771-49ae-ac86-7e7d35736ddd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:24.970372 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-162b665f-b593-423f-b663-9fabecf7e646 req-3669010a-6771-49ae-ac86-7e7d35736ddd service nova] Creating event network-vif-plugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:57:25.010215 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-162b665f-b593-423f-b663-9fabecf7e646 req-3669010a-6771-49ae-ac86-7e7d35736ddd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071889 Mar 26 20:57:25.013878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1342/2516] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:25.031312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:25.041422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:25.050679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:25.062028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.062779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.067568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.071795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.162435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.164554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.165917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lazy-loading 'fault' on Instance uuid 78c3cd28-3614-4e17-83c3-c0c6a41b5992 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:57:25.273571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c658c4a7b9c4d7886127c3e40f359f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6beb485658f40dc83598fd2e00800ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:25.293691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a162eb4-b4ee-4307-be7b-03ed4a31276a tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 200 len: 1311 microversion: 2.1 time: 0.271868 Mar 26 20:57:25.295731 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1343/2517] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:25 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:25.312238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.78"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:25.316288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:25.346330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.348195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.350465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.351897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.405959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Acquired lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:57:25.545888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:25.546894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:25.547851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:25.548874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:25.549563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:25.564220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.564688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.575836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.576457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.628437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Getting quotas for project c6702eaac3714fd6aaeafeb1dddfc749. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:25.635444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Getting quotas for user e0a55d0611954871ac316bcc4381d031 and project c6702eaac3714fd6aaeafeb1dddfc749. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:25.653159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:25.656468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:25.744024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d62ba8a-6898-418d-9d0a-7a8f57c14fd5 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291192 Mar 26 20:57:25.754829 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1175/2518] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:57:25.779353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:25.783741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:25.814147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.816196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:25.817962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:25.820465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:26.404517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:26.422184 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3f313c9-69d5-4841-be43-3089b9dd4414 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.665328 Mar 26 20:57:26.426276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1176/2519] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:25 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:26.439461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:26.441335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:26.454413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:26.455054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:26.456403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:26.457302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:26.788424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.78 (cf232bac-ae80-4a7b-ad80-acfc1fb1b6f6) with port 99c505bb-f97f-4e98-9619-8702a96345b6 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 339cc6ca-e602-48a0-984b-bc0e7f2b3b82.", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:57:26.790264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Releasing lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:57:26.791611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.78 (cf232bac-ae80-4a7b-ad80-acfc1fb1b6f6) with port 99c505bb-f97f-4e98-9619-8702a96345b6 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 339cc6ca-e602-48a0-984b-bc0e7f2b3b82. Mar 26 20:57:26.791611 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-d851626a-f861-4d2e-bcf9-8116ec941aec'] Mar 26 20:57:26.792561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Returning 400 to user: Cannot associate floating IP 172.35.4.78 (cf232bac-ae80-4a7b-ad80-acfc1fb1b6f6) with port 99c505bb-f97f-4e98-9619-8702a96345b6 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 339cc6ca-e602-48a0-984b-bc0e7f2b3b82. Mar 26 20:57:26.792561 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-d851626a-f861-4d2e-bcf9-8116ec941aec'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:26.793681 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e02cbbe5-9cd6-43a5-9160-d47c35b74a7c tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 400 len: 381 microversion: 2.1 time: 1.496513 Mar 26 20:57:26.794773 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1344/2520] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:25 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 381 bytes in 1498 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:57:27.007301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1300786536", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:27.097454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:27.112412 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87059928-f554-44f9-ba58-9f7a76de23e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1465 microversion: 2.1 time: 0.682244 Mar 26 20:57:27.113598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1177/2521] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:26 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1465 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:27.118544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:27.120003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:27.128096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.128781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.130014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.130632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.130910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:27.131342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:27.131819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:27.132351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:27.132792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:27.143766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.144343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.145163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.145749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.187292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Getting quotas for project 4711951c1994477aabaf5a8a585fe537. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:27.207910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Getting quotas for user 0e8a51bcbc574c758595a30ba9e885df and project 4711951c1994477aabaf5a8a585fe537. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:27.234622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:27.242894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:27.258388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:27.274820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-590024ac-0cf5-42fc-a0e6-472bd536a553 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1267 microversion: 2.1 time: 0.159856 Mar 26 20:57:27.275856 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1178/2522] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:27 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:27.284075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:27.285137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] [instance: 78c3cd28-3614-4e17-83c3-c0c6a41b5992] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:27.299293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.300027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.300928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.302845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.335436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] HTTP exception thrown: Instance 78c3cd28-3614-4e17-83c3-c0c6a41b5992 could not be found. Mar 26 20:57:27.336523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] Returning 404 to user: Instance 78c3cd28-3614-4e17-83c3-c0c6a41b5992 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:27.339326 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1c9b517-fedd-43ce-8319-87d9aaec668e tempest-ListServerFiltersTestJSON-384822768 tempest-ListServerFiltersTestJSON-384822768-project] 10.222.0.16 "GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992" status: 404 len: 111 microversion: 2.1 time: 0.062093 Mar 26 20:57:27.340032 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1179/2523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:27 2022] GET /compute/v2.1/servers/78c3cd28-3614-4e17-83c3-c0c6a41b5992 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:27.354170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7321a30a-eaaa-4455-a8a9-062726ef8071 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '.version_select at 0x7f6e596a0940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:27.380150 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb9e7e28-4b84-4c5b-a29c-98d00f993c37 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.584053 Mar 26 20:57:27.384677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1345/2524] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 20:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 20:57:27.404373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:27.408346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:27.432041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.435843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.439621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:27.443689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:27.973987 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e57c3d78-c5be-419e-a19e-eff1f19e4a14 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1616 microversion: 2.1 time: 0.584858 Mar 26 20:57:27.974649 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1346/2525] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:27 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1616 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:27.999906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2b9fa2cf-23f2-47c8-b4e0-b6eda64932b3 req-aca06360-02af-4ad2-8e5e-5e6a71332654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8368aa61-964c-40fc-b08f-5369b1915410", "tag": "09a2b045-fb00-44cf-929e-188526c6e172"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:28.030142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2b9fa2cf-23f2-47c8-b4e0-b6eda64932b3 req-aca06360-02af-4ad2-8e5e-5e6a71332654 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:28.030680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2b9fa2cf-23f2-47c8-b4e0-b6eda64932b3 req-aca06360-02af-4ad2-8e5e-5e6a71332654 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:28.043004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2b9fa2cf-23f2-47c8-b4e0-b6eda64932b3 req-aca06360-02af-4ad2-8e5e-5e6a71332654 service nova] Creating event network-changed:09a2b045-fb00-44cf-929e-188526c6e172 for instance 8368aa61-964c-40fc-b08f-5369b1915410 on nch1-master-1 Mar 26 20:57:28.068971 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2b9fa2cf-23f2-47c8-b4e0-b6eda64932b3 req-aca06360-02af-4ad2-8e5e-5e6a71332654 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072927 Mar 26 20:57:28.069936 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1347/2526] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:28.079619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:28.080675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:28.093824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:28.094334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:28.095121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:28.095648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:28.289725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:28.299651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:28.302018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:28.303481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4afafa76-d9cf-45eb-8998-a4635eb96141 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1282 microversion: 2.57 time: 0.231614 Mar 26 20:57:28.304907 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1348/2527] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:28 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:28.314358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:28.315204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:28.323852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:28.324594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:28.325633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:28.326252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:28.741991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:28.750273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-485fc38e-50d9-48e5-a68d-cca6d3d5e10c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.443964 Mar 26 20:57:28.754699 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1349/2528] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:28 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:28.764150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1844567454", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c51099b7-6a2d-4a66-8a36-3b9b6c08e32e"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:28.875241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:29.479118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:29.480295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:29.480982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:29.481587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:29.482177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:29.499852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:29.500358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:29.501177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:29.505664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:29.548995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:29.557361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:29.605209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:29.610763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:29.721053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1340905b-8a27-48ce-a16f-d523e989bd55 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964780 Mar 26 20:57:29.724667 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1350/2529] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:57:29.732260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:29.732866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:29.759083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:29.759884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:29.761065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:29.761681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.018841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.033299 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-040538f7-ce91-4e57-a7eb-5ab9051598a3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1273 microversion: 2.1 time: 0.307315 Mar 26 20:57:30.043046 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1351/2530] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:29 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:30.048136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:30.056908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:30.084040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:30.084440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.085263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:30.085745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.259613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.273787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.280374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.281799 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d22ac149-a211-40a0-afd0-7dedb0f23135 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1336 microversion: 2.57 time: 0.237467 Mar 26 20:57:30.284619 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1352/2531] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:30 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1336 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:30.293208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fb7550ba-a5d0-44b3-bfcc-2beaad17e8d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:30.293811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fb7550ba-a5d0-44b3-bfcc-2beaad17e8d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:30.512121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb7550ba-a5d0-44b3-bfcc-2beaad17e8d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.521315 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fb7550ba-a5d0-44b3-bfcc-2beaad17e8d3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1217 microversion: 2.1 time: 0.235336 Mar 26 20:57:30.524979 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1353/2532] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:30 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:30.535219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:30.548929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:30.568219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:30.570165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.576252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:30.576950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.618208 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7321a30a-eaaa-4455-a8a9-062726ef8071 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cf232bac-ae80-4a7b-ad80-acfc1fb1b6f6" status: 202 len: 0 microversion: 2.1 time: 3.277055 Mar 26 20:57:30.618789 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1180/2533] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:57:27 2022] DELETE /compute/v2.1/os-floating-ips/cf232bac-ae80-4a7b-ad80-acfc1fb1b6f6 => generated 0 bytes in 3278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:57:30.625806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b6c96e7f-871d-436c-a59c-71a8afd443ac req-82412c0e-1047-4308-af9f-3541b6967551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3799bb6e-a5b9-4157-a684-91e478a7ca1a", "tag": "3a191c4e-56a3-4de4-aeb0-a8c4b060945d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:30.645106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b6c96e7f-871d-436c-a59c-71a8afd443ac req-82412c0e-1047-4308-af9f-3541b6967551 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:30.645563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b6c96e7f-871d-436c-a59c-71a8afd443ac req-82412c0e-1047-4308-af9f-3541b6967551 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:30.680054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b6c96e7f-871d-436c-a59c-71a8afd443ac req-82412c0e-1047-4308-af9f-3541b6967551 service nova] Creating event network-changed:3a191c4e-56a3-4de4-aeb0-a8c4b060945d for instance 3799bb6e-a5b9-4157-a684-91e478a7ca1a on nch2-master-1 Mar 26 20:57:30.689531 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b6c96e7f-871d-436c-a59c-71a8afd443ac req-82412c0e-1047-4308-af9f-3541b6967551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069543 Mar 26 20:57:30.694078 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1181/2534] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:30.704080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.237"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:30.902153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:30.912541 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8943873-0ba3-4a00-aecf-85823b8e66b7 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.386197 Mar 26 20:57:30.925408 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1354/2535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:30 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:31.051084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:31.051714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:31.060682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.061424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.064089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.065955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.207175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:31.228970 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5566ee1-91eb-4eff-873c-f8cc871208ce tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1273 microversion: 2.1 time: 0.182122 Mar 26 20:57:31.229574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1355/2536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:31 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:31.303978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:31.304712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:31.312021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.312480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.313271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.313718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.366705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:31.381803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.390025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.406177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.408844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.576183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:31.585194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:31.589269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:31.602302 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b957362c-3369-4ecb-9bf1-dab4ddf2cd4b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1336 microversion: 2.57 time: 0.302825 Mar 26 20:57:31.613074 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1356/2537] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:31 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1336 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:31.613074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:31.613074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:31.629878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.630487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.631423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.632011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.876935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:31.889517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a43a372b-d324-4de9-996b-c2fdb6b51514 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1287 microversion: 2.1 time: 0.285047 Mar 26 20:57:31.890119 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1357/2538] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:31 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1287 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:31.933987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:31.944832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:31.951555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.952118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:31.953186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:31.955134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:32.229038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Acquired lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:57:32.463667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:32.472254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c21c03d-31d9-47cc-8f91-f34fd6174a02 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.543067 Mar 26 20:57:32.482045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1358/2539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:31 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:32.487810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:32.488779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:32.496008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:32.496841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:32.497928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:32.499627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:32.967283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:32.979448 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-244534a2-9ba7-47f3-b56f-c19c82917705 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.495911 Mar 26 20:57:32.980503 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1359/2540] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:32 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:32.990955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:32.994611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:33.006211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.006211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.025164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.025870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.240010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:33.256075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:33.260960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:33.263007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9786d25-27e3-4c6a-bfc1-85e65d0f84e9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1357 microversion: 2.57 time: 0.280182 Mar 26 20:57:33.265624 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1360/2541] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:32 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:33.286426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:33.287595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:33.298647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.299350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.300391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.306698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.458030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:33.467949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bdc7b7dc-889d-49fc-bbb5-de866335022c tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1275 microversion: 2.1 time: 0.200534 Mar 26 20:57:33.477031 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1361/2542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:33 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:33.489476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:33.494750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:33.506857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.507970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.508827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.509465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.638913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:33.641164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:33.643681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:33.645360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:33.646127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:33.781358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:33.789777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.790607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.791682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.792520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.827981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-481ff6fe-073c-479e-b9e9-986e81e1592e tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "POST /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca/action" status: 202 len: 1138 microversion: 2.57 time: 0.347332 Mar 26 20:57:33.829794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1362/2543] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Mar 26 20:57:33 2022] POST /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca/action => generated 1138 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 26 20:57:33.844935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:33.845670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:33.860395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.860932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:33.861999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:33.862710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:34.457106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:34.466324 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f51585c7-e3cf-4fa3-bcd8-96011e23b497 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.635189 Mar 26 20:57:34.478906 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1363/2544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:33 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:34.489644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0bacccb6-2d84-4582-a214-7cf2bd2c6a9d req-f57db188-7c01-4eb1-9732-bf5cd4872978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8368aa61-964c-40fc-b08f-5369b1915410", "name": "network-vif-plugged", "status": "completed", "tag": "09a2b045-fb00-44cf-929e-188526c6e172"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:34.510853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0bacccb6-2d84-4582-a214-7cf2bd2c6a9d req-f57db188-7c01-4eb1-9732-bf5cd4872978 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:34.511395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0bacccb6-2d84-4582-a214-7cf2bd2c6a9d req-f57db188-7c01-4eb1-9732-bf5cd4872978 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:34.536653 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0bacccb6-2d84-4582-a214-7cf2bd2c6a9d req-f57db188-7c01-4eb1-9732-bf5cd4872978 service nova] Creating event network-vif-plugged:09a2b045-fb00-44cf-929e-188526c6e172 for instance 8368aa61-964c-40fc-b08f-5369b1915410 on nch1-master-1 Mar 26 20:57:34.551019 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0bacccb6-2d84-4582-a214-7cf2bd2c6a9d req-f57db188-7c01-4eb1-9732-bf5cd4872978 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070467 Mar 26 20:57:34.552148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1364/2545] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:34.559979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:34.581358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:34.593829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:34.594278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:34.599598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:34.599766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:34.731418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:34.742959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:34.753470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:34.754902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-763362eb-df5e-45f0-bd33-d6b070a73ffd tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.199630 Mar 26 20:57:34.755815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1365/2546] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:34 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:34.773703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:34.774651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:34.784042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:34.786916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:34.787844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:34.788328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:35.206480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:35.214257 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e11697e-6617-4cd8-9d45-af478e7e89e1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.456924 Mar 26 20:57:35.214846 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1366/2547] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:34 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:35.231293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:35.242149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:35.253280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:35.254332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:35.255334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:35.256064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:35.910730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:35.924770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ed36440c-b1ac-4c17-9a74-f71282398d27 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.703619 Mar 26 20:57:35.928804 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1367/2548] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:35 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:35.942449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:35.943329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:35.956119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:35.961855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:35.962936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:35.963651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:36.429263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:36.445313 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a853a51-cdd3-4ea0-95f7-4e1de343f4d9 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.513698 Mar 26 20:57:36.449311 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1368/2549] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:35 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:36.471258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:36.472191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:36.496080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:36.496440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:36.497221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:36.497660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:36.640196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:36.657581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:36.661621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:36.665323 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9fa850cb-b0c5-49fb-8f07-4fa5b3190a81 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.214763 Mar 26 20:57:36.666436 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1369/2550] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:36 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:36.680414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:36.681285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:36.694533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:36.695794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:36.696853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:36.699801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.141933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Building network info cache for instance {{(pid=141580) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 20:57:37.145230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:37.160292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-694100af-537b-4ed6-b8f7-d7e87c74c2c4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.491493 Mar 26 20:57:37.170233 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1370/2551] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:36 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:37.189187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:37.194144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:37.225270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.225898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.226898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.227535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.746421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:37.761252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ad5d5e8-16ea-41e0-9fed-1cfeb4185015 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.582878 Mar 26 20:57:37.774971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1371/2552] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:37 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:37.785972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ebc702d6-e251-4053-8073-6f15799b9c1c req-18f062b5-2b4a-44ef-8d9d-50cd7da45c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2bfcb66-1cd1-45a8-bae4-b25cf4240d78", "tag": "13e6f963-1ad1-433a-9c38-29a63ba6f2c3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:37.818072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ebc702d6-e251-4053-8073-6f15799b9c1c req-18f062b5-2b4a-44ef-8d9d-50cd7da45c6e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.818773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ebc702d6-e251-4053-8073-6f15799b9c1c req-18f062b5-2b4a-44ef-8d9d-50cd7da45c6e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.838725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ebc702d6-e251-4053-8073-6f15799b9c1c req-18f062b5-2b4a-44ef-8d9d-50cd7da45c6e service nova] Creating event network-changed:13e6f963-1ad1-433a-9c38-29a63ba6f2c3 for instance e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 on nch1-master-1 Mar 26 20:57:37.860356 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ebc702d6-e251-4053-8073-6f15799b9c1c req-18f062b5-2b4a-44ef-8d9d-50cd7da45c6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083422 Mar 26 20:57:37.861658 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1372/2553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:37.873724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-abf0e4dc-f72e-48ce-86d1-25d4762d9c8f req-3ffac497-b35d-4e4c-9712-764b0343ef51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff07ab6-31a1-447f-99dc-e6f97b468d08", "tag": "99c505bb-f97f-4e98-9619-8702a96345b6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:37.890829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-abf0e4dc-f72e-48ce-86d1-25d4762d9c8f req-3ffac497-b35d-4e4c-9712-764b0343ef51 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.900452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-abf0e4dc-f72e-48ce-86d1-25d4762d9c8f req-3ffac497-b35d-4e4c-9712-764b0343ef51 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.918517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-abf0e4dc-f72e-48ce-86d1-25d4762d9c8f req-3ffac497-b35d-4e4c-9712-764b0343ef51 service nova] Creating event network-changed:99c505bb-f97f-4e98-9619-8702a96345b6 for instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 on nch2-master-1 Mar 26 20:57:37.926210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-abf0e4dc-f72e-48ce-86d1-25d4762d9c8f req-3ffac497-b35d-4e4c-9712-764b0343ef51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061838 Mar 26 20:57:37.927603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1373/2554] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:37.937558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:37.947750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:37.964096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.964895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:37.966060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:37.966697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:38.710815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:38.730908 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c03d1e7-d42a-4116-a8eb-1b5322a3f924 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.799503 Mar 26 20:57:38.733634 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1374/2555] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:37 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:38.755222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:38.755844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:38.778934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:38.791065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:38.793234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:38.794601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:39.368017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:39.378758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:39.380765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:39.384399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-755fec71-4ba4-4702-b07c-b56f0213269c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.645578 Mar 26 20:57:39.396896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1375/2556] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:38 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:39.402460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:39.403329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:39.410056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:39.410909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:39.412078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:39.412745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:39.599035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Updating instance_info_cache with network_info: [{"id": "99c505bb-f97f-4e98-9619-8702a96345b6", "address": "fa:16:3e:3d:e5:7d", "network": {"id": "1d0343d0-ee1e-46f6-ac18-c82566fa23cb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1411116242-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7150c612879247208855ce511f95a5a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99c505bb-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 20:57:39.620396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Releasing lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:57:39.621642 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7fcaff66-d02f-452c-8ffd-a715863ed020 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 202 len: 0 microversion: 2.1 time: 8.925104 Mar 26 20:57:39.627637 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1182/2557] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:30 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 0 bytes in 8933 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 20:57:39.632768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:39.637962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:39.654791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:39.655440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:39.656896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:39.657529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:39.886276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:39.895957 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed3dcd1c-956e-4660-ac4c-e6200faf73e3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.266887 Mar 26 20:57:39.909357 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1183/2558] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:39 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:39.917556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3963277f-3a7f-45d0-8c79-14e4c176f8d6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '.version_select at 0x7f6e5ed2c670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:40.261568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:40.268968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53f5ef7c-0bd9-482a-8784-5f77c4b8073e tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.870660 Mar 26 20:57:40.271831 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1376/2559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:39 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:40.280067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:40.280589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:40.295821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.296298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.307473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.307957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.810988 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3963277f-3a7f-45d0-8c79-14e4c176f8d6 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5c0a8f27-84a5-4e60-ad57-369cc365eeda" status: 202 len: 0 microversion: 2.1 time: 0.900022 Mar 26 20:57:40.811978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1184/2560] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:57:39 2022] DELETE /compute/v2.1/os-floating-ips/5c0a8f27-84a5-4e60-ad57-369cc365eeda => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:57:40.816937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:40.823489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b4675928-2544-4f2f-a762-23e491dfe8e3 req-03cbba5c-0658-42f1-8bf4-554ffaedb6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3799bb6e-a5b9-4157-a684-91e478a7ca1a", "name": "network-vif-plugged", "status": "completed", "tag": "3a191c4e-56a3-4de4-aeb0-a8c4b060945d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:40.826786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a499ec1c-5eac-47ec-a02e-330f043af2eb tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.553855 Mar 26 20:57:40.827701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1377/2561] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:40 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:40.832997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-33178dd4-65f5-41da-a43e-3daee744bb58 req-0081f5cc-0454-4997-9dd5-9d364fecb3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed6c119-e132-488c-964a-c28e1411b0b4", "tag": "b15eee45-c08c-4bb6-a728-2b42726ae7b4"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:40.840661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b4675928-2544-4f2f-a762-23e491dfe8e3 req-03cbba5c-0658-42f1-8bf4-554ffaedb6f7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.841197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b4675928-2544-4f2f-a762-23e491dfe8e3 req-03cbba5c-0658-42f1-8bf4-554ffaedb6f7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.842482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33178dd4-65f5-41da-a43e-3daee744bb58 req-0081f5cc-0454-4997-9dd5-9d364fecb3c7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.842931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33178dd4-65f5-41da-a43e-3daee744bb58 req-0081f5cc-0454-4997-9dd5-9d364fecb3c7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.854835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b4675928-2544-4f2f-a762-23e491dfe8e3 req-03cbba5c-0658-42f1-8bf4-554ffaedb6f7 service nova] Creating event network-vif-plugged:3a191c4e-56a3-4de4-aeb0-a8c4b060945d for instance 3799bb6e-a5b9-4157-a684-91e478a7ca1a on nch2-master-1 Mar 26 20:57:40.855529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-33178dd4-65f5-41da-a43e-3daee744bb58 req-0081f5cc-0454-4997-9dd5-9d364fecb3c7 service nova] Creating event network-changed:b15eee45-c08c-4bb6-a728-2b42726ae7b4 for instance eed6c119-e132-488c-964a-c28e1411b0b4 on nch1-master-1 Mar 26 20:57:40.860348 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-33178dd4-65f5-41da-a43e-3daee744bb58 req-0081f5cc-0454-4997-9dd5-9d364fecb3c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Mar 26 20:57:40.861146 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1378/2562] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:40.861292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b4675928-2544-4f2f-a762-23e491dfe8e3 req-03cbba5c-0658-42f1-8bf4-554ffaedb6f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048105 Mar 26 20:57:40.861947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1185/2563] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:40.867908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:40.868808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:40.872891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ca0b565-89f2-4c69-a670-bc6904aa97a0 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:40.874680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ca0b565-89f2-4c69-a670-bc6904aa97a0 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:40.875628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.875859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ca0b565-89f2-4c69-a670-bc6904aa97a0 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 400 len: 142 microversion: 2.1 time: 0.012473 Mar 26 20:57:40.876241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.877023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.877164 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1186/2564] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:40 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 142 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:57:40.877796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.889976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:40.891390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:40.900255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.901042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.903209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:40.903665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:40.942717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Acquired lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 20:57:41.084741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:41.092804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:41.094309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:41.095472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c614a5b-0b34-46b7-8c05-ee8f68f8447b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.232629 Mar 26 20:57:41.104160 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1379/2565] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:40 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:41.119830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:41.120465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:41.141884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.142346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.143268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.143711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.214357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Releasing lock "refresh_cache-4ff07ab6-31a1-447f-99dc-e6f97b468d08" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 20:57:41.215195 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] HTTP exception thrown: floating IP not found Mar 26 20:57:41.216063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Returning 404 to user: floating IP not found {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:41.217272 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41645754-dbbc-40a6-a9b0-b05007ad4967 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 404 len: 67 microversion: 2.1 time: 0.332417 Mar 26 20:57:41.218449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1187/2566] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:40 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 67 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:57:41.226875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:41.227787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:41.239813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.240642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.242316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.244346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.498403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:41.506377 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5786c18-830b-4ea4-a1d5-818ee53dcb3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.286219 Mar 26 20:57:41.517991 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1188/2567] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:41 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:41.523812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ace6d6f5-e6a1-4d7b-af08-da5bd72dca7f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:41.536883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:41.545869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96630c12-7ab3-4942-badf-558ef4ad0102 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.430405 Mar 26 20:57:41.546459 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1380/2568] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:41 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:41.555303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:41.556323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:41.562843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.563388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.564267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.564781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.590300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ace6d6f5-e6a1-4d7b-af08-da5bd72dca7f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Mar 26 20:57:41.590880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ace6d6f5-e6a1-4d7b-af08-da5bd72dca7f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:41.591909 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ace6d6f5-e6a1-4d7b-af08-da5bd72dca7f tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action" status: 404 len: 88 microversion: 2.1 time: 0.072571 Mar 26 20:57:41.596544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1189/2569] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:41 2022] POST /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08/action => generated 88 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:57:41.597454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-363256612"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:41.598640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:41.606453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.606981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.607844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.608405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.917215 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-330f8663-714e-45be-8f85-10517d02a5fc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.323271 Mar 26 20:57:41.918749 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1190/2570] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:57:41 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 26 20:57:41.926788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:41.927513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:41.940965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.942061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.942926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:41.943385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:41.976088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:42.090372 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae027963-5b64-420b-8a4c-c5a46e44e6dd tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 204 len: 0 microversion: 2.1 time: 0.169450 Mar 26 20:57:42.091404 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1191/2571] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:41 2022] DELETE /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:42.103064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:42.104587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:42.111467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.112403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.113211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.113670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.272255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.282971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00c69023-8b0a-4ec5-bddf-60aa0060c939 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1319 microversion: 2.1 time: 0.185215 Mar 26 20:57:42.283568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1192/2572] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:42 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:42.296762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:42.297790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:42.308610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.309546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.310533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.311826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.313043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.321347 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-996785a5-e162-47fc-8b3c-2d28c022bf2c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.773650 Mar 26 20:57:42.324096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1381/2573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:41 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:42.337032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:42.337754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:42.345033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.365564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.368631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.369345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.550558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.560279 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-922bd1bf-a083-4751-978e-a021d0c59e49 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.270057 Mar 26 20:57:42.561235 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1193/2574] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:42 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:42.574886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:42.576682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:42.584506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.585059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.586840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.587375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.705211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.714479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.716907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.717631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f452cac-5030-4086-8d94-0ba012ff19c7 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.152581 Mar 26 20:57:42.718778 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1194/2575] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:42 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:42.726316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:42.727419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:42.734431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.735010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.735948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:42.736520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:42.898485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.909990 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-253cc049-f361-425b-9a94-fabd626071d2 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1541 microversion: 2.1 time: 0.584430 Mar 26 20:57:42.910986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1382/2576] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:42 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1541 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:42.912134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:42.924481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1041412d-071f-4b34-8e6b-eded9f3bd732 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.204834 Mar 26 20:57:42.936717 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1195/2577] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:42 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:43.300608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:43.301249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:43.308168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.308631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.309452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.309877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.339783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:43.340442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:43.358840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.359310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.360172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.360627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.693705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:43.702871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5208791e-fbf4-4c07-b0db-b17bdcec2558 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 200 len: 1506 microversion: 2.1 time: 0.406677 Mar 26 20:57:43.705602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1383/2578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:43 2022] GET /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:43.716752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:43.717816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:43.732811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.733398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.740804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.742023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.926477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:43.941471 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d6a9194-4335-4126-8a93-5c4196cb5fef tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 0.602925 Mar 26 20:57:43.942387 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1196/2579] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:43 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:43.953972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:43.954597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 8368aa61-964c-40fc-b08f-5369b1915410] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:43.961023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.961479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:43.964062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:43.964729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.086567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.096197 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c314434-df48-406c-91aa-e0604619208a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1688 microversion: 2.1 time: 0.388434 Mar 26 20:57:44.108676 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1384/2580] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:43 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1688 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:44.114516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.116269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.124043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.124890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.126047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.126714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.246048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.264098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.266519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.268161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dba5a4f5-a5b5-445a-8930-f5b48e5fb023 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.157747 Mar 26 20:57:44.270473 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1385/2581] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:44 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:44.279201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e527a126-0694-4072-852f-ef1642ed4a1f req-d48ead65-0bfd-49c5-83e8-5668031ce49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-unplugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:44.296922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e527a126-0694-4072-852f-ef1642ed4a1f req-d48ead65-0bfd-49c5-83e8-5668031ce49d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.297835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e527a126-0694-4072-852f-ef1642ed4a1f req-d48ead65-0bfd-49c5-83e8-5668031ce49d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.325758 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e527a126-0694-4072-852f-ef1642ed4a1f req-d48ead65-0bfd-49c5-83e8-5668031ce49d service nova] Creating event network-vif-unplugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:57:44.333020 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e527a126-0694-4072-852f-ef1642ed4a1f req-d48ead65-0bfd-49c5-83e8-5668031ce49d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060886 Mar 26 20:57:44.334140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1386/2582] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:44.342420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.343538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.350821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.351410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.352615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.353265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.481060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.493358 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c23fe13b-dcb2-4ed9-9df4-1cb7024b0fb8 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/8368aa61-964c-40fc-b08f-5369b1915410" status: 200 len: 1506 microversion: 2.1 time: 0.548757 Mar 26 20:57:44.494306 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1197/2583] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:43 2022] GET /compute/v2.1/servers/8368aa61-964c-40fc-b08f-5369b1915410 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:44.512224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.513135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.520583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.521272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.522250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.523487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.631680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a3991559f4738b240874a96dd5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7150c612879247208855ce511f95a5a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.642381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-324f7b70-7530-424c-a00b-7c489304b759 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 200 len: 1541 microversion: 2.1 time: 0.306613 Mar 26 20:57:44.648347 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1387/2584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:44 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 1541 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:44.653194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.660710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 8368aa61-964c-40fc-b08f-5369b1915410] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.676407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.680652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.681759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.682393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.737518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 8368aa61-964c-40fc-b08f-5369b1915410] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:44.904472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a2e35c1-8359-4b84-b082-47d6f8314317 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8368aa61-964c-40fc-b08f-5369b1915410" status: 204 len: 0 microversion: 2.1 time: 0.254653 Mar 26 20:57:44.908912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1388/2585] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:44 2022] DELETE /compute/v2.1/servers/8368aa61-964c-40fc-b08f-5369b1915410 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:44.914987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.915617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.922595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:44.926290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.930971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.932111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.932653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.936983 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e082f604-b59f-40c1-a9a2-49926453faa9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.430051 Mar 26 20:57:44.950894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1198/2586] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:44 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:44.962583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:44.963147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:44.977896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.978241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:44.979264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:44.981842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 3799bb6e-a5b9-4157-a684-91e478a7ca1a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:57:44.982535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.133542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8b97b65-f011-478d-bf8e-1c8cb8106251 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a" status: 204 len: 0 microversion: 2.1 time: 0.223367 Mar 26 20:57:45.135051 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1389/2587] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:57:44 2022] DELETE /compute/v2.1/servers/3799bb6e-a5b9-4157-a684-91e478a7ca1a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:57:45.142185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:45.143159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:45.167653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:45.168137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.169319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:45.169931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.687934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:45.699534 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b6c89f8f-1c19-4505-b19f-2055fddbd3a6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1688 microversion: 2.1 time: 0.562631 Mar 26 20:57:45.702932 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1390/2588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:45 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1688 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:45.717732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5e1dae6f-aebb-4c07-a528-f911600b3c44 req-0c73ca42-d21b-40ab-b0fa-9b4f6245150a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff07ab6-31a1-447f-99dc-e6f97b468d08", "name": "network-vif-deleted", "tag": "99c505bb-f97f-4e98-9619-8702a96345b6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:45.731015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5e1dae6f-aebb-4c07-a528-f911600b3c44 req-0c73ca42-d21b-40ab-b0fa-9b4f6245150a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:45.731480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5e1dae6f-aebb-4c07-a528-f911600b3c44 req-0c73ca42-d21b-40ab-b0fa-9b4f6245150a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.755529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5e1dae6f-aebb-4c07-a528-f911600b3c44 req-0c73ca42-d21b-40ab-b0fa-9b4f6245150a service nova] Creating event network-vif-deleted:99c505bb-f97f-4e98-9619-8702a96345b6 for instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 on nch2-master-1 Mar 26 20:57:45.785769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5e1dae6f-aebb-4c07-a528-f911600b3c44 req-0c73ca42-d21b-40ab-b0fa-9b4f6245150a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081030 Mar 26 20:57:45.788466 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1391/2589] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:45.803515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:45.804857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:45.821135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:45.821608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.822413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:45.822856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:45.973201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:45.981478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:45.988132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:45.989631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:45.990420 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40011f25-4216-4a04-9659-044c035949c1 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 1.035394 Mar 26 20:57:45.991983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-589c1500-885c-44b3-b359-95e7a6b2e0cc tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.200974 Mar 26 20:57:45.993052 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1392/2590] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:45 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:45.996638 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1199/2591] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:44 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:46.019481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1223173932", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e576dcd8-f5e7-40ea-bc9e-ff386ea0e139"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:46.027550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:46.027745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] [instance: 4ff07ab6-31a1-447f-99dc-e6f97b468d08] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:46.038454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.039127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:46.040367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.040979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:46.065557 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] HTTP exception thrown: Instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 could not be found. Mar 26 20:57:46.066520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] Returning 404 to user: Instance 4ff07ab6-31a1-447f-99dc-e6f97b468d08 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:57:46.069146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2479c741-fe83-4afb-896f-0ed613a98984 tempest-FloatingIPsAssociationNegativeTestJSON-133599405 tempest-FloatingIPsAssociationNegativeTestJSON-133599405-project] 10.222.0.16 "GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08" status: 404 len: 111 microversion: 2.1 time: 0.069004 Mar 26 20:57:46.070991 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1200/2592] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:45 2022] GET /compute/v2.1/servers/4ff07ab6-31a1-447f-99dc-e6f97b468d08 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:46.078966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:46.080060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:46.092925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.095808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:46.100607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.101128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:46.133772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] validate_networks() for [('e576dcd8-f5e7-40ea-bc9e-ff386ea0e139', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:46.689272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:46.697623 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0b22ced5-8de3-43b9-8e8f-991cfebf19f0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 0.625327 Mar 26 20:57:46.703046 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1201/2593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:46 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:46.718883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:46.719796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:46.732988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.733750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:46.734719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:46.740813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.166543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:47.180458 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9880e796-02db-4a54-b0a3-ed0750120147 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.465090 Mar 26 20:57:47.183269 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1202/2594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:46 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:57:47.195682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:47.201564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:47.217285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.221818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.223472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.230654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.461688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:47.473116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:47.487541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:47.489123 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2c0d4f1-1959-43f9-8277-f08035e41f0c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.302509 Mar 26 20:57:47.489856 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1203/2595] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:47 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:47.495032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:47.495860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:47.512896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.513680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.515188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.515803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.599247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:47.600366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:47.601066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:47.601658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:47.602242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:47.626728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.627456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.628511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.629196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.663051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Getting quotas for project c7b56cae79f846b5b6f3700480cfc811. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:47.684014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Getting quotas for user 75cdd0c73bcc473081b65958a7b1fbe6 and project c7b56cae79f846b5b6f3700480cfc811. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:47.715843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Going to run 2 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:47.718596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:47.798926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=4098ba7e-07e3-468c-997a-7960ed44729c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:47.911087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-154c3813-e0a6-440d-a41c-6fb21d478453 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.915886 Mar 26 20:57:47.924214 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1393/2596] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1930 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 26 20:57:47.930856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:47.931951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:47.946803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.947710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:47.949112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:47.951785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:48.956604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:48.969572 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-37f4bd5c-1572-4aa2-8a56-336706f1bd5f tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 1.477202 Mar 26 20:57:48.971714 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1204/2597] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:47 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:49.000351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:49.014850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:49.018895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Searching by: {'deleted': False, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 20:57:49.075560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.075908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.077170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.077672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.146377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 20:57:49.243477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-742b7171-2218-4fab-9c6c-77ddff873b11 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.269954 Mar 26 20:57:49.247714 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1205/2598] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 20:57:48 2022] GET /compute/v2.1/servers => generated 1335 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:49.259317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:49.260019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:49.277337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.278409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.281975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.282979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.662873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:49.670631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52042e55-1bf7-4fe0-86c0-dabbbc9d425e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 1.745091 Mar 26 20:57:49.677041 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1394/2599] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:47 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:49.704280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:49.704910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:49.737477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.737931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.738719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:49.739157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:49.965855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:49.979804 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4843652-db9b-4ba7-a6de-ddc4483a4f07 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.730871 Mar 26 20:57:49.982867 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1206/2600] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:49 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:49.991952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-18cd9cbc-3204-473d-b2b9-bd119c358ab5 req-79924e26-e268-4fac-b489-0534c7f0f468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3799bb6e-a5b9-4157-a684-91e478a7ca1a", "name": "network-vif-deleted", "tag": "3a191c4e-56a3-4de4-aeb0-a8c4b060945d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:50.002727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:50.021257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:50.023350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:50.032886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-18cd9cbc-3204-473d-b2b9-bd119c358ab5 req-79924e26-e268-4fac-b489-0534c7f0f468 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.033614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-18cd9cbc-3204-473d-b2b9-bd119c358ab5 req-79924e26-e268-4fac-b489-0534c7f0f468 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:50.036520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa1a1bb9-b4e1-4965-a987-95aef8b6bacb tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.352715 Mar 26 20:57:50.047954 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1395/2601] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:49 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:50.058878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:50.063604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:50.065782 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-18cd9cbc-3204-473d-b2b9-bd119c358ab5 req-79924e26-e268-4fac-b489-0534c7f0f468 service nova] Creating event network-vif-deleted:3a191c4e-56a3-4de4-aeb0-a8c4b060945d for instance 3799bb6e-a5b9-4157-a684-91e478a7ca1a on nch2-master-1 Mar 26 20:57:50.071691 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-18cd9cbc-3204-473d-b2b9-bd119c358ab5 req-79924e26-e268-4fac-b489-0534c7f0f468 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087223 Mar 26 20:57:50.074969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1207/2602] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:50.096469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.102451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:50.108440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.110818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:50.328284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-202337159", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:50.386334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:50.397414 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f9497c8-2133-4464-8764-97219a2ead21 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1270 microversion: 2.1 time: 0.354339 Mar 26 20:57:50.409006 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1396/2603] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:50 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1270 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:50.431248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8df52206-958a-41c0-9260-8bd52125f76c req-6057d9de-7890-405e-aea4-25a428607d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8368aa61-964c-40fc-b08f-5369b1915410", "name": "network-vif-deleted", "tag": "09a2b045-fb00-44cf-929e-188526c6e172"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:50.459295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8df52206-958a-41c0-9260-8bd52125f76c req-6057d9de-7890-405e-aea4-25a428607d30 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.460864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8df52206-958a-41c0-9260-8bd52125f76c req-6057d9de-7890-405e-aea4-25a428607d30 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:50.490775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8df52206-958a-41c0-9260-8bd52125f76c req-6057d9de-7890-405e-aea4-25a428607d30 service nova] Creating event network-vif-deleted:09a2b045-fb00-44cf-929e-188526c6e172 for instance 8368aa61-964c-40fc-b08f-5369b1915410 on nch1-master-1 Mar 26 20:57:50.505049 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8df52206-958a-41c0-9260-8bd52125f76c req-6057d9de-7890-405e-aea4-25a428607d30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092025 Mar 26 20:57:50.509129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1397/2604] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:50.509442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] validate_networks() for [('637c5544-5d67-4536-b4e8-2425937ec750', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:50.526299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:50.535275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:50.578634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.583520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:50.587626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:50.593064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:51.552972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:51.569016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44a84f74-faed-425f-b50d-6e0f62e450f3 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 1.058393 Mar 26 20:57:51.582948 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1398/2605] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:50 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:51.589540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-668ebba3-292c-47bb-9cad-3027f8fefc81 req-43f539ea-da94-4044-be59-7641391b3604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2bfcb66-1cd1-45a8-bae4-b25cf4240d78", "name": "network-vif-plugged", "status": "completed", "tag": "13e6f963-1ad1-433a-9c38-29a63ba6f2c3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:51.602289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-668ebba3-292c-47bb-9cad-3027f8fefc81 req-43f539ea-da94-4044-be59-7641391b3604 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:51.610313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-668ebba3-292c-47bb-9cad-3027f8fefc81 req-43f539ea-da94-4044-be59-7641391b3604 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:51.650176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-668ebba3-292c-47bb-9cad-3027f8fefc81 req-43f539ea-da94-4044-be59-7641391b3604 service nova] Creating event network-vif-plugged:13e6f963-1ad1-433a-9c38-29a63ba6f2c3 for instance e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 on nch1-master-1 Mar 26 20:57:51.673612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-668ebba3-292c-47bb-9cad-3027f8fefc81 req-43f539ea-da94-4044-be59-7641391b3604 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088972 Mar 26 20:57:51.675513 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1399/2606] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:51.699300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:51.706497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:51.724341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:51.726139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:51.727102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:51.731963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:52.660160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:52.660664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:52.661066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:52.661486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:52.661907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:52.679183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:52.679650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:52.682314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:52.682314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:52.741108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Getting quotas for project a7e64b94cc37456185389445ddc56877. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:52.756982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Getting quotas for user 32e2a79f7ce548d5b39cd657ac6d578a and project a7e64b94cc37456185389445ddc56877. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:52.778374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:52.780891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:52.906387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8996e10-8508-4aa7-8919-cd2243796954 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.829841 Mar 26 20:57:52.907114 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1208/2607] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:57:52.924566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:52.936119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:52.949654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:52.950456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:52.952726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:52.954881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.182956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:53.191749 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88f51790-11c9-4956-ab27-89163ae5e08f tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1317 microversion: 2.1 time: 1.503121 Mar 26 20:57:53.196027 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1400/2608] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:51 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1317 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:53.206806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:53.207442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:53.229297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.229835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.230622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.230958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.380195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:53.406469 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-637b33f3-5fb8-4b42-8648-6c4c7048e7d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.484296 Mar 26 20:57:53.416499 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1209/2609] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:52 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:53.436987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:53.437906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:53.469160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.471306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.475677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.478469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.586950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:53.609507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:53.617985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:53.619230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5874101-f67b-4fb7-b735-aeb69af75e86 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.421785 Mar 26 20:57:53.619818 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1401/2610] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:53 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:53.651019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:53.659799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:53.706605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.707089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:53.707911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:53.708389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:54.110096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:54.130683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a63b1376-4b9b-455d-8338-6c843c718f0b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1276 microversion: 2.1 time: 0.712199 Mar 26 20:57:54.131377 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1210/2611] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:53 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1276 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:54.165743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:54.174051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:54.189018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:54.193148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:54.196230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:54.198963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:54.343096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:54.356300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4ef37a8-96fe-42bd-8f16-97a0cada640e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1217 microversion: 2.1 time: 0.213794 Mar 26 20:57:54.359392 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1211/2612] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:54 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:54.381009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-plugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}, {"server_uuid": "eed6c119-e132-488c-964a-c28e1411b0b4", "name": "network-vif-plugged", "status": "completed", "tag": "b15eee45-c08c-4bb6-a728-2b42726ae7b4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:54.421958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:54.422420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:54.474099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] Creating event network-vif-plugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:57:54.491258 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] Creating event network-vif-plugged:b15eee45-c08c-4bb6-a728-2b42726ae7b4 for instance eed6c119-e132-488c-964a-c28e1411b0b4 on nch1-master-1 Mar 26 20:57:54.539296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d85145df-29b1-44c3-a564-e75ef0c292f2 req-e8ae3a09-1ec9-420e-a6ff-2bbf391f8a61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.175608 Mar 26 20:57:54.539937 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1212/2613] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:54.554390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:54.555177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:54.592929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:54.593458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:54.594316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:54.594771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.087158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.094710 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fe47672b-4d7c-4c8a-836d-976037f9d58c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 1.473834 Mar 26 20:57:55.095306 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1402/2614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:53 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:55.112070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:55.113002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:55.125895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.126663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.127809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.128549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.658414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.667281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7b6b7c2a-1505-461e-a222-f13d758f610d tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1467 microversion: 2.1 time: 1.119831 Mar 26 20:57:55.674394 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1213/2615] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:54 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1467 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:55.692917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:55.693919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:55.717173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.720253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.724196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.724807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.797099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.806869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b94afd64-14e1-492d-8c8a-83128e16a820 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.698767 Mar 26 20:57:55.807473 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1403/2616] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:55 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:55.818658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:55.819333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:55.842324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.843105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.844195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:55.856643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:55.946205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.976027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.977635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:55.978861 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e34a0678-848c-462e-adcc-54014e358a30 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.303173 Mar 26 20:57:55.994041 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1214/2617] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:55 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:56.053697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:56.056332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:56.064886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.065889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.069989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.070673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.297617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:56.323430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3bd0550-d07e-477a-b164-1389c5dd6143 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.514530 Mar 26 20:57:56.324129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1404/2618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:55 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:56.341330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:56.345289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:56.345903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:56.349736 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1ebb7b5c-48a0-43e9-9f60-29668ff0892c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1271 microversion: 2.1 time: 0.354506 Mar 26 20:57:56.356660 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1215/2619] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:55 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:56.364161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.364962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.365965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.367141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.375169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:56.380254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:56.410755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.411244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.412111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.421813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.734226 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c7df664-1b3e-484e-97af-10d811176780 tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1618 microversion: 2.1 time: 0.393116 Mar 26 20:57:56.735079 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1405/2620] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:56 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1618 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:56.829356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:56.829987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:56.838256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.848174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:56.851747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:56.856344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:57.142488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:57.149533 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04903a9b-cdc4-439e-b438-e3e807c52f4d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.324332 Mar 26 20:57:57.151484 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1406/2621] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:56 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:57.161773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b544202b-7fba-4002-ae6f-7c12aa48333b req-7af495e1-5e5f-48ca-b01a-6b66ce574b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4098ba7e-07e3-468c-997a-7960ed44729c", "tag": "a6b3c590-9fed-47ce-b164-f99a99555c05"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:57.180284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b544202b-7fba-4002-ae6f-7c12aa48333b req-7af495e1-5e5f-48ca-b01a-6b66ce574b27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:57.180937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b544202b-7fba-4002-ae6f-7c12aa48333b req-7af495e1-5e5f-48ca-b01a-6b66ce574b27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:57.202404 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b544202b-7fba-4002-ae6f-7c12aa48333b req-7af495e1-5e5f-48ca-b01a-6b66ce574b27 service nova] Creating event network-changed:a6b3c590-9fed-47ce-b164-f99a99555c05 for instance 4098ba7e-07e3-468c-997a-7960ed44729c on nch2-master-1 Mar 26 20:57:57.224922 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b544202b-7fba-4002-ae6f-7c12aa48333b req-7af495e1-5e5f-48ca-b01a-6b66ce574b27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069928 Mar 26 20:57:57.236335 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1407/2622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:57:57.244013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:57.244973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:57.260239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:57.260945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:57.261933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:57.262545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:57.453365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:57.472852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:57.475044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:57.484755 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31fd5ea8-079a-4548-85f2-a5687ac9f817 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.238282 Mar 26 20:57:57.508061 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1408/2623] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:57 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:57:57.534185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1473966934", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c51099b7-6a2d-4a66-8a36-3b9b6c08e32e"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:57:57.665530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:57:57.871902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:57.883095 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c96d744-cfdd-4b19-966d-84876894f990 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1315 microversion: 2.1 time: 1.525233 Mar 26 20:57:57.893189 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1216/2624] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:56 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1315 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:57.898348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:57.901257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:57.917137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:57.922014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:57.923132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:57.923772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.124080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:57:58.124738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:57:58.125384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:57:58.126011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:57:58.126697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:57:58.149839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.152475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.153502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.155197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.228202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:57:58.244485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Getting quotas for user 4c8199b3248742a7ba0d0cb6570c7058 and project a8e2bb0e3958483d90176ec061c32ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:57:58.283240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:57:58.286364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:57:58.404790 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d18e3a14-660b-4ba6-b5c7-6db306c12874 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895338 Mar 26 20:57:58.414237 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1409/2625] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:57:58.437686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:58.444964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:58.463572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.465667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.466809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.467448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.728132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:58.736082 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edc4a8ac-4def-4362-92d5-b6dcdad2cce7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1271 microversion: 2.1 time: 0.318933 Mar 26 20:57:58.753978 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1410/2626] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:58 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1271 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:58.771488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:58.781328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:58.807437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.807895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:58.808783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:58.809136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:59.485975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:59.497631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6c39dc58-d2bd-4aaa-bb46-bea1c5b48e4e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 1.602533 Mar 26 20:57:59.499540 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1217/2627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:57 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:59.505877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:59.508022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:59.527411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:59.533819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:59.535364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:59.536075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:59.817560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:59.833397 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56e04e6d-2d4b-406f-a683-f373cd19b7c7 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1213 microversion: 2.1 time: 0.332351 Mar 26 20:57:59.835745 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1218/2628] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:59 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:59.875082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:59.880772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:57:59.913909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:59.914377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:59.915344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:57:59.915752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:57:59.927520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:57:59.958989 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01fab9e6-4c4a-4d75-b273-410fbf0c4a39 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 1.201571 Mar 26 20:57:59.973784 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1411/2629] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:58 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:57:59.983634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:57:59.988702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:00.002018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.004495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:00.005694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.009452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:00.185197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:00.197644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:00.199763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:00.201845 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a3d13c8-5bb4-4a15-af68-7c0db48cfda9 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1366 microversion: 2.57 time: 0.349426 Mar 26 20:58:00.203198 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1219/2630] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:57:59 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:58:00.209360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:00.210246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:00.216991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.217695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:00.218742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.219399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:00.900871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:00.928170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f8aa7fc-2a3c-42bd-a95d-8576c91580e0 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1465 microversion: 2.1 time: 0.950456 Mar 26 20:58:00.937088 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1412/2631] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:57:59 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1465 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:00.972238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:00.973038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:00.990025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.990484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:00.991339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:00.991786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.337015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:01.346673 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2200dd1-f0c7-47f1-ab6b-ffe171fda3a0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 1.142233 Mar 26 20:58:01.347261 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1220/2632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:00 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:01.370127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-fd910363-91ec-424f-8700-d5f35f1fbea9 req-d93cff4f-dc0e-4936-bb33-56a552e24e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744ce669-197a-4411-a6c8-31d0efc0e6ea", "tag": "4e6695aa-f00f-45cf-9e7a-67f47f86a40c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:01.400222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fd910363-91ec-424f-8700-d5f35f1fbea9 req-d93cff4f-dc0e-4936-bb33-56a552e24e6c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.400678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fd910363-91ec-424f-8700-d5f35f1fbea9 req-d93cff4f-dc0e-4936-bb33-56a552e24e6c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.435764 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-fd910363-91ec-424f-8700-d5f35f1fbea9 req-d93cff4f-dc0e-4936-bb33-56a552e24e6c service nova] Creating event network-changed:4e6695aa-f00f-45cf-9e7a-67f47f86a40c for instance 744ce669-197a-4411-a6c8-31d0efc0e6ea on nch2-master-1 Mar 26 20:58:01.448331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-fd910363-91ec-424f-8700-d5f35f1fbea9 req-d93cff4f-dc0e-4936-bb33-56a552e24e6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090745 Mar 26 20:58:01.448942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1221/2633] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:01.462591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:01.464495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:01.484665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.485058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.485859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.486300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.634899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:01.646833 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-630094b6-94ad-4762-b63f-be9aa0344b5b tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.705367 Mar 26 20:58:01.662213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1413/2634] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:00 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:01.668145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:01.683686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:01.701233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.701694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.702489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.702960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.714870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:01.724811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ff5a5f0-21ce-47ba-a1d9-ded1b23c1163 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1275 microversion: 2.1 time: 0.274335 Mar 26 20:58:01.736149 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1222/2635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:01 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:01.740926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:01.742067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:01.750870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.754934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.760438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:01.761205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:01.805575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:02.113724 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8b400e4-c4e7-48c6-971e-b1e253119b52 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 204 len: 0 microversion: 2.1 time: 0.449208 Mar 26 20:58:02.115453 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1414/2636] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:01 2022] DELETE /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:02.126441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:02.127431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:02.137507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.138330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.140183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.140963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.309765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:02.319279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:02.326383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:02.328101 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f13bd71-873f-42c7-a59a-74b4ab2a9fc4 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1372 microversion: 2.57 time: 0.210557 Mar 26 20:58:02.331513 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1415/2637] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:58:02 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:58:02.344361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:02.345273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:02.371338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.372171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.373148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.373924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.424321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:02.433091 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8bd9575a-c40b-4dd2-a3a2-1c2bdd6f120f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.695806 Mar 26 20:58:02.437117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1223/2638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:01 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:02.441981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-683ae17f-5d60-4cbb-9702-2e1250433f6a req-b821395b-7bb0-48e0-9d9d-3eff709ac6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098ba7e-07e3-468c-997a-7960ed44729c", "name": "network-vif-plugged", "status": "completed", "tag": "a6b3c590-9fed-47ce-b164-f99a99555c05"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:02.466623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-683ae17f-5d60-4cbb-9702-2e1250433f6a req-b821395b-7bb0-48e0-9d9d-3eff709ac6ac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.469267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-683ae17f-5d60-4cbb-9702-2e1250433f6a req-b821395b-7bb0-48e0-9d9d-3eff709ac6ac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.489600 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-683ae17f-5d60-4cbb-9702-2e1250433f6a req-b821395b-7bb0-48e0-9d9d-3eff709ac6ac service nova] Creating event network-vif-plugged:a6b3c590-9fed-47ce-b164-f99a99555c05 for instance 4098ba7e-07e3-468c-997a-7960ed44729c on nch2-master-1 Mar 26 20:58:02.498658 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-683ae17f-5d60-4cbb-9702-2e1250433f6a req-b821395b-7bb0-48e0-9d9d-3eff709ac6ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059766 Mar 26 20:58:02.504997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1224/2639] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:02.529374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:02.530458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:02.537781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.539220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:02.540273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:02.540931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.177679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.197409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d953a476-5160-479b-aa12-5f98295361b4 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1471 microversion: 2.1 time: 0.864504 Mar 26 20:58:03.198693 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1416/2640] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:02 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1471 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:03.206885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:03.209335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:03.222326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.224473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.225547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.227394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.467108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.480699 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29d24da8-26ff-40b3-9537-9db72df3fdc8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.973456 Mar 26 20:58:03.486815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1225/2641] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:02 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:03.500342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:03.503017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:03.519422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.520375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.521451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.527893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.597202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.608292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-182c2192-85b5-4b67-a2b1-3f66bf06a41c tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.407587 Mar 26 20:58:03.618538 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1417/2642] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:03 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:03.619669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:03.630787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:03.639253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.639716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.640972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.641435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.816066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.831210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.832882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:03.834106 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dbd17dbc-f299-4caf-a3be-64f7d48ee2e0 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1357 microversion: 2.57 time: 0.223653 Mar 26 20:58:03.846347 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1418/2643] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:58:03 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:58:03.857356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:03.857986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:03.886698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.887151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:03.887951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:03.904715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:04.254852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:04.269971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f64322c7-2f18-456b-822e-0a079c962397 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.775049 Mar 26 20:58:04.271275 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1226/2644] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:03 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:04.298441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:04.299438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:04.317080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:04.324725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:04.326030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:04.328451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:04.402782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:04.603955 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a15a255d-f589-4810-89f0-6dd8872baae1 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 204 len: 0 microversion: 2.57 time: 0.330567 Mar 26 20:58:04.608473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1227/2645] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 20:58:04 2022] DELETE /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 20:58:04.628937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:04.632852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:04.645222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:04.646695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:04.650398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:04.650892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.265257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:05.290040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e2b189d-d4de-4527-aad6-74517308c5eb tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1471 microversion: 2.1 time: 0.678226 Mar 26 20:58:05.297888 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1228/2646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:04 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1471 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:05.316455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:05.317099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:05.330735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.331895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.334366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.335508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.428215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:05.438452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ca88000-ce4f-4f78-ba08-f3c7f0765b05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 1.591085 Mar 26 20:58:05.446113 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1419/2647] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:03 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:05.451968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:05.463273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:05.483556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.484044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.484830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.485286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.627834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:05.636557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:05.647886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:05.649402 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5ac61b1b-5a08-4e51-bbee-f8fa52633ad3 tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1363 microversion: 2.57 time: 0.201528 Mar 26 20:58:05.650168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1420/2648] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:58:05 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:58:05.654856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:05.660721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:05.678073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.681335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:05.684586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:05.685223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:06.149936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:06.157925 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36ec27cc-9980-41e1-a0a5-19bd50f807c5 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.506523 Mar 26 20:58:06.161070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1421/2649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:05 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:06.167591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-34d03cf5-5682-4e4f-a381-4d1dc7f393c2 req-0a820a25-4b2b-4750-9dbd-9ed7c8e7986c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b3ccf8-2570-48db-aa78-3a673c02d3da", "tag": "41328fe6-d504-4051-8089-d948e97d3fa2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:06.197527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-34d03cf5-5682-4e4f-a381-4d1dc7f393c2 req-0a820a25-4b2b-4750-9dbd-9ed7c8e7986c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:06.198456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-34d03cf5-5682-4e4f-a381-4d1dc7f393c2 req-0a820a25-4b2b-4750-9dbd-9ed7c8e7986c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:06.224818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-34d03cf5-5682-4e4f-a381-4d1dc7f393c2 req-0a820a25-4b2b-4750-9dbd-9ed7c8e7986c service nova] Creating event network-changed:41328fe6-d504-4051-8089-d948e97d3fa2 for instance 62b3ccf8-2570-48db-aa78-3a673c02d3da on nch1-master-1 Mar 26 20:58:06.237721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-34d03cf5-5682-4e4f-a381-4d1dc7f393c2 req-0a820a25-4b2b-4750-9dbd-9ed7c8e7986c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075174 Mar 26 20:58:06.238359 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1422/2650] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:06.244651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:06.245361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:06.264504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:06.264948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:06.266017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:06.266629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:06.891064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:06.904981 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0b67e84-0f7d-476d-9a94-b8368e2bb910 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 1.604695 Mar 26 20:58:06.915471 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1229/2651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:05 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:07.036690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.046093 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c39d8d6-5c04-4d21-9c2b-363335d94e8e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.806479 Mar 26 20:58:07.048997 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1423/2652] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:06 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:07.059896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.061902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:07.079845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.080350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.084856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.087206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.112264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc892315-30aa-4610-baea-d041fa72767d tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.202688 Mar 26 20:58:07.112979 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1230/2653] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:58:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 26 20:58:07.123063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0d84560f-b6ff-41fd-bf37-4c66a927303f req-d21ec654-92e4-472a-842e-e6beed4b9cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed6c119-e132-488c-964a-c28e1411b0b4", "name": "network-vif-deleted", "tag": "b15eee45-c08c-4bb6-a728-2b42726ae7b4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:07.142017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0d84560f-b6ff-41fd-bf37-4c66a927303f req-d21ec654-92e4-472a-842e-e6beed4b9cfa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.142874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0d84560f-b6ff-41fd-bf37-4c66a927303f req-d21ec654-92e4-472a-842e-e6beed4b9cfa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.155302 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0d84560f-b6ff-41fd-bf37-4c66a927303f req-d21ec654-92e4-472a-842e-e6beed4b9cfa service nova] Creating event network-vif-deleted:b15eee45-c08c-4bb6-a728-2b42726ae7b4 for instance eed6c119-e132-488c-964a-c28e1411b0b4 on nch1-master-1 Mar 26 20:58:07.162038 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0d84560f-b6ff-41fd-bf37-4c66a927303f req-d21ec654-92e4-472a-842e-e6beed4b9cfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043014 Mar 26 20:58:07.163865 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1231/2654] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:07.165658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.166115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.166576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lazy-loading 'fault' on Instance uuid eed6c119-e132-488c-964a-c28e1411b0b4 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:07.172778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.174548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:07.183357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.184235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.188194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.189003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.275399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a55d0611954871ac316bcc4381d031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6702eaac3714fd6aaeafeb1dddfc749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.282680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9313f38b-75a8-4505-b8e7-981c266e8cf6 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 200 len: 1305 microversion: 2.1 time: 0.229112 Mar 26 20:58:07.283329 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1424/2655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:07.295091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.304876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:07.311317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.312164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.313338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.314020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.352784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.353510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.354131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lazy-loading 'fault' on Instance uuid 45ca750d-c755-4a67-9a68-0a22d846b4ca {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:07.473707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.497191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.498918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8a51bcbc574c758595a30ba9e885df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4711951c1994477aabaf5a8a585fe537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.500344 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d25cc139-66b1-40f9-9915-ef8a7f98200b tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 200 len: 1368 microversion: 2.57 time: 0.209118 Mar 26 20:58:07.501689 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1425/2656] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:58:07 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 20:58:07.506628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfd5d1d9-d40f-4d97-8d72-e5b0deba6846 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Calling method '.version_select at 0x7f6e5958e790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.541325 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-dfd5d1d9-d40f-4d97-8d72-e5b0deba6846 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] HTTP exception thrown: Image not found. Mar 26 20:58:07.542252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfd5d1d9-d40f-4d97-8d72-e5b0deba6846 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:07.543322 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dfd5d1d9-d40f-4d97-8d72-e5b0deba6846 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.040504 Mar 26 20:58:07.544815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1426/2657] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 20:58:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:58:07.554281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.555717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:07.569814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.570597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.571595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.573862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.621330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.629624 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63e0717e-681a-4c80-beda-95b71ddd91fb tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.464261 Mar 26 20:58:07.665544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1232/2658] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:07.679211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-70d0c23f-2a53-4f49-8446-db3d51059c89 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Calling method '.version_select at 0x7f6e59666c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.724593 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-70d0c23f-2a53-4f49-8446-db3d51059c89 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] HTTP exception thrown: Image not found. Mar 26 20:58:07.725351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-70d0c23f-2a53-4f49-8446-db3d51059c89 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:07.726755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-70d0c23f-2a53-4f49-8446-db3d51059c89 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/4f420f05-a64d-49e6-85f6-23982636e44j" status: 404 len: 62 microversion: 2.1 time: 0.060034 Mar 26 20:58:07.727797 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1233/2659] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] DELETE /compute/v2.1/images/4f420f05-a64d-49e6-85f6-23982636e44j => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:58:07.741596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76043b61-98e1-4f9c-a9ba-3736fa4707da tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Calling method '.version_select at 0x7f6e594d3af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.766747 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-76043b61-98e1-4f9c-a9ba-3736fa4707da tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] HTTP exception thrown: Image not found. Mar 26 20:58:07.767412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76043b61-98e1-4f9c-a9ba-3736fa4707da tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:07.768304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76043b61-98e1-4f9c-a9ba-3736fa4707da tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/ebb5dca1-a276-4fc7-9f10-5f34eac748b81" status: 404 len: 62 microversion: 2.1 time: 0.035116 Mar 26 20:58:07.768862 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1234/2660] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:07 2022] DELETE /compute/v2.1/images/ebb5dca1-a276-4fc7-9f10-5f34eac748b81 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 20:58:07.778955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1236a5f2-d79a-4dc0-9803-e0f437d95258 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Calling method '.version_select at 0x7f6e596669d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.802285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:07.811283 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b2d63ef-bb2b-4cd0-bdf3-7c501f0af93e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.265248 Mar 26 20:58:07.812175 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1427/2661] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:07.820695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1236a5f2-d79a-4dc0-9803-e0f437d95258 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] HTTP exception thrown: Image not found. Mar 26 20:58:07.821377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1236a5f2-d79a-4dc0-9803-e0f437d95258 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:07.822343 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1236a5f2-d79a-4dc0-9803-e0f437d95258 tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-186043606" status: 404 len: 62 microversion: 2.1 time: 0.047348 Mar 26 20:58:07.823429 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1235/2662] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:58:07 2022] DELETE /compute/v2.1/images/tempest-invalid-186043606 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 20:58:07.836425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61123c35-f0ca-4c03-84c9-4561fea7f3cd tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Calling method '.version_select at 0x7f6e593aed30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.861312 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-61123c35-f0ca-4c03-84c9-4561fea7f3cd tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] HTTP exception thrown: Image not found. Mar 26 20:58:07.863164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61123c35-f0ca-4c03-84c9-4561fea7f3cd tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:07.864268 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61123c35-f0ca-4c03-84c9-4561fea7f3cd tempest-ImagesDeleteNegativeTestJSON-1091520519 tempest-ImagesDeleteNegativeTestJSON-1091520519-project] 10.222.0.16 "DELETE /compute/v2.1/images/15db792f-e366-4aa4-8ed5-8d53295f4259" status: 404 len: 62 microversion: 2.1 time: 0.034660 Mar 26 20:58:07.865034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1428/2663] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] DELETE /compute/v2.1/images/15db792f-e366-4aa4-8ed5-8d53295f4259 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:58:07.925676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:07.926351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:07.942364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.946130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:07.947193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:07.952339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.069716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.074213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.112445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.114790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.128761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.131340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.367233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:08.378296 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9e708dc-e5d1-4ef7-ba44-e47289830a4a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.316307 Mar 26 20:58:08.381567 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1429/2664] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:08.388134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f37dc4b2-476c-4ee4-b864-0a202b3f4964 req-34312c85-b4bc-4145-969d-3ee23ee1d29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744ce669-197a-4411-a6c8-31d0efc0e6ea", "name": "network-vif-plugged", "status": "completed", "tag": "4e6695aa-f00f-45cf-9e7a-67f47f86a40c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:08.398550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f37dc4b2-476c-4ee4-b864-0a202b3f4964 req-34312c85-b4bc-4145-969d-3ee23ee1d29d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.399430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f37dc4b2-476c-4ee4-b864-0a202b3f4964 req-34312c85-b4bc-4145-969d-3ee23ee1d29d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.418137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f37dc4b2-476c-4ee4-b864-0a202b3f4964 req-34312c85-b4bc-4145-969d-3ee23ee1d29d service nova] Creating event network-vif-plugged:4e6695aa-f00f-45cf-9e7a-67f47f86a40c for instance 744ce669-197a-4411-a6c8-31d0efc0e6ea on nch2-master-1 Mar 26 20:58:08.426424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f37dc4b2-476c-4ee4-b864-0a202b3f4964 req-34312c85-b4bc-4145-969d-3ee23ee1d29d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041630 Mar 26 20:58:08.432534 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1430/2665] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:08.439805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.441355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.448280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:08.450815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.451823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.453085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.453694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.462111 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a98b1851-0637-4854-a0cf-b0bd10250cfa tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.542930 Mar 26 20:58:08.463041 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1236/2666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:07 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:08.492447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. Mar 26 20:58:08.493418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.494478 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71fb35cb-a8da-4c2d-8c3c-b3c7ce312d3c tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 404 len: 111 microversion: 2.1 time: 0.060509 Mar 26 20:58:08.495212 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1431/2667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:08.503778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1530823151", "metadata": {"image_type": "test"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:08.505352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.517377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.518095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.519090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.525067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.528628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.529464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] [instance: 45ca750d-c755-4a67-9a68-0a22d846b4ca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.556617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.557262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.558622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.559236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.580124 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. Mar 26 20:58:08.580950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.582168 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7704e087-9aba-4092-8637-5f09f42f1551 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "POST /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4/action" status: 404 len: 111 microversion: 2.1 time: 0.082414 Mar 26 20:58:08.582940 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1237/2668] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Mar 26 20:58:08 2022] POST /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:08.594356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2120b971-a5f7-4b0a-aff6-5a66f6b49513 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2025602353", "metadata": {"image_type": "test"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:08.599222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] HTTP exception thrown: Instance 45ca750d-c755-4a67-9a68-0a22d846b4ca could not be found. Mar 26 20:58:08.599707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2120b971-a5f7-4b0a-aff6-5a66f6b49513 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Failed to fetch instance by id tempest-invalid-2078185483 {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 20:58:08.600479 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2120b971-a5f7-4b0a-aff6-5a66f6b49513 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance tempest-invalid-2078185483 could not be found. Mar 26 20:58:08.601278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] Returning 404 to user: Instance 45ca750d-c755-4a67-9a68-0a22d846b4ca could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.602023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2120b971-a5f7-4b0a-aff6-5a66f6b49513 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance tempest-invalid-2078185483 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.603040 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a60d6c47-9f7e-4351-8cf5-c1a6956a841c tempest-ServerShowV257Test-622898713 tempest-ServerShowV257Test-622898713-project] 10.222.0.16 "GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca" status: 404 len: 111 microversion: 2.57 time: 0.087587 Mar 26 20:58:08.607807 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2120b971-a5f7-4b0a-aff6-5a66f6b49513 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-2078185483/action" status: 404 len: 101 microversion: 2.1 time: 0.014393 Mar 26 20:58:08.608952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1432/2669] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/45ca750d-c755-4a67-9a68-0a22d846b4ca => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:08.609436 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1238/2670] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 20:58:08 2022] POST /compute/v2.1/servers/tempest-invalid-2078185483/action => generated 101 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:08.618996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83f0ac5f-eadf-4f66-9661-43fa0385a3fe tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1293684614"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:08.620430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83f0ac5f-eadf-4f66-9661-43fa0385a3fe tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 20:58:08.621427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-83f0ac5f-eadf-4f66-9661-43fa0385a3fe tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 26 20:58:08.622174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83f0ac5f-eadf-4f66-9661-43fa0385a3fe tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.623159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83f0ac5f-eadf-4f66-9661-43fa0385a3fe tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009371 Mar 26 20:58:08.624250 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1433/2671] 10.222.0.16 () {60 vars in 1274 bytes} [Sat Mar 26 20:58:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:08.634506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-700487aa-9e48-4386-b081-7bbfc3540498 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-679955868"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:08.637169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-700487aa-9e48-4386-b081-7bbfc3540498 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 20:58:08.637962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-700487aa-9e48-4386-b081-7bbfc3540498 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 26 20:58:08.638798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-700487aa-9e48-4386-b081-7bbfc3540498 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.639804 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-700487aa-9e48-4386-b081-7bbfc3540498 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010770 Mar 26 20:58:08.640944 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1239/2672] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Mar 26 20:58:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:08.655468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.656641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.673834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.674473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.689995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.690587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.691264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.691712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.693565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.694044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.694835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.695393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.740579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. Mar 26 20:58:08.741269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.742652 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f67228c3-2b59-4926-8995-2e2eab9c5a24 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 404 len: 111 microversion: 2.1 time: 0.095425 Mar 26 20:58:08.752193 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1434/2673] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:08 2022] DELETE /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:08.760311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.760916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] [instance: eed6c119-e132-488c-964a-c28e1411b0b4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.777650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.781867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.782798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.783262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.818029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] HTTP exception thrown: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. Mar 26 20:58:08.818642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] Returning 404 to user: Instance eed6c119-e132-488c-964a-c28e1411b0b4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:08.819542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-97f7e9e1-bc34-42c0-a596-e35c76857060 tempest-ImagesNegativeTestJSON-1986411782 tempest-ImagesNegativeTestJSON-1986411782-project] 10.222.0.16 "GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4" status: 404 len: 111 microversion: 2.1 time: 0.063219 Mar 26 20:58:08.826697 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1435/2674] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/eed6c119-e132-488c-964a-c28e1411b0b4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:08.841988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:08.843047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:08.858996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.860508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:08.862529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:08.863357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:09.205272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:09.217978 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92bb4d69-82e5-49a9-8b29-e6abc65f0129 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.551146 Mar 26 20:58:09.219231 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1240/2675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:09.239413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-70f363db-26cd-4e98-ac02-d3e19ddb43fe req-68668972-8972-486c-a047-f2ce26e36d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bfa695-99d2-471f-8920-4a76bb8af593", "tag": "fbf0f9fa-1caf-456e-b3b7-a9bc64217a12"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:09.254048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-70f363db-26cd-4e98-ac02-d3e19ddb43fe req-68668972-8972-486c-a047-f2ce26e36d09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:09.257132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-70f363db-26cd-4e98-ac02-d3e19ddb43fe req-68668972-8972-486c-a047-f2ce26e36d09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:09.284813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-70f363db-26cd-4e98-ac02-d3e19ddb43fe req-68668972-8972-486c-a047-f2ce26e36d09 service nova] Creating event network-changed:fbf0f9fa-1caf-456e-b3b7-a9bc64217a12 for instance c3bfa695-99d2-471f-8920-4a76bb8af593 on nch2-master-1 Mar 26 20:58:09.315771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-70f363db-26cd-4e98-ac02-d3e19ddb43fe req-68668972-8972-486c-a047-f2ce26e36d09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094137 Mar 26 20:58:09.317068 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1241/2676] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:09.398324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:09.399279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:09.413476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:09.414190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:09.415166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:09.417832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:09.658152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:09.665603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cd06eb1-8d11-424c-b114-d2d7d725d0b6 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1318 microversion: 2.1 time: 0.837320 Mar 26 20:58:09.685961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1436/2677] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:08 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:09.692145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:09.693024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:09.700057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:09.700801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:09.701764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:09.702379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:10.071144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:10.081542 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ded1d5f1-e272-42dd-a794-8ac319351e34 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.687984 Mar 26 20:58:10.086467 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1242/2678] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:09 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:10.236307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:10.236913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:10.248421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:10.249616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:10.254540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:10.255744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:10.576273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:10.586930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-053176cc-08dc-471c-89b9-4e0ef55102a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.900680 Mar 26 20:58:10.596195 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1437/2679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:09 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:10.612570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:10.631235 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82958125-0863-4cbc-8d99-f35746cb594d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.397393 Mar 26 20:58:10.633466 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1243/2680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:10 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:10.696073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:10.697278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:10.703525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:10.716387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:10.717308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:10.717765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.102092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:11.102861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:11.111713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:11.116363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.117841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.120027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46c0f775-4a9e-45df-9827-7df5a3baee36 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 200 len: 1506 microversion: 2.1 time: 0.431102 Mar 26 20:58:11.124595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.125534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.134825 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1438/2681] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:10 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:11.148570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:11.149193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:11.174321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.174779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.175571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.176049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.477087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:11.493888 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7090545-b9d2-4db1-992d-6798306d1532 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 200 len: 1506 microversion: 2.1 time: 0.357850 Mar 26 20:58:11.499965 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1439/2682] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:11 2022] GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:11.518500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:11.519364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:11.527160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.527998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.529010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.529692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.553345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:11.562648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:11.564588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb440b9b-fe2a-4614-a2cc-7cd7b56cd106 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.466096 Mar 26 20:58:11.568293 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1244/2683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:11 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:11.604058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:11.605391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:11.619664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.620715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.621772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.622481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.700004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88dd874d-f7ca-4505-ae36-68eb200df4ee tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 204 len: 0 microversion: 2.1 time: 0.185243 Mar 26 20:58:11.700905 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1440/2684] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:11 2022] DELETE /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:11.710667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:11.711394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:11.727185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.727766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:11.728444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:11.732517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.004954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:12.013350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-194bf40c-7c82-4ac1-a148-8ba52c135bd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1683 microversion: 2.1 time: 0.311120 Mar 26 20:58:12.014923 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1441/2685] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:11 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1683 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:12.024196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:12.024196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:12.028345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.028930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.029836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.030389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.070460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:12.166716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:12.181689 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c03dbe9-b1f2-426f-9b2c-d34aa27feccb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.582383 Mar 26 20:58:12.197034 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1245/2686] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:11 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:12.222957 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-50c8f0e7-4bbd-4629-9db8-aac6cdceb405 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 204 len: 0 microversion: 2.1 time: 0.206295 Mar 26 20:58:12.223641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1442/2687] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:12 2022] DELETE /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:12.232543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:12.233464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:12.243824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.244325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.245125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.245578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.734584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:12.742651 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f6409f0a-9292-4e07-a2f5-db1c96dc202e tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 200 len: 1512 microversion: 2.1 time: 0.513982 Mar 26 20:58:12.748949 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1246/2688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:12 2022] GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:12.755411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e40a023b-f4a5-47bc-84ed-3a905057497c tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] Calling method '.version_select at 0x7f6e59529af0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:12.765112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2ebf6661-4223-4e9e-b5d2-0e8e53674a70 req-1c366007-b660-4dd8-b216-98417afbcb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bfa695-99d2-471f-8920-4a76bb8af593", "name": "network-vif-plugged", "status": "completed", "tag": "fbf0f9fa-1caf-456e-b3b7-a9bc64217a12"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:12.813008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ebf6661-4223-4e9e-b5d2-0e8e53674a70 req-1c366007-b660-4dd8-b216-98417afbcb27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.813858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ebf6661-4223-4e9e-b5d2-0e8e53674a70 req-1c366007-b660-4dd8-b216-98417afbcb27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.824606 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e40a023b-f4a5-47bc-84ed-3a905057497c tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] 10.222.0.16 "GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb" status: 200 len: 784 microversion: 2.1 time: 0.502472 Mar 26 20:58:12.825199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1443/2689] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:12 2022] GET /compute/v2.1/images/4c68d3e3-5768-41fa-883a-78a7564bdbcb => generated 784 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:12.839378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:12.841635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:12.856596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.857068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.857869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:12.858317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:12.869963 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2ebf6661-4223-4e9e-b5d2-0e8e53674a70 req-1c366007-b660-4dd8-b216-98417afbcb27 service nova] Creating event network-vif-plugged:fbf0f9fa-1caf-456e-b3b7-a9bc64217a12 for instance c3bfa695-99d2-471f-8920-4a76bb8af593 on nch2-master-1 Mar 26 20:58:12.883549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2ebf6661-4223-4e9e-b5d2-0e8e53674a70 req-1c366007-b660-4dd8-b216-98417afbcb27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121881 Mar 26 20:58:12.887664 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1247/2690] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:12.894798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba36b160-2623-478b-956e-914ad6b9e29f tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] Calling method '.version_select at 0x7f6e59499ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:12.973998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba36b160-2623-478b-956e-914ad6b9e29f tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.084691 Mar 26 20:58:12.975061 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1248/2691] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:12 2022] GET /compute/v2.1/images => generated 445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:13.083499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6b3b00a-ef77-4ad4-9a59-d842923e1180 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Calling method '.version_select at 0x7f6e596a0310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.155448 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6b3b00a-ef77-4ad4-9a59-d842923e1180 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.178666 Mar 26 20:58:13.161781 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1249/2692] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:58:12 2022] GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf/defaults => generated 371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:13.167482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0769f855-5675-486a-91e0-8ce9d20b727b tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] Calling method '.version_select at 0x7f6e593d9700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.236148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0769f855-5675-486a-91e0-8ce9d20b727b tempest-ListImagesTestJSON-674796512 tempest-ListImagesTestJSON-674796512-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.072494 Mar 26 20:58:13.244731 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1250/2693] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 20:58:13 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:13.244731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.252705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:13.267123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.268540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:13.269521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.271306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:13.464355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:13.473732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af565db9-4f82-4268-8dc9-6830ff2ec91a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.234010 Mar 26 20:58:13.475798 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1251/2694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:13 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:13.493024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b6f1c1fe-dd4a-4e3f-a375-0521ce473d1a tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Calling method '.version_select at 0x7f6e59499ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.751261 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b6f1c1fe-dd4a-4e3f-a375-0521ce473d1a tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf" status: 200 len: 371 microversion: 2.1 time: 0.273260 Mar 26 20:58:13.753491 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1252/2695] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:58:13 2022] GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:13.759622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.760584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:13.769919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.770602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:13.771806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.772995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:13.827242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:13.837922 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03072bd5-4cc8-4ecc-aca9-7032e0cc07b2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 1.011589 Mar 26 20:58:13.847429 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1444/2696] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:12 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:13.847429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:13.847429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:13.857110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.857751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:13.858718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:13.859123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:14.037670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:14.050364 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2d18b07-5332-4fe2-b175-2a02fadfd091 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.295553 Mar 26 20:58:14.050960 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1253/2697] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:13 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:14.059893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-01d4070c-2615-4a0e-81eb-2cb10a40b883 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Calling method '.version_select at 0x7f6e59658310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:14.243882 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-01d4070c-2615-4a0e-81eb-2cb10a40b883 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.187724 Mar 26 20:58:14.244829 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1254/2698] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:58:14 2022] GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf/defaults => generated 371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:14.257022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:14.259437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:14.274615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:14.275285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:14.276458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:14.277032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:14.425267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:14.434419 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-51bc2733-6a06-47db-a776-70db54b0b5e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.594359 Mar 26 20:58:14.436561 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1445/2699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:13 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:14.441640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06f1f9d3-be77-404c-b909-9d68557b0fb4 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Calling method '.version_select at 0x7f6e5ed28af0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:14.538987 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06f1f9d3-be77-404c-b909-9d68557b0fb4 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf" status: 200 len: 371 microversion: 2.1 time: 0.099933 Mar 26 20:58:14.545203 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1446/2700] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:58:14 2022] GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:14.569738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:14.586203 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a23b72c0-2fa3-47a8-adaa-5bd3abe6d447 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 200 len: 1512 microversion: 2.1 time: 0.340179 Mar 26 20:58:14.586902 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1255/2701] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:14 2022] GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:14.595990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f621a5fa-86f4-44cf-bff9-a03c6c245c39 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Calling method '.version_select at 0x7f6e59408ca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:14.633409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfca6b72-b884-4b36-8c4e-6d7caf3aa273 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e58b2a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-558443609", "description": "tempest-description-14436494"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:14.807033 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f621a5fa-86f4-44cf-bff9-a03c6c245c39 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf?user_id=fe29b57bbdb240cfb2db88ee93accd74" status: 200 len: 371 microversion: 2.1 time: 0.219049 Mar 26 20:58:14.807736 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1256/2702] 10.222.0.16 () {58 vars in 1322 bytes} [Sat Mar 26 20:58:14 2022] GET /compute/v2.1/os-quota-sets/6ed5f1700fdf4c55a6bed753ec0072bf?user_id=fe29b57bbdb240cfb2db88ee93accd74 => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:14.854905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:14.856915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:14.867434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:14.868351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:14.869838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:14.870612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.130818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfca6b72-b884-4b36-8c4e-6d7caf3aa273 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.588941 Mar 26 20:58:15.132438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1447/2703] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:14 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:15.136830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8faaac65-4917-43df-8539-4bae56095fef req-12b0de3c-7e1a-4dab-818d-cf0147024690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744ce669-197a-4411-a6c8-31d0efc0e6ea", "name": "network-vif-deleted", "tag": "4e6695aa-f00f-45cf-9e7a-67f47f86a40c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:15.149917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8faaac65-4917-43df-8539-4bae56095fef req-12b0de3c-7e1a-4dab-818d-cf0147024690 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.153113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:15.157184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8faaac65-4917-43df-8539-4bae56095fef req-12b0de3c-7e1a-4dab-818d-cf0147024690 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.169285 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8faaac65-4917-43df-8539-4bae56095fef req-12b0de3c-7e1a-4dab-818d-cf0147024690 service nova] Creating event network-vif-deleted:4e6695aa-f00f-45cf-9e7a-67f47f86a40c for instance 744ce669-197a-4411-a6c8-31d0efc0e6ea on nch2-master-1 Mar 26 20:58:15.175101 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8faaac65-4917-43df-8539-4bae56095fef req-12b0de3c-7e1a-4dab-818d-cf0147024690 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041456 Mar 26 20:58:15.176239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1448/2704] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:15.181941 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5845bcde-c0fc-494b-ac5c-57a9c36b488e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1317 microversion: 2.1 time: 0.330981 Mar 26 20:58:15.183280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:15.184513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:15.185609 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1257/2705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:14 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:15.191613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.192405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.193421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.194820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.204345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6c6b8d0f-5359-48ec-87f6-4680e6dd1915 req-b4833b22-a2ec-4d15-8b37-1b18dfaa8e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098ba7e-07e3-468c-997a-7960ed44729c", "name": "network-vif-deleted", "tag": "a6b3c590-9fed-47ce-b164-f99a99555c05"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:15.225841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6c6b8d0f-5359-48ec-87f6-4680e6dd1915 req-b4833b22-a2ec-4d15-8b37-1b18dfaa8e99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.227716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6c6b8d0f-5359-48ec-87f6-4680e6dd1915 req-b4833b22-a2ec-4d15-8b37-1b18dfaa8e99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.251935 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6c6b8d0f-5359-48ec-87f6-4680e6dd1915 req-b4833b22-a2ec-4d15-8b37-1b18dfaa8e99 service nova] Creating event network-vif-deleted:a6b3c590-9fed-47ce-b164-f99a99555c05 for instance 4098ba7e-07e3-468c-997a-7960ed44729c on nch2-master-1 Mar 26 20:58:15.262851 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6c6b8d0f-5359-48ec-87f6-4680e6dd1915 req-b4833b22-a2ec-4d15-8b37-1b18dfaa8e99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073971 Mar 26 20:58:15.264490 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1258/2706] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:15.279592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b0e3b8d-d03a-43fa-aa73-56e597ed7240 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e59505160>, body: {"security_group_rule": {"parent_group_id": "b5663b1d-c4fa-4ac3-a8a0-546792566a2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:15.477841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:15.489206 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-95372aca-987d-49cc-aed6-1cae50a70393 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.311184 Mar 26 20:58:15.490019 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1449/2707] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:15 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:15.605513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:15.606892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:15.628924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.629664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.632718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.634030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.738482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:15.741868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:15.742423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lazy-loading 'fault' on Instance uuid 4098ba7e-07e3-468c-997a-7960ed44729c {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:15.755979 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b0e3b8d-d03a-43fa-aa73-56e597ed7240 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.489946 Mar 26 20:58:15.757347 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1259/2708] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:15.770743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-877f6ba5-03be-4dd5-8bf7-8f0604bdc670 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e593d99d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-476678972", "description": "tempest-description-439863989"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:15.821625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75cdd0c73bcc473081b65958a7b1fbe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56cae79f846b5b6f3700480cfc811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:15.831111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1477a013-9425-4c21-9eec-7eefe68bff70 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 200 len: 1308 microversion: 2.1 time: 0.231904 Mar 26 20:58:15.844364 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1450/2709] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:15 2022] GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:16.008840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2a360f36-ee8c-40ff-b1ed-caa9010396ad req-91531ef3-6c95-4323-8d2e-741e28e02bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b3ccf8-2570-48db-aa78-3a673c02d3da", "name": "network-vif-plugged", "status": "completed", "tag": "41328fe6-d504-4051-8089-d948e97d3fa2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:16.019804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2a360f36-ee8c-40ff-b1ed-caa9010396ad req-91531ef3-6c95-4323-8d2e-741e28e02bc7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.024490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2a360f36-ee8c-40ff-b1ed-caa9010396ad req-91531ef3-6c95-4323-8d2e-741e28e02bc7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.050752 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2a360f36-ee8c-40ff-b1ed-caa9010396ad req-91531ef3-6c95-4323-8d2e-741e28e02bc7 service nova] Creating event network-vif-plugged:41328fe6-d504-4051-8089-d948e97d3fa2 for instance 62b3ccf8-2570-48db-aa78-3a673c02d3da on nch1-master-1 Mar 26 20:58:16.065016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2a360f36-ee8c-40ff-b1ed-caa9010396ad req-91531ef3-6c95-4323-8d2e-741e28e02bc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Mar 26 20:58:16.067121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1451/2710] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:58:16.199171 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-877f6ba5-03be-4dd5-8bf7-8f0604bdc670 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.434441 Mar 26 20:58:16.200080 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1260/2711] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:16.211161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:16.211717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d19569e9-7b13-45af-9c78-d803e1b436a1 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e594998b0>, body: {"security_group_rule": {"parent_group_id": "8721e849-bfe5-4fc3-9614-c753c5f1d981", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:16.211883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:16.219802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.220644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.222081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.222783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.438036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:16.449689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de6a0f27-83f7-45e2-889c-e2af642142ce tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1465 microversion: 2.1 time: 0.251537 Mar 26 20:58:16.469716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1452/2712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:16 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:16.481317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:16.482143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:16.488897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.489291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.490079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.490520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.492246 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d19569e9-7b13-45af-9c78-d803e1b436a1 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.284899 Mar 26 20:58:16.493204 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1261/2713] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:16.505448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58b79860-d339-4f3c-954b-c658be27f809 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e593d9430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-402695621", "description": "tempest-description-1776324933"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:16.696820 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b99b5066-b22d-47e4-b949-07c64c44d07f tempest-ServersOnMultiNodesTest-1092617530 tempest-ServersOnMultiNodesTest-1092617530-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1616 microversion: 2.1 time: 0.225136 Mar 26 20:58:16.697925 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1453/2714] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:16 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1616 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:16.704447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:16.705170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:16.716529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.717015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.719295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.720522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.750834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58b79860-d339-4f3c-954b-c658be27f809 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.249351 Mar 26 20:58:16.758643 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1262/2715] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:16.763942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:16.764829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:16.777204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.781394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.783768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:16.789294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:16.849022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:16.910912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:16.920965 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2dbee30c-1f8c-4b4a-8af5-cdcc1d2772ca tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1313 microversion: 2.1 time: 0.221080 Mar 26 20:58:16.921832 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1454/2716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:16 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:16.926405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e2b07115-7f5c-4cb3-9b34-f2655c825b90 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e58acc310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1760588779", "description": "tempest-description-1158126087"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:16.987346 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-341b7815-84db-4a04-a3c7-2f9bd15dc740 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 204 len: 0 microversion: 2.1 time: 0.226912 Mar 26 20:58:16.989190 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1263/2717] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:16 2022] DELETE /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:17.000966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:17.002329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 4098ba7e-07e3-468c-997a-7960ed44729c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:17.011844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.014863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.016288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.016756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.035843 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] HTTP exception thrown: Instance 4098ba7e-07e3-468c-997a-7960ed44729c could not be found. Mar 26 20:58:17.036770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Returning 404 to user: Instance 4098ba7e-07e3-468c-997a-7960ed44729c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:17.038562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6f81979-20be-4887-acbd-1d07e1acd808 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c" status: 404 len: 111 microversion: 2.1 time: 0.047258 Mar 26 20:58:17.042526 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1264/2718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:16 2022] GET /compute/v2.1/servers/4098ba7e-07e3-468c-997a-7960ed44729c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:17.048906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:17.049569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:17.058037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.058797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.059805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.060446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.119119 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e2b07115-7f5c-4cb3-9b34-f2655c825b90 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.196180 Mar 26 20:58:17.120214 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1455/2719] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:17.124728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:17.125441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:17.132515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.132967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.133744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.134184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.265867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:17.273858 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-64e7abc8-4b3c-4174-b1c5-35361c5fb206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.230190 Mar 26 20:58:17.281023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:17.285872 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1265/2720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:17 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:17.289265 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8188292f-1a1b-40c6-8742-d1d5311e66f3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1471 microversion: 2.1 time: 0.167986 Mar 26 20:58:17.291262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:17.291841 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1456/2721] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:17 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:17.292050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] [instance: 744ce669-197a-4411-a6c8-31d0efc0e6ea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:17.300779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a837b857-e0f0-4a88-873d-1912c652c36c tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e582f1af0>, body: {"security_group_rule": {"parent_group_id": "9ea15609-fdf4-4d55-a5af-1595e460d625", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "948f9305-4978-40b6-a004-4bdbb1a5b59d"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:17.301642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.302104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.302888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.306333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.325368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] HTTP exception thrown: Instance 744ce669-197a-4411-a6c8-31d0efc0e6ea could not be found. Mar 26 20:58:17.325980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] Returning 404 to user: Instance 744ce669-197a-4411-a6c8-31d0efc0e6ea could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:17.326944 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e9097b71-98af-4452-ac8a-39307251f651 tempest-MultipleCreateTestJSON-973694375 tempest-MultipleCreateTestJSON-973694375-project] 10.222.0.16 "GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea" status: 404 len: 111 microversion: 2.1 time: 0.039933 Mar 26 20:58:17.327997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1266/2722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:17 2022] GET /compute/v2.1/servers/744ce669-197a-4411-a6c8-31d0efc0e6ea => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:17.332602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:17.333443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:17.392046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.392046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.392046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:17.392046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:17.710397 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a837b857-e0f0-4a88-873d-1912c652c36c tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.415030 Mar 26 20:58:17.718341 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1457/2723] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:17.972660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68e1ec3e-6e02-4916-849d-1548d81ffc4c tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e5933a160>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:17.982509 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-68e1ec3e-6e02-4916-849d-1548d81ffc4c tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Mar 26 20:58:17.983114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68e1ec3e-6e02-4916-849d-1548d81ffc4c tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:17.983986 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68e1ec3e-6e02-4916-849d-1548d81ffc4c tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.264174 Mar 26 20:58:17.984859 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1458/2724] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:58:17 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:17.992187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:17.994076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7491b695-1ca4-4c79-9380-2bea04bcd6e6 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e59aec3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-678925446", "description": "tempest-description-2026463416"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:18.007271 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c944576b-0ce9-438a-80a2-5dcb688d4759 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.677809 Mar 26 20:58:18.008118 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1267/2725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:17 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:18.016271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:18.020700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:18.031774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.032675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.034404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.035048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.233256 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7491b695-1ca4-4c79-9380-2bea04bcd6e6 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.246255 Mar 26 20:58:18.234720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1459/2726] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:18.248556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e596fa8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-935703779", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:18.270811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:18.278539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:18.304458 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 26 20:58:18.306485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:18.307570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94c57c53-f348-40ae-8a5f-f95fdb86a15b tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071510 Mar 26 20:58:18.308312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1460/2727] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Mar 26 20:58:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:18.316867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:18.317701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:18.325042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.325494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.326268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.326707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.371797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:18.384263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-39e1f4b8-8bd8-4b5b-8a85-2910e8719f2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1499 microversion: 2.1 time: 0.370654 Mar 26 20:58:18.385489 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1268/2728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:18 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1499 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:18.391795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8d357808-ac48-4937-a1ba-7b4dc8b61174 req-28d363a2-d414-4fc7-9d03-6aa9203c146d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-unplugged", "status": "completed", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:18.405953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8d357808-ac48-4937-a1ba-7b4dc8b61174 req-28d363a2-d414-4fc7-9d03-6aa9203c146d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.406721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8d357808-ac48-4937-a1ba-7b4dc8b61174 req-28d363a2-d414-4fc7-9d03-6aa9203c146d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.422271 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8d357808-ac48-4937-a1ba-7b4dc8b61174 req-28d363a2-d414-4fc7-9d03-6aa9203c146d service nova] Creating event network-vif-unplugged:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 20:58:18.428973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8d357808-ac48-4937-a1ba-7b4dc8b61174 req-28d363a2-d414-4fc7-9d03-6aa9203c146d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041465 Mar 26 20:58:18.433918 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1269/2729] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:18.442035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc22260d-9c03-4f28-b941-c9d9b013bed0 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e596a0670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-489151510", "description": "tempest-description-664256217"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:18.703002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:18.713080 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b0fedf4-eb6c-4e15-b57d-0ab6b72895ad tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.403237 Mar 26 20:58:18.723648 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1461/2730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:18 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:18.723648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:18.723648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:18.738912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.739393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.741070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:18.742570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:18.855951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc22260d-9c03-4f28-b941-c9d9b013bed0 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.417892 Mar 26 20:58:18.863660 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1270/2731] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:18.865349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e59d48f70>, body: {"keypair": {"name": "tempest-keypair-474766146"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:18.901337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:18.909279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:19.089693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:19.111292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7199180-5bbf-473e-950a-69163b9377d2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 200 len: 1471 microversion: 2.1 time: 0.395622 Mar 26 20:58:19.113174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1462/2732] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:18 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 1471 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:19.134020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:19.138261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:19.149596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:19.150060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:19.150908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:19.151353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:19.184973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lazy-loading 'flavor' on Instance uuid 62b3ccf8-2570-48db-aa78-3a673c02d3da {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:19.415220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:19.424539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:19.451383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c77ac9a6-763f-4cdc-8e89-32fa71901310 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.591328 Mar 26 20:58:19.452022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1271/2733] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:58:18 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:19.462086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:19.463254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:19.487750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:19.488561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:19.489624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:19.492977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:19.562646 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69f18511-a1c6-4459-935f-fe8d9ee2f7fc tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "POST /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da/action" status: 200 len: 32 microversion: 2.1 time: 0.445823 Mar 26 20:58:19.570811 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1463/2734] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:58:19 2022] POST /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:58:19.585773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39a58195-ed68-4984-b58d-0546b1a812bb tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e5937e940>, body: {"security_group_rule": {"parent_group_id": "99101237-b77d-40d4-b9dd-fab098f7956c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8ad621ea-c4c9-4fd2-bdb6-917ab3684961"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:19.677430 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bf66bd19-7950-40bf-ad04-ff0902ff50d3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.223440 Mar 26 20:58:19.682149 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1272/2735] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:58:19 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:19.693686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e5967f160>, body: {"keypair": {"name": "tempest-keypair-474766146"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:19.736080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:19.748054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:19.907297 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Key pair 'tempest-keypair-474766146' already exists. Mar 26 20:58:19.908548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 409 to user: Key pair 'tempest-keypair-474766146' already exists. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:19.909138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5bd0949b-261c-40c0-8cdd-482e1c01b63d tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.221298 Mar 26 20:58:19.910466 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1273/2736] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:58:19 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 223 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:58:19.923154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f3b3e473-fda4-4907-a6e2-a8cdecf918a2 req-e9d49627-7d16-4f86-8103-6ed4a3c17dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bfa695-99d2-471f-8920-4a76bb8af593", "name": "network-vif-deleted", "tag": "fbf0f9fa-1caf-456e-b3b7-a9bc64217a12"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:19.940995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f3b3e473-fda4-4907-a6e2-a8cdecf918a2 req-e9d49627-7d16-4f86-8103-6ed4a3c17dce service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:19.946896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f3b3e473-fda4-4907-a6e2-a8cdecf918a2 req-e9d49627-7d16-4f86-8103-6ed4a3c17dce service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:19.968209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f3b3e473-fda4-4907-a6e2-a8cdecf918a2 req-e9d49627-7d16-4f86-8103-6ed4a3c17dce service nova] Creating event network-vif-deleted:fbf0f9fa-1caf-456e-b3b7-a9bc64217a12 for instance c3bfa695-99d2-471f-8920-4a76bb8af593 on nch2-master-1 Mar 26 20:58:19.978993 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f3b3e473-fda4-4907-a6e2-a8cdecf918a2 req-e9d49627-7d16-4f86-8103-6ed4a3c17dce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066948 Mar 26 20:58:19.980677 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1274/2737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:19.988082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:19.993185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:20.008822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.009354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.010218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.010714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.401278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39a58195-ed68-4984-b58d-0546b1a812bb tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.829017 Mar 26 20:58:20.408915 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1464/2738] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:20.415089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:20.416252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:20.431607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.432619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.433822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.434536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.733886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:20.741982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:20.749825 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-81ffad95-d661-499f-9b6a-a44d55b458aa tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1672 microversion: 2.1 time: 0.339531 Mar 26 20:58:20.749935 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6137e71d-784d-4383-81bd-ad7949878955 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.765407 Mar 26 20:58:20.760167 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1275/2739] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:19 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:20.760246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1465/2740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:20 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1672 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:20.760246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:20.760796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c3bfa695-99d2-471f-8920-4a76bb8af593] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:20.768118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e84fcaf8-2365-4db0-9685-9de1544eaaa8 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Calling method '.version_select at 0x7f6e5904b700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:20.777328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.777788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.778701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.779945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.799378 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance c3bfa695-99d2-471f-8920-4a76bb8af593 could not be found. Mar 26 20:58:20.800015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance c3bfa695-99d2-471f-8920-4a76bb8af593 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:20.800859 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2f0f6ee-6ac7-4fee-8107-8914bd60b238 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593" status: 404 len: 111 microversion: 2.1 time: 0.046608 Mar 26 20:58:20.801414 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1466/2741] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:20 2022] GET /compute/v2.1/servers/c3bfa695-99d2-471f-8920-4a76bb8af593 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:20.823586 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e84fcaf8-2365-4db0-9685-9de1544eaaa8 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474766146" status: 202 len: 0 microversion: 2.1 time: 0.069160 Mar 26 20:58:20.824511 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1276/2742] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 20:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474766146 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:20.829428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31fa160e-4cdc-4a9a-bdf6-5d4820a01eaa tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e58b2a8b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:20.849572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:20.851258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:20.868290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.871733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.873619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:20.874874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:20.937102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:21.056666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4eabe89a-4f9d-408a-9023-db75c42c8c81 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 204 len: 0 microversion: 2.1 time: 0.230786 Mar 26 20:58:21.058295 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1277/2743] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:20 2022] DELETE /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:21.065760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ea979b5-6047-42a8-af4d-ea5bd07f3aef tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e5ebf03a0>, body: {"keypair": {"name": ""}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.067226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ea979b5-6047-42a8-af4d-ea5bd07f3aef tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:21.068261 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ea979b5-6047-42a8-af4d-ea5bd07f3aef tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008360 Mar 26 20:58:21.069653 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1278/2744] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:21.075143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:21.076202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:21.085237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:21.087363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:21.092698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:21.094702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:21.233792 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31fa160e-4cdc-4a9a-bdf6-5d4820a01eaa tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8ad621ea-c4c9-4fd2-bdb6-917ab3684961" status: 202 len: 0 microversion: 2.1 time: 0.431341 Mar 26 20:58:21.237878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1467/2745] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:20 2022] DELETE /compute/v2.1/os-security-groups/8ad621ea-c4c9-4fd2-bdb6-917ab3684961 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:21.243991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e582b1700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1328267736", "public_key": " "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.263035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:21.270411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:21.296697 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 26 20:58:21.297287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:21.298263 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7869963-5e2b-45b3-854a-5436428e4967 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.059154 Mar 26 20:58:21.299125 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1468/2746] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:21.304675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b85bed2c-b827-4ef8-b63c-6ee086b1b1c8 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e582b1a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:21.367560 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b85bed2c-b827-4ef8-b63c-6ee086b1b1c8 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/99101237-b77d-40d4-b9dd-fab098f7956c" status: 200 len: 247 microversion: 2.1 time: 0.067384 Mar 26 20:58:21.374772 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1469/2747] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:58:21 2022] GET /compute/v2.1/os-security-groups/99101237-b77d-40d4-b9dd-fab098f7956c => generated 247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:21.380167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27422a77-722c-45e8-814b-d1164161975f tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e58b2ae50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.383329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27422a77-722c-45e8-814b-d1164161975f tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:21.384280 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27422a77-722c-45e8-814b-d1164161975f tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014726 Mar 26 20:58:21.390915 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1470/2748] 10.222.0.16 () {60 vars in 1158 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:21.393540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4b272bf-3577-4ce8-8a5c-cae566731e5e tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e5958e790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1473585425", "description": "tempest-description-1853035359"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.614512 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4b272bf-3577-4ce8-8a5c-cae566731e5e tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.227411 Mar 26 20:58:21.616591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1471/2749] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:21.621911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Action: 'create', calling method: .version_select at 0x7f6e58b2a8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1778096958", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.638069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:21.644094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Getting quotas for user 0c30a9434cd34f4a92ec3657d9cbbc4f and project 23327f0f8a7b433b884f61312794cfeb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:21.666551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 26 20:58:21.667157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:21.668248 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-870594e4-73d2-4a4b-921d-1e16f4cd4974 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.050457 Mar 26 20:58:21.668982 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1472/2750] 10.222.0.16 () {60 vars in 1158 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:21.677831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a035d72-2e43-46da-92be-f8d62c5d6d81 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e5824c280>, body: {"security_group_rule": {"parent_group_id": "a367c5e4-d162-4627-8035-02e319b2aa20", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:21.679295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:21.688268 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd2ec6b1-420d-4218-ae01-587092c8d938 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1473 microversion: 2.1 time: 0.617384 Mar 26 20:58:21.698456 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1279/2751] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:21 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1473 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:21.703498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a47edc80-1700-4b43-946d-5ae40c8d6c60 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Calling method '.version_select at 0x7f6e5ebf03a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:21.715209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a47edc80-1700-4b43-946d-5ae40c8d6c60 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1270620641 not found for user 0c30a9434cd34f4a92ec3657d9cbbc4f Mar 26 20:58:21.716058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a47edc80-1700-4b43-946d-5ae40c8d6c60 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1270620641 not found for user 0c30a9434cd34f4a92ec3657d9cbbc4f {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:21.717027 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a47edc80-1700-4b43-946d-5ae40c8d6c60 tempest-KeyPairsNegativeTestJSON-366585973 tempest-KeyPairsNegativeTestJSON-366585973-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1270620641" status: 404 len: 145 microversion: 2.1 time: 0.017541 Mar 26 20:58:21.718029 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1280/2752] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 20:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1270620641 => generated 145 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:21.792433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:21.793777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:21.809425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:21.816209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:21.817179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:21.817644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:22.095469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a035d72-2e43-46da-92be-f8d62c5d6d81 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.425315 Mar 26 20:58:22.096424 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1473/2753] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:22.101670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:22.102453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:22.117853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:22.118545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:22.119500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:22.120120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:22.217085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:22.225857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15dd3b82-be68-4247-a39a-142602ef52f0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.447238 Mar 26 20:58:22.226350 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1281/2754] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:21 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:22.241702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-037970d5-e35e-4c96-922e-5ce2bccd557d tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Action: 'create', calling method: .version_select at 0x7f6e59e15f70>, body: {"security_group_rule": {"parent_group_id": "a367c5e4-d162-4627-8035-02e319b2aa20", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:22.816241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:22.826358 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-200bd579-11aa-40f1-bc5b-db8038cf0a17 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.728673 Mar 26 20:58:22.827330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1474/2755] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:22 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:22.844843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:22.846546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:22.855126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:22.855522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:22.856833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:22.857876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.179586 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-037970d5-e35e-4c96-922e-5ce2bccd557d tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.946812 Mar 26 20:58:23.180545 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1282/2756] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:22 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:23.185225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:23.186246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:23.199836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.200316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.207041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.207747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.266113 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06ed1493-538d-40e5-8efd-557d0ee4a959 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 200 len: 202 microversion: 2.1 time: 0.437285 Mar 26 20:58:23.268695 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1475/2757] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:58:22 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 202 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:23.289041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d0a10cb-8ebe-4431-930b-51c69ed75bfc tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e5940d790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:23.468876 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d0a10cb-8ebe-4431-930b-51c69ed75bfc tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a367c5e4-d162-4627-8035-02e319b2aa20" status: 200 len: 665 microversion: 2.1 time: 0.198808 Mar 26 20:58:23.469664 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1476/2758] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:58:23 2022] GET /compute/v2.1/os-security-groups/a367c5e4-d162-4627-8035-02e319b2aa20 => generated 665 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:23.480738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:23.481499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:23.495814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.496313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.497148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.497626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.732948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:23.753605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-72193be4-a84f-4575-ba7c-6f07430e2507 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1473 microversion: 2.1 time: 0.571862 Mar 26 20:58:23.763793 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1283/2759] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:23 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1473 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:23.763793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e1f9e17-59cf-4fe9-9e7c-83d17efdcb7b tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e59397790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:23.883067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:23.899529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a720bc22-bfa8-4d0e-a37c-7bed37428ff9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.425730 Mar 26 20:58:23.903382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1477/2760] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:23 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:23.918160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:23.920820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:23.937778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.938177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:23.938992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:23.939447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:24.380766 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e1f9e17-59cf-4fe9-9e7c-83d17efdcb7b tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/d131c7b1-6956-45ab-b189-2af2d249258d" status: 202 len: 0 microversion: 2.1 time: 0.624678 Mar 26 20:58:24.385781 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1284/2761] 10.222.0.16 () {58 vars in 1286 bytes} [Sat Mar 26 20:58:23 2022] DELETE /compute/v2.1/os-security-group-rules/d131c7b1-6956-45ab-b189-2af2d249258d => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:24.392107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:24.392769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:24.403233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:24.403894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:24.404872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:24.405453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:24.849653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:24.882567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-867a47b7-eb15-4390-a18c-933e890f85f3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.970940 Mar 26 20:58:24.885934 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1478/2762] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:23 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:24.897558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d354fa6-e904-4d99-aee3-2d8f76e4147d tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e582b1ca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:25.019078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:25.029165 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-34431fa9-250e-45a9-9dc0-79c4a501a164 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.642292 Mar 26 20:58:25.029753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1285/2763] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:24 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:25.060668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:25.063658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:25.094928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.095756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.096721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.098469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.249284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.250184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.252536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lazy-loading 'fault' on Instance uuid e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:25.490159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:25.500658 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-89a8b1e0-f0ec-45d8-8093-781eb2efc3e4 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 200 len: 1307 microversion: 2.1 time: 0.457143 Mar 26 20:58:25.501432 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1286/2764] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:25 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:25.525647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9b607ce0-b3b6-42b8-9a90-6a168af68edf req-f3655750-5b55-4ff7-823a-cf650383a3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2bfcb66-1cd1-45a8-bae4-b25cf4240d78", "name": "network-vif-deleted", "tag": "13e6f963-1ad1-433a-9c38-29a63ba6f2c3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:25.556452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9b607ce0-b3b6-42b8-9a90-6a168af68edf req-f3655750-5b55-4ff7-823a-cf650383a3c8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.557532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9b607ce0-b3b6-42b8-9a90-6a168af68edf req-f3655750-5b55-4ff7-823a-cf650383a3c8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.600604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9b607ce0-b3b6-42b8-9a90-6a168af68edf req-f3655750-5b55-4ff7-823a-cf650383a3c8 service nova] Creating event network-vif-deleted:13e6f963-1ad1-433a-9c38-29a63ba6f2c3 for instance e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 on nch1-master-1 Mar 26 20:58:25.618614 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9b607ce0-b3b6-42b8-9a90-6a168af68edf req-f3655750-5b55-4ff7-823a-cf650383a3c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110799 Mar 26 20:58:25.621472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1287/2765] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:25.633188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:25.636410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:25.657141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.657856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.658788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.659401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.805029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d354fa6-e904-4d99-aee3-2d8f76e4147d tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a367c5e4-d162-4627-8035-02e319b2aa20" status: 202 len: 0 microversion: 2.1 time: 0.917494 Mar 26 20:58:25.806324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1479/2766] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:24 2022] DELETE /compute/v2.1/os-security-groups/a367c5e4-d162-4627-8035-02e319b2aa20 => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:25.816527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e58a55940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:25.903237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8ad621ea-c4c9-4fd2-bdb6-917ab3684961 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:58:25.904090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Neutron security group 8ad621ea-c4c9-4fd2-bdb6-917ab3684961 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:58:25.904634 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] HTTP exception thrown: Security group 8ad621ea-c4c9-4fd2-bdb6-917ab3684961 does not exist Mar 26 20:58:25.904634 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-b1d2cac8-8592-4bda-9294-b73613f9d609'] Mar 26 20:58:25.905242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Returning 404 to user: Security group 8ad621ea-c4c9-4fd2-bdb6-917ab3684961 does not exist Mar 26 20:58:25.905242 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-b1d2cac8-8592-4bda-9294-b73613f9d609'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:25.906939 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0cfc32bb-0869-4377-b361-69f1c0ab1b02 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8ad621ea-c4c9-4fd2-bdb6-917ab3684961" status: 404 len: 194 microversion: 2.1 time: 0.095858 Mar 26 20:58:25.907141 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1480/2767] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:25 2022] DELETE /compute/v2.1/os-security-groups/8ad621ea-c4c9-4fd2-bdb6-917ab3684961 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:25.920061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:25.921038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:25.934107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.934578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:25.935425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:25.935880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.262876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:26.269373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:26.277117 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-01b82fc8-43ce-4e26-ab59-ed3c5b627b09 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.654256 Mar 26 20:58:26.281705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17de70e0-1444-4540-a79a-5f45a3464252 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.373542 Mar 26 20:58:26.282295 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1481/2768] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:25 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:26.296988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5499d5ca-f617-4495-b822-e18473834aba tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e593ae310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:26.305397 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1288/2769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:25 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:26.310565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:26.317678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:26.333630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.335940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.337010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.340579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.713266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:26.726028 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e160bbe5-f016-45d0-8538-268cc3d21de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.418975 Mar 26 20:58:26.726860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1289/2770] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:26 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:26.769630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:26.770270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e2bfcb66-1cd1-45a8-bae4-b25cf4240d78] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:26.792214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.792716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.792912 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5499d5ca-f617-4495-b822-e18473834aba tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/99101237-b77d-40d4-b9dd-fab098f7956c" status: 202 len: 0 microversion: 2.1 time: 0.499013 Mar 26 20:58:26.793512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.793952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.794375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1482/2771] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:26 2022] DELETE /compute/v2.1/os-security-groups/99101237-b77d-40d4-b9dd-fab098f7956c => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:26.804233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44bc6f8f-d3fc-487c-928b-cb1cc0e2a22e tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e5938cca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:26.845054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 could not be found. Mar 26 20:58:26.845680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:26.846539 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19daa267-a2a2-4bb3-b263-3928f2b2acda tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78" status: 404 len: 111 microversion: 2.1 time: 0.103724 Mar 26 20:58:26.847111 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1290/2772] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:26 2022] GET /compute/v2.1/servers/e2bfcb66-1cd1-45a8-bae4-b25cf4240d78 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:26.875582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:26.879772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:26.896543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.897792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.899878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:26.901310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:26.955807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:27.120426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8200283f-c314-48ad-8495-54c3aabe6886 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 204 len: 0 microversion: 2.1 time: 0.260752 Mar 26 20:58:27.121164 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1291/2773] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:26 2022] DELETE /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:27.139813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1215130144", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:27.241906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] validate_networks() for [('30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:58:27.657630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44bc6f8f-d3fc-487c-928b-cb1cc0e2a22e tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/948f9305-4978-40b6-a004-4bdbb1a5b59d" status: 202 len: 0 microversion: 2.1 time: 0.858812 Mar 26 20:58:27.659572 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1483/2774] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:26 2022] DELETE /compute/v2.1/os-security-groups/948f9305-4978-40b6-a004-4bdbb1a5b59d => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:27.665766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:27.666658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:27.700312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:27.702679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:27.703747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:27.706070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:28.093052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:28.126506 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6657b58c-33a9-4d4a-9915-fa1d129b47f6 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1471 microversion: 2.1 time: 0.462296 Mar 26 20:58:28.128008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1484/2775] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:27 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1471 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:28.135482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:28.136137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:28.157990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:28.158899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:28.159954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:28.161389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:28.295102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:58:28.295577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:58:28.296050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:58:28.296477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:58:28.296901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:58:28.312543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:28.314523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:28.318525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:28.320244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:28.400916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:28.420423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:28.442380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:58:28.445419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:58:28.458592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:28.475620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0d4d2b5-aef7-4e51-be22-b7f04d33534d tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.346076 Mar 26 20:58:28.480021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1485/2776] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:28 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:28.489020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7be7796b-2f87-410d-9ce6-3fb65f4f9c07 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e5937e550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:28.573806 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-326b1c59-1dbe-4d78-9f7c-da797347cd62 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449859 Mar 26 20:58:28.574396 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1292/2777] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:58:29.265170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7be7796b-2f87-410d-9ce6-3fb65f4f9c07 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9ea15609-fdf4-4d55-a5af-1595e460d625" status: 202 len: 0 microversion: 2.1 time: 0.783633 Mar 26 20:58:29.267012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1486/2778] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:28 2022] DELETE /compute/v2.1/os-security-groups/9ea15609-fdf4-4d55-a5af-1595e460d625 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:29.272549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b80d8227-9664-4cfa-98ea-01e9a5c347b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:29.273739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b80d8227-9664-4cfa-98ea-01e9a5c347b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:29.282069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31327f14-9ea2-4f5c-9278-6c602219b58d tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e596a8ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-780417175", "description": "tempest-description-1409536671"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:29.408639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b80d8227-9664-4cfa-98ea-01e9a5c347b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:29.432323 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b80d8227-9664-4cfa-98ea-01e9a5c347b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1215 microversion: 2.1 time: 0.163022 Mar 26 20:58:29.434558 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1487/2779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:29 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:29.441569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:29.442529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:29.455383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:29.456661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:29.463950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:29.465060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:29.811293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:29.821872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d8031b6-6b6f-4130-b34a-859d42c5c0c9 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 200 len: 1471 microversion: 2.1 time: 0.385946 Mar 26 20:58:29.823419 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1488/2780] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:29 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:29.829438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d157596-3ea5-423c-8d69-3fe7cd91e34f tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e594ea4c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:30.092965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31327f14-9ea2-4f5c-9278-6c602219b58d tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.508235 Mar 26 20:58:30.099146 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1293/2781] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:30.105859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:30.117140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:30.141964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:30.144512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:30.145590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:30.148097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:30.657715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:30.676869 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ecccb298-c819-4f5a-b3b3-38df85cfa415 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.574569 Mar 26 20:58:30.679116 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1294/2782] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:30 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:30.700342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3e4c65f-fca2-4646-9ca2-3b02b473e88e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e593a1820>, body: {"security_group_rule": {"parent_group_id": "97ac834a-74b4-492d-bfcc-735cc35bf7f1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:31.148590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3e4c65f-fca2-4646-9ca2-3b02b473e88e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.466205 Mar 26 20:58:31.151420 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1295/2783] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:31.158413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1e2a9a19-8c4b-4de5-9b6c-9d2c45a259e0 req-ba15138f-8c11-4134-9031-486f5f7ffb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b90cee9-9904-41f7-95a5-d6ed889e27ed", "name": "network-vif-deleted", "tag": "aa18c074-3c50-4a11-9055-0c0910e8dd41"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:31.179223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1e2a9a19-8c4b-4de5-9b6c-9d2c45a259e0 req-ba15138f-8c11-4134-9031-486f5f7ffb8e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.180707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1e2a9a19-8c4b-4de5-9b6c-9d2c45a259e0 req-ba15138f-8c11-4134-9031-486f5f7ffb8e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.207465 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1e2a9a19-8c4b-4de5-9b6c-9d2c45a259e0 req-ba15138f-8c11-4134-9031-486f5f7ffb8e service nova] Creating event network-vif-deleted:aa18c074-3c50-4a11-9055-0c0910e8dd41 for instance 5b90cee9-9904-41f7-95a5-d6ed889e27ed on nch1-master-1 Mar 26 20:58:31.216043 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1e2a9a19-8c4b-4de5-9b6c-9d2c45a259e0 req-ba15138f-8c11-4134-9031-486f5f7ffb8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062680 Mar 26 20:58:31.217630 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1296/2784] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:31.224306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:31.225567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:31.236455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.237150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.239319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.239781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.410375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d157596-3ea5-423c-8d69-3fe7cd91e34f tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8721e849-bfe5-4fc3-9614-c753c5f1d981" status: 202 len: 0 microversion: 2.1 time: 1.580926 Mar 26 20:58:31.413472 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1489/2785] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:29 2022] DELETE /compute/v2.1/os-security-groups/8721e849-bfe5-4fc3-9614-c753c5f1d981 => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:31.430897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:31.434012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 5b90cee9-9904-41f7-95a5-d6ed889e27ed] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:31.463500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.464955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.466450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.471263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.500126 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance 5b90cee9-9904-41f7-95a5-d6ed889e27ed could not be found. Mar 26 20:58:31.507344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance 5b90cee9-9904-41f7-95a5-d6ed889e27ed could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:31.509569 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9e8152e-9c3f-48f8-8670-3c223acbe76a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed" status: 404 len: 111 microversion: 2.1 time: 0.093103 Mar 26 20:58:31.510569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1490/2786] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:31 2022] GET /compute/v2.1/servers/5b90cee9-9904-41f7-95a5-d6ed889e27ed => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:31.520274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed4085a2-2d9a-401b-98d0-e75bc20fd6a0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e594df9d0>, body: {"security_group_rule": {"parent_group_id": "97ac834a-74b4-492d-bfcc-735cc35bf7f1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:31.676983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ed4085a2-2d9a-401b-98d0-e75bc20fd6a0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: This rule already exists in group 97ac834a-74b4-492d-bfcc-735cc35bf7f1 Mar 26 20:58:31.677602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed4085a2-2d9a-401b-98d0-e75bc20fd6a0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: This rule already exists in group 97ac834a-74b4-492d-bfcc-735cc35bf7f1 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:31.697088 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ed4085a2-2d9a-401b-98d0-e75bc20fd6a0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.181989 Mar 26 20:58:31.700385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1491/2787] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:31 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:31.729485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:31.737500 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73c13f66-5acb-4813-ab60-598c324ff7db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1273 microversion: 2.1 time: 0.517957 Mar 26 20:58:31.741307 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1297/2788] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:31 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:31.746204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:31.746716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:31.748751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b98ac29c-36e0-40df-add1-3eef35bdfb67 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] Calling method '.version_select at 0x7f6e594ea820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:31.762018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.762522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.763313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.763759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:31.828546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:31.978443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e52a10e0-e41e-4fd6-a365-23083e21171e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e" status: 204 len: 0 microversion: 2.1 time: 0.232506 Mar 26 20:58:31.979568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1298/2789] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:31 2022] DELETE /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:31.985422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:31.986235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:31.994996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:31.995591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:32.006448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:32.007269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:32.351010 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b98ac29c-36e0-40df-add1-3eef35bdfb67 tempest-SecurityGroupRulesTestJSON-334072206 tempest-SecurityGroupRulesTestJSON-334072206-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b5663b1d-c4fa-4ac3-a8a0-546792566a2c" status: 202 len: 0 microversion: 2.1 time: 0.647836 Mar 26 20:58:32.356664 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1492/2790] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:31 2022] DELETE /compute/v2.1/os-security-groups/b5663b1d-c4fa-4ac3-a8a0-546792566a2c => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:32.364758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-903b1c46-9820-471a-a8d0-a2593edb2960 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e594df9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:32.425748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:32.438631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0dc4c1f2-715c-4505-8cd2-898b0981b4bd tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.457297 Mar 26 20:58:32.439788 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1299/2791] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:31 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:32.734201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1016836625", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:32.738472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-903b1c46-9820-471a-a8d0-a2593edb2960 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/0ea81467-5d0e-4e54-af5b-d142fd672c2f" status: 202 len: 0 microversion: 2.1 time: 0.380428 Mar 26 20:58:32.739772 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1493/2792] 10.222.0.16 () {58 vars in 1286 bytes} [Sat Mar 26 20:58:32 2022] DELETE /compute/v2.1/os-security-group-rules/0ea81467-5d0e-4e54-af5b-d142fd672c2f => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:32.744866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:32.745511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:32.775801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:32.778189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:32.783152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:32.785837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:32.831860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] validate_networks() for [('774ec06c-09d0-4daf-abd3-72e75f21ab7d', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:58:32.849650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:32.984930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a89d19b-ad79-468f-9220-7f69ccfde689 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 204 len: 0 microversion: 2.1 time: 0.243250 Mar 26 20:58:32.985778 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1494/2793] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:32 2022] DELETE /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:33.001086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bffa97d9-4e79-462d-bb90-58842b31d8a6 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e58a55550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-638075355", "description": "tempest-description-319450878"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:33.466941 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bffa97d9-4e79-462d-bb90-58842b31d8a6 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.476315 Mar 26 20:58:33.468216 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1495/2794] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:33.480358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:33.481550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:33.502067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:33.505741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:33.514375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:33.518663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:33.820211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:58:33.821893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:58:33.822784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:58:33.824140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:58:33.824910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:58:33.836617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:33.837653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:33.839600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:33.840272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:33.873571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:33.883521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for user 3cb495ec547743d38a7502110a166b1a and project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:33.919752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:58:33.924751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:58:33.998973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c533b819-80fd-4d7b-ba4d-e39f54f5aa69 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.556954 Mar 26 20:58:34.000485 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1300/2795] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:58:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:58:34.031650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:34.033237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:34.056253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.057022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.058468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.059028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.268308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:34.280928 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-441afdef-e45f-48d2-8bd9-493a2666df36 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 0.810009 Mar 26 20:58:34.283085 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1496/2796] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:33 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:34.294000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:34.299349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:34.313897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.317835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.320349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.321464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.770431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:34.780480 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0b2b910-ca37-4b72-a61a-e0a30711490e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.494201 Mar 26 20:58:34.783244 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1497/2797] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:34 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:34.795377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f32800c8-a3f1-4742-a93e-0902d4de15d4 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e596fa160>, body: {"security_group_rule": {"parent_group_id": "360ea0b7-a38e-4e85-b5eb-31513aa1f776", "ip_protocol": "tcp", "from_port": 757486978, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:34.841848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:34.857280 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed703390-c2b5-465d-9136-63b65d9c7332 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e" status: 200 len: 1473 microversion: 2.1 time: 0.849588 Mar 26 20:58:34.857888 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1301/2798] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:34 2022] GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e => generated 1473 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:34.890356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4fac07d0-88c2-4e9a-b101-84ba662e40f6 req-ef3f5439-0669-42c2-a266-a68fa6dfd1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9520886e-3914-4f48-a3dd-ab467f45feff", "tag": "70a83fdf-b383-49e1-962f-77e816017e97"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:34.918489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4fac07d0-88c2-4e9a-b101-84ba662e40f6 req-ef3f5439-0669-42c2-a266-a68fa6dfd1ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.919126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4fac07d0-88c2-4e9a-b101-84ba662e40f6 req-ef3f5439-0669-42c2-a266-a68fa6dfd1ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.943751 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4fac07d0-88c2-4e9a-b101-84ba662e40f6 req-ef3f5439-0669-42c2-a266-a68fa6dfd1ed service nova] Creating event network-changed:70a83fdf-b383-49e1-962f-77e816017e97 for instance 9520886e-3914-4f48-a3dd-ab467f45feff on nch2-master-1 Mar 26 20:58:34.949132 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4fac07d0-88c2-4e9a-b101-84ba662e40f6 req-ef3f5439-0669-42c2-a266-a68fa6dfd1ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078298 Mar 26 20:58:34.951743 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1302/2799] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:34.959206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:34.960307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:34.967218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.967946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:34.968908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:34.969983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:35.028438 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f32800c8-a3f1-4742-a93e-0902d4de15d4 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Invalid port range 757486978:22. Former value cannot be greater than the later Mar 26 20:58:35.028624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f32800c8-a3f1-4742-a93e-0902d4de15d4 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: Invalid port range 757486978:22. Former value cannot be greater than the later {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:35.029473 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f32800c8-a3f1-4742-a93e-0902d4de15d4 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.243866 Mar 26 20:58:35.030048 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1498/2800] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:34 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:35.040838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d108bdd9-b84a-42f3-9cc5-1654564db929 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e594ea670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-964222802", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:35.042730 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d108bdd9-b84a-42f3-9cc5-1654564db929 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Security group id should be uuid Mar 26 20:58:35.043368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d108bdd9-b84a-42f3-9cc5-1654564db929 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: Security group id should be uuid {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:35.044220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d108bdd9-b84a-42f3-9cc5-1654564db929 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008298 Mar 26 20:58:35.046689 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1499/2801] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:35 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:35.061273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7af90265-2d84-47f5-8cef-390489f3e590 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e595e7670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-638904712", "description": "tempest-description-1666012859"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:35.164065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:35.176355 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a86dba59-fc1b-4288-8523-ff995baeeb71 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1226 microversion: 2.1 time: 0.223202 Mar 26 20:58:35.176938 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1303/2802] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:34 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1226 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:35.305211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:35.306767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:35.321991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:35.325773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:35.326872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:35.328495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:35.377186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7af90265-2d84-47f5-8cef-390489f3e590 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.325944 Mar 26 20:58:35.378152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1500/2803] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:35.391021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-014806a1-af5e-4246-bda2-20fa99333950 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e5958e0d0>, body: {"security_group_rule": {"parent_group_id": "00fd64ce-c058-452f-83f9-17ec17bdfb9f", "ip_protocol": "tempest-999-1697693636", "from_port": 22, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:35.639638 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-014806a1-af5e-4246-bda2-20fa99333950 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Invalid IP protocol tempest-999-1697693636. Mar 26 20:58:35.640292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-014806a1-af5e-4246-bda2-20fa99333950 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: Invalid IP protocol tempest-999-1697693636. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:35.641220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-014806a1-af5e-4246-bda2-20fa99333950 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.256032 Mar 26 20:58:35.642174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1501/2804] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:35 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:35.648075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-667a6fd7-5b96-47ff-a84f-666a50de6333 req-ac336766-23be-4613-a9df-65aea047a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df72bb8-2c08-42da-b528-003cdaec7d4e", "name": "network-vif-deleted", "tag": "2393d24c-c12f-4ced-b0e6-3cc4d6bcca51"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:35.686810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-667a6fd7-5b96-47ff-a84f-666a50de6333 req-ac336766-23be-4613-a9df-65aea047a5ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:35.691810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-667a6fd7-5b96-47ff-a84f-666a50de6333 req-ac336766-23be-4613-a9df-65aea047a5ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:35.719210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-667a6fd7-5b96-47ff-a84f-666a50de6333 req-ac336766-23be-4613-a9df-65aea047a5ba service nova] Creating event network-vif-deleted:2393d24c-c12f-4ced-b0e6-3cc4d6bcca51 for instance 0df72bb8-2c08-42da-b528-003cdaec7d4e on nch1-master-1 Mar 26 20:58:35.747941 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-667a6fd7-5b96-47ff-a84f-666a50de6333 req-ac336766-23be-4613-a9df-65aea047a5ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104363 Mar 26 20:58:35.751296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1502/2805] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:35.766695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1063996364", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:35.900184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] validate_networks() for [('774ec06c-09d0-4daf-abd3-72e75f21ab7d', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:58:36.793457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:36.802514 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b2cbde5-b0ac-48d8-9119-e58f5a2649f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 1.505899 Mar 26 20:58:36.805933 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1304/2806] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:35 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:36.818235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-542251e7-c823-4a22-8eaf-73ad34508d2a tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e59382700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-285237454", "description": "tempest-description-869020816"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:37.453892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:58:37.455317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:58:37.456160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:58:37.457701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:58:37.462565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:58:37.486972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:37.499644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:37.502702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:37.503678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:37.555576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:37.564396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for user 3cb495ec547743d38a7502110a166b1a and project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:37.583590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:58:37.590625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:58:37.677514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c2525e93-cc88-4084-8710-052c24f7857e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.924979 Mar 26 20:58:37.680346 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1503/2807] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:58:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:58:37.700683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:37.713379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:37.757650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:37.758198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:37.759152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:37.762986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.398615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:38.418973 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e1ba40f-55f4-4ab0-8cc4-3af6c0e89e2f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.734210 Mar 26 20:58:38.431472 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1504/2808] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:37 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:38.444765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:38.445909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 0df72bb8-2c08-42da-b528-003cdaec7d4e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:38.454089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.455214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.456227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.456865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.481457 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance 0df72bb8-2c08-42da-b528-003cdaec7d4e could not be found. Mar 26 20:58:38.483135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance 0df72bb8-2c08-42da-b528-003cdaec7d4e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:38.484444 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f96109a-9cc6-4b26-b649-74fdc449a8a8 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e" status: 404 len: 111 microversion: 2.1 time: 0.051478 Mar 26 20:58:38.485652 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1505/2809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:38 2022] GET /compute/v2.1/servers/0df72bb8-2c08-42da-b528-003cdaec7d4e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:38.492008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b05cb87b-0bff-45ca-bc8a-ba87736aa118 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:38.493725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b05cb87b-0bff-45ca-bc8a-ba87736aa118 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:38.604866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b05cb87b-0bff-45ca-bc8a-ba87736aa118 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:38.633482 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b05cb87b-0bff-45ca-bc8a-ba87736aa118 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1222 microversion: 2.1 time: 0.146493 Mar 26 20:58:38.641369 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1506/2810] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:38 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:38.666446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:38.668513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:38.685497 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-542251e7-c823-4a22-8eaf-73ad34508d2a tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.878104 Mar 26 20:58:38.686109 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1305/2811] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:38.698177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.701607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.708493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.708706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:38.709361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.710876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:38.733298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.736815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:38.737993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:38.739071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:39.015084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:39.025664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f61e89e6-659a-48d9-ae40-3966932a1fc9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 0.382256 Mar 26 20:58:39.034273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1507/2812] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:38 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:39.051534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02fb7803-c647-4f34-9a12-40b4202223db tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e594df9d0>, body: {"security_group_rule": {"parent_group_id": "3818f6e0-b213-491c-8dff-85a402697ddf", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:39.065839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:39.090313 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f52ae6e9-7189-460d-8887-79725551da94 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 200 len: 1432 microversion: 2.1 time: 0.391776 Mar 26 20:58:39.093882 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1306/2813] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:38 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 1432 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:39.117894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-65917130-32d3-4e17-a1ee-9531cbde9eee req-9afcee57-c550-477e-92c2-fb7f26ff5f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db", "name": "network-vif-deleted", "tag": "9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:39.151163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-65917130-32d3-4e17-a1ee-9531cbde9eee req-9afcee57-c550-477e-92c2-fb7f26ff5f2b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:39.151619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-65917130-32d3-4e17-a1ee-9531cbde9eee req-9afcee57-c550-477e-92c2-fb7f26ff5f2b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:39.171592 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-65917130-32d3-4e17-a1ee-9531cbde9eee req-9afcee57-c550-477e-92c2-fb7f26ff5f2b service nova] Creating event network-vif-deleted:9db0ea2f-49f9-4e05-b6e4-e5ae2ea483ca for instance f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db on nch2-master-1 Mar 26 20:58:39.180855 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-65917130-32d3-4e17-a1ee-9531cbde9eee req-9afcee57-c550-477e-92c2-fb7f26ff5f2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084939 Mar 26 20:58:39.184200 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1307/2814] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:39.255391 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-02fb7803-c647-4f34-9a12-40b4202223db tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Mar 26 20:58:39.256348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02fb7803-c647-4f34-9a12-40b4202223db tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:39.262054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-02fb7803-c647-4f34-9a12-40b4202223db tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.221611 Mar 26 20:58:39.265247 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1508/2815] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:39.280067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-926aff75-4e90-449e-8c69-f99adc843e7a tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e593f40d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1820729769", "description": "tempest-description-914490585"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:39.438564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:39.439155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:39.447167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:39.447634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:39.448724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:39.449178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:39.719851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:39.731626 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb2a0323-504c-43fc-a8c7-ca5cca8e41a7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.297622 Mar 26 20:58:39.732860 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1509/2816] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:39 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:39.931180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6180c743-e0f0-451b-879b-677f0b0f478b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e593aef70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1428275375", "description": "tempest-description-1333974502"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:40.135937 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6180c743-e0f0-451b-879b-677f0b0f478b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.401715 Mar 26 20:58:40.136913 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1510/2817] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:40.142760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.143978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.154043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.154696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.157365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.157912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.234840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:40.243849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39d6d38c-0cc4-4544-8fee-4076a2b5c064 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1280 microversion: 2.1 time: 0.105361 Mar 26 20:58:40.245023 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1511/2818] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:40 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:40.250507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.251215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.258879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.260061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.261406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.261952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.275999 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-926aff75-4e90-449e-8c69-f99adc843e7a tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.001803 Mar 26 20:58:40.276613 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1308/2819] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:40.286941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.288574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.299246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.300864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.301881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.304432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.324908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db could not be found. Mar 26 20:58:40.326072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:40.327330 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-645aa1c5-7f64-44c8-991f-b23ae43461a3 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db" status: 404 len: 111 microversion: 2.1 time: 0.049625 Mar 26 20:58:40.328172 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1309/2820] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:40 2022] GET /compute/v2.1/servers/f56e4a3c-c8ce-4abc-99fa-f18bf3c2e8db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:40.340125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0f676112-ed6a-48a5-a0da-e0420d3940c3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e5943e310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-646243715", "description": "tempest-description-1997646239"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:40.421212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:40.430375 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04149d86-1017-4f9d-9784-bc575d9884b0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 0.183993 Mar 26 20:58:40.430958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1512/2821] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:40 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:40.436193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60b2eccc-69cf-4214-9738-583ab04ad751 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e596cc700>, body: {"security_group_rule": {"parent_group_id": "5cc0cc8d-1e70-4cf3-b235-a44d9048118f", "ip_protocol": "tcp", "from_port": 22, "to_port": 764555450}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:40.487515 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-60b2eccc-69cf-4214-9738-583ab04ad751 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Invalid port range 22:764555450. Valid TCP ports should be between 1-65535 Mar 26 20:58:40.488160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60b2eccc-69cf-4214-9738-583ab04ad751 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 400 to user: Invalid port range 22:764555450. Valid TCP ports should be between 1-65535 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:40.489002 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60b2eccc-69cf-4214-9738-583ab04ad751 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.056563 Mar 26 20:58:40.489575 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1513/2822] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:40 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:58:40.498563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-513122ec-46fc-4768-8a1b-60e3a2292d10 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.529749 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-513122ec-46fc-4768-8a1b-60e3a2292d10 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c729502b-28d5-49c5-875a-c17fbdb10f5d" status: 204 len: 0 microversion: 2.1 time: 0.038851 Mar 26 20:58:40.530589 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1514/2823] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:40 2022] DELETE /compute/v2.1/os-server-groups/c729502b-28d5-49c5-875a-c17fbdb10f5d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:40.537517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Action: 'create', calling method: .version_select at 0x7f6e5940a9d0>, body: {"security_group_rule": {"parent_group_id": "47b31939-9f8f-4008-a737-9fd674f5ae92", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:40.563451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 47b31939-9f8f-4008-a737-9fd674f5ae92 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:58:40.564357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Neutron security group 47b31939-9f8f-4008-a737-9fd674f5ae92 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:58:40.565126 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Security group 47b31939-9f8f-4008-a737-9fd674f5ae92 does not exist Mar 26 20:58:40.565126 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-b80f94cd-a296-49d4-aade-c00764f81f83'] Mar 26 20:58:40.565991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 404 to user: Security group 47b31939-9f8f-4008-a737-9fd674f5ae92 does not exist Mar 26 20:58:40.565991 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-b80f94cd-a296-49d4-aade-c00764f81f83'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:40.568476 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd7147a1-48d0-48ca-9bed-9573cac5cf6e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.036290 Mar 26 20:58:40.573805 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1515/2824] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Mar 26 20:58:40 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:40.580421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.581227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.588653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.589121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.590015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.590470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.616323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:40.713460 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62f21e9c-68f7-4718-be3e-16e8a44182fc tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 204 len: 0 microversion: 2.1 time: 0.133430 Mar 26 20:58:40.714073 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1516/2825] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:40 2022] DELETE /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:40.719850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e5940aee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.746749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 4fa3f066-590c-42ac-a53f-faa29a47d56b does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:58:40.747361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Neutron security group rule 4fa3f066-590c-42ac-a53f-faa29a47d56b not found {{(pid=141581) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Mar 26 20:58:40.747896 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] HTTP exception thrown: Security group rule 4fa3f066-590c-42ac-a53f-faa29a47d56b does not exist Mar 26 20:58:40.747896 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-da72cfa2-cc36-4f13-8b8a-4de534f8b11e'] Mar 26 20:58:40.748544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Returning 404 to user: Security group rule 4fa3f066-590c-42ac-a53f-faa29a47d56b does not exist Mar 26 20:58:40.748544 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-da72cfa2-cc36-4f13-8b8a-4de534f8b11e'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:40.749768 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e24f4cc-f20f-4ae2-980c-6a8e4769a7c0 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/4fa3f066-590c-42ac-a53f-faa29a47d56b" status: 404 len: 199 microversion: 2.1 time: 0.033853 Mar 26 20:58:40.752075 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1517/2826] 10.222.0.16 () {58 vars in 1286 bytes} [Sat Mar 26 20:58:40 2022] DELETE /compute/v2.1/os-security-group-rules/4fa3f066-590c-42ac-a53f-faa29a47d56b => generated 199 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:40.759222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.760050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.768689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.769209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.770347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.770840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.809229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:40.896617 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71a30677-ec11-409e-a38d-96ee4c4e58c5 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 204 len: 0 microversion: 2.1 time: 0.142670 Mar 26 20:58:40.900039 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1518/2827] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:40 2022] DELETE /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:40.909379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:40.910649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:40.918314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.918828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:40.919663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:40.920302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.083364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:41.093927 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f9b62e6-eddf-43ee-be05-bb4cbc825789 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.190598 Mar 26 20:58:41.094553 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1519/2828] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:40 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:41.101371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-334c8f58-32bc-4ce9-9875-6050e9ca9ae3 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e595d5f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:41.317858 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-334c8f58-32bc-4ce9-9875-6050e9ca9ae3 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5cc0cc8d-1e70-4cf3-b235-a44d9048118f" status: 202 len: 0 microversion: 2.1 time: 0.222109 Mar 26 20:58:41.323853 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1520/2829] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:41 2022] DELETE /compute/v2.1/os-security-groups/5cc0cc8d-1e70-4cf3-b235-a44d9048118f => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:41.331796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:41.332768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:41.346841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.348251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.349353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.350199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.400845 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0f676112-ed6a-48a5-a0da-e0420d3940c3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.067233 Mar 26 20:58:41.401694 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1310/2830] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:58:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:41.407982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:41.408741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:41.462730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.463301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.464225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.467862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.598759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:41.608737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7697434-c807-43a3-bb42-daa09c16b487 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 200 len: 1474 microversion: 2.1 time: 0.282775 Mar 26 20:58:41.609422 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1521/2831] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:41 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:41.622683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:41.633020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b54b303-6cbe-492f-8d02-29646af6c79b tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e593e6790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:41.634093 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9ceaffb-c201-48b8-9f07-5e7c3c36aac1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1280 microversion: 2.1 time: 0.230849 Mar 26 20:58:41.652537 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1311/2832] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:41 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:41.664576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:41.666501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:41.678600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.679070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.679869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:41.680528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:41.866764 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b54b303-6cbe-492f-8d02-29646af6c79b tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3818f6e0-b213-491c-8dff-85a402697ddf" status: 202 len: 0 microversion: 2.1 time: 0.256114 Mar 26 20:58:41.870174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1522/2833] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:41 2022] DELETE /compute/v2.1/os-security-groups/3818f6e0-b213-491c-8dff-85a402697ddf => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:41.885529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1474442078", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5f7a9847-066b-4899-88a9-f395e43c97c0"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:41.976855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] validate_networks() for [('5f7a9847-066b-4899-88a9-f395e43c97c0', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:58:42.221339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:42.231035 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12ceb297-4483-4875-a816-a46faa65a8f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 0.573519 Mar 26 20:58:42.231626 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1312/2834] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:41 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:42.236157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cefe14d1-6b5d-4af4-a0e1-0ed8ec608377 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e593f44c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:42.848183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:58:42.849159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:58:42.850422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:58:42.851119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:58:42.851824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:58:42.861237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:42.861899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:42.862860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:42.863458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:42.882541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Getting quotas for project c3f87b02119a4e3f86e4fdc7a4bd93a6. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:42.889155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Getting quotas for user 0458cfbae7f945309c300d336b6dfd64 and project c3f87b02119a4e3f86e4fdc7a4bd93a6. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:42.910307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:58:42.914324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:58:42.976713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70a0bf9e-3397-4e7e-b978-eeda18ed47ba tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107471 Mar 26 20:58:42.978042 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1523/2835] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:58:42.984550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:42.985813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:42.997635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:42.998750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.000233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.000906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.368179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:43.375693 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41a974cf-c6c8-413c-829c-28bfab4912f2 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.395831 Mar 26 20:58:43.380547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1524/2836] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:42 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:43.391286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-66b649a3-5010-4a59-b169-0046b53c96d3 req-badcad52-6961-4648-96d7-bcb55fd2bfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9520886e-3914-4f48-a3dd-ab467f45feff", "name": "network-vif-plugged", "status": "completed", "tag": "70a83fdf-b383-49e1-962f-77e816017e97"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:43.409607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-66b649a3-5010-4a59-b169-0046b53c96d3 req-badcad52-6961-4648-96d7-bcb55fd2bfe4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.410298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-66b649a3-5010-4a59-b169-0046b53c96d3 req-badcad52-6961-4648-96d7-bcb55fd2bfe4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.425194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-66b649a3-5010-4a59-b169-0046b53c96d3 req-badcad52-6961-4648-96d7-bcb55fd2bfe4 service nova] Creating event network-vif-plugged:70a83fdf-b383-49e1-962f-77e816017e97 for instance 9520886e-3914-4f48-a3dd-ab467f45feff on nch2-master-1 Mar 26 20:58:43.436131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-66b649a3-5010-4a59-b169-0046b53c96d3 req-badcad52-6961-4648-96d7-bcb55fd2bfe4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053530 Mar 26 20:58:43.437311 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1525/2837] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:43.452421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0eee9959-72a8-450f-a206-e31b3c937531 req-62bf2bed-df8b-4b3f-8d96-a040f7694ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181cdcdc-74c2-4b78-b19a-090890ca8a8b", "tag": "f222d2e5-bec9-47c9-9eb3-321c6788db77"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:43.477379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0eee9959-72a8-450f-a206-e31b3c937531 req-62bf2bed-df8b-4b3f-8d96-a040f7694ef2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.479862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0eee9959-72a8-450f-a206-e31b3c937531 req-62bf2bed-df8b-4b3f-8d96-a040f7694ef2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.513893 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0eee9959-72a8-450f-a206-e31b3c937531 req-62bf2bed-df8b-4b3f-8d96-a040f7694ef2 service nova] Creating event network-changed:f222d2e5-bec9-47c9-9eb3-321c6788db77 for instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b on nch1-master-1 Mar 26 20:58:43.527983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0eee9959-72a8-450f-a206-e31b3c937531 req-62bf2bed-df8b-4b3f-8d96-a040f7694ef2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089065 Mar 26 20:58:43.529965 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1526/2838] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:43.539765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:43.545527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:43.573135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.573673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.574514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.574983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.671617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.672267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.684732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lazy-loading 'fault' on Instance uuid 110b4849-d543-4a97-a107-aefdf033c2b0 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:43.778727 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cefe14d1-6b5d-4af4-a0e1-0ed8ec608377 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/00fd64ce-c058-452f-83f9-17ec17bdfb9f" status: 202 len: 0 microversion: 2.1 time: 1.541534 Mar 26 20:58:43.779402 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1313/2839] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:42 2022] DELETE /compute/v2.1/os-security-groups/00fd64ce-c058-452f-83f9-17ec17bdfb9f => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:43.804259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:43.807449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:43.844331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.848571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.849430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.850496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.865808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:43.877613 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fa317ab-bf5c-4965-bbbc-2ece70df8c71 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 200 len: 1308 microversion: 2.1 time: 0.346398 Mar 26 20:58:43.878376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1527/2840] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:43 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:43.892098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:43.893415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:43.904725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.905413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:43.908415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:43.909028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.053203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:44.063466 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1f0d982-b6e3-4c4f-953c-d66c8e05c7b0 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1220 microversion: 2.1 time: 0.183858 Mar 26 20:58:44.075855 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1528/2841] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:43 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:44.083351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:44.086324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:44.093965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.094427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.096330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.097077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.300842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:44.310540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef3a6a30-541d-4886-923f-315da3527c3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1315 microversion: 2.1 time: 0.233530 Mar 26 20:58:44.312522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1529/2842] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:44 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:44.317712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5cfaf290-bb3e-42cf-8604-b4d21c540402 req-171bb477-9199-43d1-a27f-9df00572cc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110b4849-d543-4a97-a107-aefdf033c2b0", "name": "network-vif-deleted", "tag": "56ab69ae-c6fc-4468-8bb0-3885983fca3e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:44.332793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5cfaf290-bb3e-42cf-8604-b4d21c540402 req-171bb477-9199-43d1-a27f-9df00572cc5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.333401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5cfaf290-bb3e-42cf-8604-b4d21c540402 req-171bb477-9199-43d1-a27f-9df00572cc5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.345659 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5cfaf290-bb3e-42cf-8604-b4d21c540402 req-171bb477-9199-43d1-a27f-9df00572cc5f service nova] Creating event network-vif-deleted:56ab69ae-c6fc-4468-8bb0-3885983fca3e for instance 110b4849-d543-4a97-a107-aefdf033c2b0 on nch2-master-1 Mar 26 20:58:44.350733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5cfaf290-bb3e-42cf-8604-b4d21c540402 req-171bb477-9199-43d1-a27f-9df00572cc5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036851 Mar 26 20:58:44.353099 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1530/2843] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:44.358322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1a2961d-e110-4b28-8948-403020384a5e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e59382160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:44.584291 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1a2961d-e110-4b28-8948-403020384a5e tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/360ea0b7-a38e-4e85-b5eb-31513aa1f776" status: 202 len: 0 microversion: 2.1 time: 0.230442 Mar 26 20:58:44.584879 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1531/2844] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:44 2022] DELETE /compute/v2.1/os-security-groups/360ea0b7-a38e-4e85-b5eb-31513aa1f776 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:44.590112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:44.590853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:44.628353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.640514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.642153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.643230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.805412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:44.829605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-83c84d5e-f472-49d9-b483-6ba05a6c908f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 1.042812 Mar 26 20:58:44.830264 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1314/2845] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:43 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:44.835225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-210e3e74-dd23-42d4-86d9-9e0812cf3f27 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] Calling method '.version_select at 0x7f6e596a0d30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:44.954851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:44.965771 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1192c446-144c-4dc4-8c32-acc8a52fda02 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.379733 Mar 26 20:58:44.966428 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1532/2846] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:44 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:44.977793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:44.982751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: 110b4849-d543-4a97-a107-aefdf033c2b0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:44.994921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.995520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:44.996719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:44.997474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.028198 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance 110b4849-d543-4a97-a107-aefdf033c2b0 could not be found. Mar 26 20:58:45.029177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance 110b4849-d543-4a97-a107-aefdf033c2b0 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:45.030223 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65f3f869-34ba-4915-8992-bd5decc22b26 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0" status: 404 len: 111 microversion: 2.1 time: 0.059920 Mar 26 20:58:45.031370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1533/2847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:44 2022] GET /compute/v2.1/servers/110b4849-d543-4a97-a107-aefdf033c2b0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:45.041643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.042477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: e29af921-dbed-4407-aaca-4ec0f73bb9d7] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:45.051088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.051907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.055403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.056136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.074050 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance e29af921-dbed-4407-aaca-4ec0f73bb9d7 could not be found. Mar 26 20:58:45.075393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance e29af921-dbed-4407-aaca-4ec0f73bb9d7 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:45.077406 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b5eec34-995f-4c24-b062-eab37884ca0a tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7" status: 404 len: 111 microversion: 2.1 time: 0.040364 Mar 26 20:58:45.078432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1534/2848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:45 2022] GET /compute/v2.1/servers/e29af921-dbed-4407-aaca-4ec0f73bb9d7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:45.083567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.086362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:45.093925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.094532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.104409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.105246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.300741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:45.336003 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f0bf383-8e28-480b-8def-a9311b329305 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1274 microversion: 2.1 time: 0.254460 Mar 26 20:58:45.350609 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1535/2849] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:45 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:45.356372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea3cace9-ba13-4e5e-ae1e-8dbe6f1f7ac2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.398601 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea3cace9-ba13-4e5e-ae1e-8dbe6f1f7ac2 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a02d23dc-1421-4fe9-a394-81571343007e" status: 204 len: 0 microversion: 2.1 time: 0.046294 Mar 26 20:58:45.401875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1536/2850] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:45 2022] DELETE /compute/v2.1/os-server-groups/a02d23dc-1421-4fe9-a394-81571343007e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:45.409083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.410024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:45.419464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.424749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.425573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.426241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.637911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-210e3e74-dd23-42d4-86d9-9e0812cf3f27 tempest-SecurityGroupRulesNegativeTestJSON-59223413 tempest-SecurityGroupRulesNegativeTestJSON-59223413-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/97ac834a-74b4-492d-bfcc-735cc35bf7f1" status: 202 len: 0 microversion: 2.1 time: 0.806335 Mar 26 20:58:45.639206 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1315/2851] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:58:44 2022] DELETE /compute/v2.1/os-security-groups/97ac834a-74b4-492d-bfcc-735cc35bf7f1 => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:45.644542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.645737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:45.654538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.655841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.657030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.657911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.699101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:58:45.857005 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8aa638c-734c-49a8-97a3-17644b926e4e tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 204 len: 0 microversion: 2.1 time: 0.215982 Mar 26 20:58:45.858724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1316/2852] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:58:45 2022] DELETE /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:58:45.868413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:45.881761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:45.892383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.893644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:45.894900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:45.895948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.229583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:46.237112 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83954f46-9a25-4fcb-a301-3c9ceb004d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1501 microversion: 2.1 time: 0.832499 Mar 26 20:58:46.237700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1537/2853] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:45 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1501 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:46.253487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:46.254115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:46.272666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.273562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.275077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.275725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.485907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:46.504383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08641b65-0ae2-4f14-b3d2-1019f0b06e55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 0.644013 Mar 26 20:58:46.505539 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1317/2854] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:45 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:46.520126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8f7358c8-3905-42de-8d66-8d345861e9ba req-9774b520-1f3c-4e56-833c-bf9c4048d9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2f2f0d-e901-48d2-ba21-81b0a8d151c5", "tag": "425a8d13-34da-40a1-93e0-b77741c63f6c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:46.530542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f7358c8-3905-42de-8d66-8d345861e9ba req-9774b520-1f3c-4e56-833c-bf9c4048d9a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.535244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8f7358c8-3905-42de-8d66-8d345861e9ba req-9774b520-1f3c-4e56-833c-bf9c4048d9a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.556191 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8f7358c8-3905-42de-8d66-8d345861e9ba req-9774b520-1f3c-4e56-833c-bf9c4048d9a7 service nova] Creating event network-changed:425a8d13-34da-40a1-93e0-b77741c63f6c for instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 on nch2-master-1 Mar 26 20:58:46.562082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:46.577563 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f163b4d-30ed-4638-a618-c21ca18d6a23 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1472 microversion: 2.1 time: 0.333417 Mar 26 20:58:46.580354 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1538/2855] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:46 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:46.590246 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8f7358c8-3905-42de-8d66-8d345861e9ba req-9774b520-1f3c-4e56-833c-bf9c4048d9a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072463 Mar 26 20:58:46.590246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1318/2856] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:46.594812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:46.595453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:46.597954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90eb85a0-6aba-40f3-a2dc-b0d1d2deb873 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:46.607487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.608176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.609255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.609722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.615448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90eb85a0-6aba-40f3-a2dc-b0d1d2deb873 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.615943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90eb85a0-6aba-40f3-a2dc-b0d1d2deb873 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.730089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90eb85a0-6aba-40f3-a2dc-b0d1d2deb873 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Going to try to stop instance {{(pid=141580) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 20:58:46.795193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90eb85a0-6aba-40f3-a2dc-b0d1d2deb873 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff/action" status: 202 len: 0 microversion: 2.1 time: 0.212054 Mar 26 20:58:46.796462 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1319/2857] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:58:46 2022] POST /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:58:46.804574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:46.805278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:46.811878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.812414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.813526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.814253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.907803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:46.921188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-584224b8-16c1-4d7f-ad64-2939db0451e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.336921 Mar 26 20:58:46.923029 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1539/2858] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:46 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:46.928313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9a4666cc-013b-43af-b762-0c10a1fb0770 req-7f055df0-2ea3-47cb-ac4c-2d725b86884e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29af921-dbed-4407-aaca-4ec0f73bb9d7", "name": "network-vif-deleted", "tag": "bf789619-a9ce-493c-8d5d-f02e2ecd718b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:46.940357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9a4666cc-013b-43af-b762-0c10a1fb0770 req-7f055df0-2ea3-47cb-ac4c-2d725b86884e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.942072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9a4666cc-013b-43af-b762-0c10a1fb0770 req-7f055df0-2ea3-47cb-ac4c-2d725b86884e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.965947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9a4666cc-013b-43af-b762-0c10a1fb0770 req-7f055df0-2ea3-47cb-ac4c-2d725b86884e service nova] Creating event network-vif-deleted:bf789619-a9ce-493c-8d5d-f02e2ecd718b for instance e29af921-dbed-4407-aaca-4ec0f73bb9d7 on nch2-master-1 Mar 26 20:58:46.971232 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9a4666cc-013b-43af-b762-0c10a1fb0770 req-7f055df0-2ea3-47cb-ac4c-2d725b86884e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046390 Mar 26 20:58:46.971990 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1540/2859] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:46.977776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:46.978799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:46.985649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.986342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:46.987556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:46.988206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:47.319115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:47.329585 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57bd9952-b861-437f-beef-f94cb60b0864 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.356171 Mar 26 20:58:47.331411 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1541/2860] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:46 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:47.348334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:47.359262 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-664e60a7-f194-4239-903a-655438a7bf18 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.560807 Mar 26 20:58:47.360723 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1320/2861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:46 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:47.521790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:47.525064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:47.530299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:47.531013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:47.531907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:47.532503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:47.597246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:47.598063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:47.604614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:47.605373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:47.606292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:47.606883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.049486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:48.060101 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b1e4f94-c8e5-4845-a0b7-31599594559d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 0.542053 Mar 26 20:58:48.060786 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1542/2862] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:47 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:48.074749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:48.075459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:48.081758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.082310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.084509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.085171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.471081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8199b3248742a7ba0d0cb6570c7058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e2bb0e3958483d90176ec061c32ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:48.482274 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbfac6e6-4729-472a-8fd1-25ae13521bb0 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 200 len: 1472 microversion: 2.1 time: 0.885132 Mar 26 20:58:48.482915 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1321/2863] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:47 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:48.496898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:48.496898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:48.511502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.511978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.512765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.513371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.555459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:48.569563 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-95147f4b-b8f9-4b36-9f31-da2ccba75bd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.496461 Mar 26 20:58:48.571599 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1543/2864] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:48 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:48.587162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:48.587794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:48.606144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.606613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.607427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:48.607868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:48.898364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:48.906611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2213ffcc-c780-45af-bb6e-bb74c814ee34 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.333549 Mar 26 20:58:48.915950 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1544/2865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:48 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:49.074018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ea5f4104-7b41-4a31-9446-3bb9b11a0f00 req-90d6e1ab-3532-4dfe-b795-6ecaa1f7a389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51099b7-6a2d-4a66-8a36-3b9b6c08e32e", "name": "network-vif-deleted", "tag": "af98a4ed-6eab-45ad-b849-2a65a2546e72"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:49.088633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ea5f4104-7b41-4a31-9446-3bb9b11a0f00 req-90d6e1ab-3532-4dfe-b795-6ecaa1f7a389 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.089110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ea5f4104-7b41-4a31-9446-3bb9b11a0f00 req-90d6e1ab-3532-4dfe-b795-6ecaa1f7a389 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.098180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:49.109572 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ea5f4104-7b41-4a31-9446-3bb9b11a0f00 req-90d6e1ab-3532-4dfe-b795-6ecaa1f7a389 service nova] Creating event network-vif-deleted:af98a4ed-6eab-45ad-b849-2a65a2546e72 for instance c51099b7-6a2d-4a66-8a36-3b9b6c08e32e on nch2-master-1 Mar 26 20:58:49.109965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3578b1b6-62d1-4d6b-bc2e-88f4a6920ac0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.624144 Mar 26 20:58:49.112276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1322/2866] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:48 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:49.138262 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ea5f4104-7b41-4a31-9446-3bb9b11a0f00 req-90d6e1ab-3532-4dfe-b795-6ecaa1f7a389 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070470 Mar 26 20:58:49.139276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1545/2867] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:49.152350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:49.153055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:49.161413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.162614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.163573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.164381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.500195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:49.501193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] [instance: c51099b7-6a2d-4a66-8a36-3b9b6c08e32e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:49.514044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.515906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.517864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.518514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.536158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] HTTP exception thrown: Instance c51099b7-6a2d-4a66-8a36-3b9b6c08e32e could not be found. Mar 26 20:58:49.537734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] Returning 404 to user: Instance c51099b7-6a2d-4a66-8a36-3b9b6c08e32e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:58:49.538976 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cee22ec9-813a-4f41-99e2-d2123f230639 tempest-ServersOnMultiNodesTest-1777760075 tempest-ServersOnMultiNodesTest-1777760075-project] 10.222.0.16 "GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e" status: 404 len: 111 microversion: 2.1 time: 0.043185 Mar 26 20:58:49.539752 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1546/2868] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:49 2022] GET /compute/v2.1/servers/c51099b7-6a2d-4a66-8a36-3b9b6c08e32e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:49.588434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:49.589953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:49.613698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.614619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.617361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.618090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.622911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:49.637026 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-992c4d21-b797-4d2f-9eba-7e40e721b951 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 0.512972 Mar 26 20:58:49.638722 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1323/2869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:49 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:49.650336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1ec80266-01ef-4987-81bf-f63caaae8b9c req-eceeefca-3b0c-445e-9d21-7d4883045b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1cff63-8d2d-4534-b4f6-d4c0493e58c0", "tag": "191321a7-1166-4f60-ae78-2ca65861dc95"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:49.676835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1ec80266-01ef-4987-81bf-f63caaae8b9c req-eceeefca-3b0c-445e-9d21-7d4883045b0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.677764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1ec80266-01ef-4987-81bf-f63caaae8b9c req-eceeefca-3b0c-445e-9d21-7d4883045b0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.701250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1ec80266-01ef-4987-81bf-f63caaae8b9c req-eceeefca-3b0c-445e-9d21-7d4883045b0c service nova] Creating event network-changed:191321a7-1166-4f60-ae78-2ca65861dc95 for instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 on nch1-master-1 Mar 26 20:58:49.706856 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1ec80266-01ef-4987-81bf-f63caaae8b9c req-eceeefca-3b0c-445e-9d21-7d4883045b0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064673 Mar 26 20:58:49.707794 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1324/2870] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:49.897095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a82ae7a5-2024-4598-837d-3ab0db657dea req-3b45d1ee-6d15-4aab-b14c-aaaaa4cce856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181cdcdc-74c2-4b78-b19a-090890ca8a8b", "name": "network-vif-plugged", "status": "completed", "tag": "f222d2e5-bec9-47c9-9eb3-321c6788db77"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:49.901840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:49.913829 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-899a16d1-d941-42ba-83eb-47cb3320dfa1 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.330871 Mar 26 20:58:49.914002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a82ae7a5-2024-4598-837d-3ab0db657dea req-3b45d1ee-6d15-4aab-b14c-aaaaa4cce856 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.914298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a82ae7a5-2024-4598-837d-3ab0db657dea req-3b45d1ee-6d15-4aab-b14c-aaaaa4cce856 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.915285 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1547/2871] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:49 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:49.931226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:49.932469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:49.940670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.941321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.942412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:49.943001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:49.950699 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a82ae7a5-2024-4598-837d-3ab0db657dea req-3b45d1ee-6d15-4aab-b14c-aaaaa4cce856 service nova] Creating event network-vif-plugged:f222d2e5-bec9-47c9-9eb3-321c6788db77 for instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b on nch1-master-1 Mar 26 20:58:49.971346 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a82ae7a5-2024-4598-837d-3ab0db657dea req-3b45d1ee-6d15-4aab-b14c-aaaaa4cce856 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080385 Mar 26 20:58:49.974009 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1325/2872] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:50.138531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:50.139739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:50.152128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.152893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:50.155142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.155758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:50.207987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:50.216951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0553ba1c-180b-4d9e-9b52-2fd781ec9443 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.291177 Mar 26 20:58:50.220468 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1548/2873] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:49 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:50.658189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:50.668229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:50.671691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:50.685118 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9fc25dd-4eaf-455c-847d-f0d7ad13cbd0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.555077 Mar 26 20:58:50.687263 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1326/2874] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:50 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:50.689297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.699964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:50.701209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.701937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:50.933778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:50.934826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:50.942518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.943100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:50.961339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:50.963959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:51.364724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:51.372576 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a5e2c5c-a65a-4f56-9fdf-451702619b6b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.445371 Mar 26 20:58:51.373048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1327/2875] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:50 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:51.377543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:51.382309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:51.396783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:51.397693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:51.405020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:51.405688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:51.590099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:51.602517 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6784cb9-1735-46f9-ba9d-0c9dc33d6b3d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 0.950885 Mar 26 20:58:51.603594 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1549/2876] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:50 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:51.722318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:51.724193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:51.747629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:51.748257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:51.749553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:51.750399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:51.773821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:51.784317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4e10b573-d4a8-49e4-a1d7-51c7f809dd96 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.410035 Mar 26 20:58:51.785513 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1328/2877] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:51 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:52.153116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b3d28a9f-48a0-4112-878c-5f04aa739e2e req-badd728b-97d4-4f60-a668-a0a4b10a1fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2f2f0d-e901-48d2-ba21-81b0a8d151c5", "name": "network-vif-plugged", "status": "completed", "tag": "425a8d13-34da-40a1-93e0-b77741c63f6c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:52.163947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b3d28a9f-48a0-4112-878c-5f04aa739e2e req-badd728b-97d4-4f60-a668-a0a4b10a1fd3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:52.165140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b3d28a9f-48a0-4112-878c-5f04aa739e2e req-badd728b-97d4-4f60-a668-a0a4b10a1fd3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:52.180932 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b3d28a9f-48a0-4112-878c-5f04aa739e2e req-badd728b-97d4-4f60-a668-a0a4b10a1fd3 service nova] Creating event network-vif-plugged:425a8d13-34da-40a1-93e0-b77741c63f6c for instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 on nch2-master-1 Mar 26 20:58:52.188097 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b3d28a9f-48a0-4112-878c-5f04aa739e2e req-badd728b-97d4-4f60-a668-a0a4b10a1fd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040350 Mar 26 20:58:52.188971 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1329/2878] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:58:52.277132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:52.286187 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9023348-6867-4b55-bda3-e61f5d257cf1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.580141 Mar 26 20:58:52.286786 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1550/2879] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:51 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:52.393557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:52.394687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:52.407854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:52.408726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:52.411624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:52.412796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:52.618720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:52.619373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:52.634075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:52.634542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:52.635342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:52.635794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:52.973127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:52.982431 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f867eba0-fe13-4b4b-adbc-c74713a4e259 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.596703 Mar 26 20:58:52.985171 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1330/2880] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:52 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:53.001793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:53.009981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:53.024342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:53.025049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:53.029080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:53.029720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:53.106217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:53.117509 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bba1624b-6a41-490e-ac72-01d6cf694dc7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1322 microversion: 2.1 time: 0.502615 Mar 26 20:58:53.119272 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1551/2881] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:52 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:53.307007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:53.308029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:53.324657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:53.326738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:53.329817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:53.331894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:53.783642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:53.802110 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a373e8ae-7568-47b2-9463-5da9989fe243 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.803996 Mar 26 20:58:53.815807 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1331/2882] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:52 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:54.002750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:54.008314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:54.036184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.037414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.038466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.039346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.191158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:54.199963 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46e5c403-1526-42c4-b5ad-f056649a2cf3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.899799 Mar 26 20:58:54.204576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1552/2883] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:53 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:54.210241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:54.216406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:54.229863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.230900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.233787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.234563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.662603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:54.674314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-497cab04-de56-4a71-999d-9087e9d5330f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1505 microversion: 2.1 time: 0.676700 Mar 26 20:58:54.683973 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1332/2884] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:53 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:54.790588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:54.799343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c88dd073-c308-4daf-bc74-64099c326055 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1517 microversion: 2.1 time: 0.593471 Mar 26 20:58:54.811135 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1553/2885] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:54 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:54.819835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:54.821713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:54.842983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.843732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.845115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:54.845804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:54.899638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'flavor' on Instance uuid 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:58:55.039762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.051075 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:55.051075 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:58:55.053708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.058562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.060213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.060842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.119737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dfd735b7-c78a-4a23-8056-38933fd03620 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action" status: 200 len: 32 microversion: 2.1 time: 0.306053 Mar 26 20:58:55.122155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1554/2886] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:58:54 2022] POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:58:55.132706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.143592 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-35f8c638-23db-42e3-8bf8-046a1a64e0f6 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.463487 Mar 26 20:58:55.144509 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1333/2887] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:58:54 2022] GET /compute/v2.1/os-services => generated 947 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:55.155493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:55.163977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.165012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:55.185171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.185802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.186948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.187809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.193680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.194172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.197022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.199034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.572463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:55.581927 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-01953f0a-cb26-4109-aaed-f1023122c5d6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.429761 Mar 26 20:58:55.582656 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1334/2888] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:55.601366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.603362 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:55.603362 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:58:55.605411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.606663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.607992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.609120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.641267 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-565a8258-7478-4af0-b1cb-fc346aab7919 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.056752 Mar 26 20:58:55.643157 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1335/2889] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:55.654998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.655841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:55.662557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.663017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.663798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.664749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.722750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:55.730969 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c64a8f49-de52-4239-9e69-612c4918738a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.606643 Mar 26 20:58:55.733490 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1555/2890] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:55.738772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.741063 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:55.741063 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 20:58:55.742534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.743332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.744339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.744974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.789714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3dcbcc9-7cf7-4f5d-b914-bab57ca063ad tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054729 Mar 26 20:58:55.790288 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1556/2891] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:55.797526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:55.798338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:55.804935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.805652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:55.806597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:55.807186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:56.044760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:56.053240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-696d241f-aca8-486b-b797-d1e5a809da9a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.408991 Mar 26 20:58:56.063136 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1336/2892] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:56.086237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:56.087418 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:56.087418 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 20:58:56.095796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:56.096303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:56.097146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:56.097600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:56.152132 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a8e067d7-16b0-41aa-b5d3-00eee4238284 tempest-ServicesAdminTestJSON-722070608 tempest-ServicesAdminTestJSON-722070608-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.081597 Mar 26 20:58:56.163902 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1337/2893] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 20:58:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:56.358266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:56.384177 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-63c6c2bf-eee7-48b7-bde1-3e55140a0f8e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1485 microversion: 2.1 time: 0.586114 Mar 26 20:58:56.385735 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1557/2894] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:55 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1485 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:56.601061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:56.602080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:56.621705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:56.623192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:56.624425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:56.626386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:56.686072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1513950641", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:56.812294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] validate_networks() for [('637c5544-5d67-4536-b4e8-2425937ec750', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:58:57.056943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:57.070217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3562af58-0dd4-4d21-8809-06341ee9cca5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.474068 Mar 26 20:58:57.082864 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1338/2895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:56 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:57.094466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:57.095226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:57.107240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:57.107891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:57.108913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:57.109697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:57.783232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:57.801890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6cc54f0-9029-488b-99a8-b4e037398b50 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.717781 Mar 26 20:58:57.814854 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1339/2896] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:57 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:57.821617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:57.824194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:57.832420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:57.833102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:57.835056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:57.836312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.166628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:58.182143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b06dbab4-71fb-4342-9752-9a1f6c3968c4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.365201 Mar 26 20:58:58.183336 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1340/2897] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:57 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:58.195219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:58.196615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:58.216545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.217014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.217985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.218442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.559168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:58.568931 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f85bd5e2-0dac-46db-816c-1c6841921d51 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.381079 Mar 26 20:58:58.572350 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1341/2898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:58 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:58.578130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d3c685b4-fc53-47ca-9a18-613f69707934 req-54b05b45-aac6-4953-b074-94b625f91c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1cff63-8d2d-4534-b4f6-d4c0493e58c0", "name": "network-vif-plugged", "status": "completed", "tag": "191321a7-1166-4f60-ae78-2ca65861dc95"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:58:58.591887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d3c685b4-fc53-47ca-9a18-613f69707934 req-54b05b45-aac6-4953-b074-94b625f91c5e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.592564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d3c685b4-fc53-47ca-9a18-613f69707934 req-54b05b45-aac6-4953-b074-94b625f91c5e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.612790 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d3c685b4-fc53-47ca-9a18-613f69707934 req-54b05b45-aac6-4953-b074-94b625f91c5e service nova] Creating event network-vif-plugged:191321a7-1166-4f60-ae78-2ca65861dc95 for instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 on nch1-master-1 Mar 26 20:58:58.623185 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d3c685b4-fc53-47ca-9a18-613f69707934 req-54b05b45-aac6-4953-b074-94b625f91c5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047111 Mar 26 20:58:58.627019 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1342/2899] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:58:58.789852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:58:58.792429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:58:58.793681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:58:58.794646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:58:58.795873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:58:58.818587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.819386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.820581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.820856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:58.821413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.821741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:58.833512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.834888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.837651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:58.840469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:58.851858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Getting quotas for project a7e64b94cc37456185389445ddc56877. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:58:58.860691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Getting quotas for user 32e2a79f7ce548d5b39cd657ac6d578a and project a7e64b94cc37456185389445ddc56877. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:58:58.900107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:58:58.903370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:58:59.042866 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e3c56ea-f409-46db-8ac1-701a8019f586 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.359522 Mar 26 20:58:59.048872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1558/2900] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:58:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:58:59.061509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56467233-74c0-4f62-86f5-19c829c170d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:59.062249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-56467233-74c0-4f62-86f5-19c829c170d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:59.263294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-56467233-74c0-4f62-86f5-19c829c170d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:59.272014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56467233-74c0-4f62-86f5-19c829c170d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1214 microversion: 2.1 time: 0.216182 Mar 26 20:58:59.272623 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1559/2901] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:59 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:58:59.297409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:59.298208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:59.316244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:59.322650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:59.324667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:59.325153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:59.726298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:58:59.736689 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d62accc-c525-40e0-ae83-24aa13390839 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 0.920316 Mar 26 20:58:59.746925 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1343/2902] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:58 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:58:59.764689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:58:59.767573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:58:59.786536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:59.787715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:58:59.791755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:58:59.792529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:00.321686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:00.332484 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1e067f9f-6783-4caf-87cf-750bcc271e33 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.582663 Mar 26 20:59:00.343952 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1344/2903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:59 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:00.354052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:00.354690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:00.362997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:00.363463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:00.364338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:00.365510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:00.397704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:00.408932 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-445cb585-b3e6-42d0-9b11-c6810eea8b76 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 1.135252 Mar 26 20:59:00.409554 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1560/2904] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:58:59 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:00.454902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:00.464676 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cc96d364-0123-4c94-953a-d71fb80a0233 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1266 microversion: 2.1 time: 0.119381 Mar 26 20:59:00.467222 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1345/2905] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:00 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:00.764665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:00.765949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:00.783481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:00.784757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:00.793833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:00.794367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:00.814175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Action: 'create', calling method: .version_select at 0x7f6e59afd160>, body: {"keypair": {"name": "tempest-keypair-1339957730"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:00.837268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for project 586533ed0cf646c2945f68477b651e23. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:00.862987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for user 791eb951b71e493c82ce921d1f8f4174 and project 586533ed0cf646c2945f68477b651e23. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:01.150762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for project 586533ed0cf646c2945f68477b651e23. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:01.163033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for user 791eb951b71e493c82ce921d1f8f4174 and project 586533ed0cf646c2945f68477b651e23. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:01.206953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-77acc188-a263-4ed4-8aed-dc1e0e321030 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.680359 Mar 26 20:59:01.207580 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1561/2906] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:59:00 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:01.352917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:01.354086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:01.376335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:01.377255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:01.379286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:01.380190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:01.781068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:01.794914 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12e00688-76d7-4ec7-8688-970374c89287 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1316 microversion: 2.1 time: 1.031590 Mar 26 20:59:01.796866 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1346/2907] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:00 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:01.809305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:01.810207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:01.832523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:01.833215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:01.834134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:01.834587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:02.301246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:02.310425 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bbbdd196-0c13-4460-bd46-5eafd89f2916 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.512491 Mar 26 20:59:02.312931 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1347/2908] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:01 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:02.318416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:02.319034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:02.326402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:02.327041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:02.328092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:02.328548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:02.383716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:02.393562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e55319e9-db2e-47e9-9e51-9032419a0a9a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 1.047856 Mar 26 20:59:02.394726 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1562/2909] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:01 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:02.454290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:02.463198 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a95412cd-2040-451a-a779-e4fddf47b483 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1272 microversion: 2.1 time: 0.149015 Mar 26 20:59:02.464322 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1348/2910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:02 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:02.818915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:02.820509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:02.833194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:02.834886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:02.837545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:02.839042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.333248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:03.334697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:03.354420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.355125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.356121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.356569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.365546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:03.384335 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd857cff-f76e-4ec8-b9ed-41981b25e643 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1504 microversion: 2.1 time: 0.574972 Mar 26 20:59:03.397088 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1563/2911] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:02 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:03.432416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1428275375"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:03.434017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:03.446401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.447142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.448684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.450300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.759967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:03.802260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-527c4354-40cb-401a-a296-fd9896eaefe2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.469795 Mar 26 20:59:03.828978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1349/2912] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:03 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:03.856418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:03.857522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:03.875880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.876772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:03.877773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:03.878442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:04.085937 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.network.security_group_api [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Adding security group 13df4862-a8b7-4bd9-9aa6-daedcf47e691 to port 191321a7-1166-4f60-ae78-2ca65861dc95 Mar 26 20:59:04.303168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:04.311770 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de13831c-32e6-4100-98bb-e545273a86f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.476749 Mar 26 20:59:04.315665 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1350/2913] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:03 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:04.323127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:04.327175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:04.344913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:04.346014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:04.348223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:04.351250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:04.682729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:04.690229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c1c5410-25bc-4b50-bf5f-c5d912bdb5fb tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1314 microversion: 2.1 time: 0.373225 Mar 26 20:59:04.691025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1351/2914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:04 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:04.846649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:04.847601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:04.864412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:04.865329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:04.869236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:04.870359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:05.517137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:05.544232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c25114ec-7175-45ed-abad-e65e95c53245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.697230 Mar 26 20:59:05.545270 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1352/2915] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:04 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:05.551021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-abe3fe5a-4659-46cb-bdb0-a6c5dae30742 req-1a1fe417-7517-452b-bbb3-6dab7ff39b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901c62c9-5a4b-4513-b027-c464f1501864", "tag": "9734139e-042e-4a25-9ed4-1e990314944b"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:05.562164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-abe3fe5a-4659-46cb-bdb0-a6c5dae30742 req-1a1fe417-7517-452b-bbb3-6dab7ff39b86 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:05.562619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-abe3fe5a-4659-46cb-bdb0-a6c5dae30742 req-1a1fe417-7517-452b-bbb3-6dab7ff39b86 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:05.579819 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-abe3fe5a-4659-46cb-bdb0-a6c5dae30742 req-1a1fe417-7517-452b-bbb3-6dab7ff39b86 service nova] Creating event network-changed:9734139e-042e-4a25-9ed4-1e990314944b for instance 901c62c9-5a4b-4513-b027-c464f1501864 on nch2-master-1 Mar 26 20:59:05.585648 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-abe3fe5a-4659-46cb-bdb0-a6c5dae30742 req-1a1fe417-7517-452b-bbb3-6dab7ff39b86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038853 Mar 26 20:59:05.586721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1353/2916] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:05.596029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:05.596969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:05.605094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:05.605566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:05.606371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:05.606817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:05.694553 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cbe89eef-6c12-4e77-88d6-3361541c0269 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/action" status: 202 len: 0 microversion: 2.1 time: 2.294248 Mar 26 20:59:05.695794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1564/2917] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:03 2022] POST /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/action => generated 0 bytes in 2296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:05.703873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-646243715"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:05.704458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:05.722320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:05.722791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:05.723598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:05.724884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.360570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:06.368698 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7737fea2-160e-47b9-a270-7d5e11d68477 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.779623 Mar 26 20:59:06.377981 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1354/2918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:05 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:06.384658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:06.386360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:06.403381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:06.404261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.405785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:06.406446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.908574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:06.919085 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3899e4b-24ea-44aa-a711-4a474eebd948 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1314 microversion: 2.1 time: 0.538848 Mar 26 20:59:06.921349 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1355/2919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:06 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:06.929831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-fbfaf267-ab92-409c-9992-1ff0e97f7454 req-2290523f-d820-4a62-87ab-ae57881b1e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1cff63-8d2d-4534-b4f6-d4c0493e58c0", "tag": "191321a7-1166-4f60-ae78-2ca65861dc95"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:06.952369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fbfaf267-ab92-409c-9992-1ff0e97f7454 req-2290523f-d820-4a62-87ab-ae57881b1e0a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:06.953190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fbfaf267-ab92-409c-9992-1ff0e97f7454 req-2290523f-d820-4a62-87ab-ae57881b1e0a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.969872 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-fbfaf267-ab92-409c-9992-1ff0e97f7454 req-2290523f-d820-4a62-87ab-ae57881b1e0a service nova] Creating event network-changed:191321a7-1166-4f60-ae78-2ca65861dc95 for instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 on nch1-master-1 Mar 26 20:59:06.977501 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-fbfaf267-ab92-409c-9992-1ff0e97f7454 req-2290523f-d820-4a62-87ab-ae57881b1e0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054187 Mar 26 20:59:06.978365 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1356/2920] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:06.983835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:06.984854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:06.992920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:06.993616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.994629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:06.995295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:06.999047 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.network.security_group_api [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Adding security group 82e03f28-d7fd-4ddc-908f-268e1e2a4ab5 to port 191321a7-1166-4f60-ae78-2ca65861dc95 Mar 26 20:59:07.657207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:07.685403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf81cd60-8153-453b-a959-db90fa960854 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.693995 Mar 26 20:59:07.686048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1357/2921] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:06 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:07.694347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:07.705902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:07.729179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:07.729647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:07.735752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:07.737821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:08.421880 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2c1e835d-4d12-45fa-839b-1e9a2c021c11 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/action" status: 202 len: 0 microversion: 2.1 time: 2.721971 Mar 26 20:59:08.424199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1565/2922] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:05 2022] POST /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/action => generated 0 bytes in 2725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:08.430365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:08.431155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:08.452565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:08.452565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:08.452565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:08.452565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:08.640816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:08.659124 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1da55db6-5f48-4f40-a564-16495fa3a664 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.965536 Mar 26 20:59:08.660870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1358/2923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:07 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:08.675414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:08.679715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:08.694595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:08.695065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:08.697120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:08.701302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.108491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:09.118220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-336e739e-7748-4de6-93e5-138b3e6c1885 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1314 microversion: 2.1 time: 0.692312 Mar 26 20:59:09.131477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1566/2924] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:08 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:09.139235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:09.147292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3ad6dd2d-6575-4426-a4bc-d230a135c621 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.481179 Mar 26 20:59:09.148611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1359/2925] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 20:59:08 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0/os-security-groups => generated 1158 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:09.159682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ee03287e-38a1-4e7e-985a-d39fc0ad57d5 req-ca9505c8-92c6-47f2-8ff1-9db5ceff0ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1cff63-8d2d-4534-b4f6-d4c0493e58c0", "tag": "191321a7-1166-4f60-ae78-2ca65861dc95"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:09.161472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:09.187030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:09.187666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.189783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:09.190446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.197132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee03287e-38a1-4e7e-985a-d39fc0ad57d5 req-ca9505c8-92c6-47f2-8ff1-9db5ceff0ede service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:09.198238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee03287e-38a1-4e7e-985a-d39fc0ad57d5 req-ca9505c8-92c6-47f2-8ff1-9db5ceff0ede service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.214287 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ee03287e-38a1-4e7e-985a-d39fc0ad57d5 req-ca9505c8-92c6-47f2-8ff1-9db5ceff0ede service nova] Creating event network-changed:191321a7-1166-4f60-ae78-2ca65861dc95 for instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 on nch1-master-1 Mar 26 20:59:09.220197 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ee03287e-38a1-4e7e-985a-d39fc0ad57d5 req-ca9505c8-92c6-47f2-8ff1-9db5ceff0ede service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070038 Mar 26 20:59:09.220986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1360/2926] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:09.227558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3a75141-92ca-41e3-b941-371f889da6a4 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e593f4ee0>, body: {"security_group": {"name": " tempest-securitygroup -78986184 ", "description": "tempest-description-568384993"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:09.732489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:09.738729 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3a75141-92ca-41e3-b941-371f889da6a4 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.515898 Mar 26 20:59:09.747208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-34e80f05-4be2-411c-a42f-7e1dbb2aa93b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.610360 Mar 26 20:59:09.748143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1567/2927] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:09 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:09.748778 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1361/2928] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:09.760164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26ce44c4-72fd-4cf2-ad6e-cf899179e0b3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e596a09d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:09.761624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:09.762513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:09.769980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:09.771816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.772822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:09.774520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:09.948256 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26ce44c4-72fd-4cf2-ad6e-cf899179e0b3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53" status: 200 len: 221 microversion: 2.1 time: 0.197617 Mar 26 20:59:09.949154 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1362/2929] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:09 2022] GET /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53 => generated 221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:09.962684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d76b6ec8-6411-4e4c-a894-e6d31549f62e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5933f280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:10.602663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:10.602819 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d76b6ec8-6411-4e4c-a894-e6d31549f62e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53" status: 202 len: 0 microversion: 2.1 time: 0.643711 Mar 26 20:59:10.609931 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1363/2930] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:09 2022] DELETE /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:10.615807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:10.616414 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8e69e68-916b-45c8-8892-a701781198b9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.866425 Mar 26 20:59:10.616587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:10.617735 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1568/2931] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:09 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:10.638335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-041804c5-a844-436a-949a-ae927d7b9247 req-4ebae3d3-0d36-43d8-829a-f29d8b6e098d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901c62c9-5a4b-4513-b027-c464f1501864", "name": "network-vif-plugged", "status": "completed", "tag": "9734139e-042e-4a25-9ed4-1e990314944b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:10.640775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:10.642466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:10.644299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:10.646639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:10.651322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-041804c5-a844-436a-949a-ae927d7b9247 req-4ebae3d3-0d36-43d8-829a-f29d8b6e098d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:10.652110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-041804c5-a844-436a-949a-ae927d7b9247 req-4ebae3d3-0d36-43d8-829a-f29d8b6e098d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:10.677261 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-041804c5-a844-436a-949a-ae927d7b9247 req-4ebae3d3-0d36-43d8-829a-f29d8b6e098d service nova] Creating event network-vif-plugged:9734139e-042e-4a25-9ed4-1e990314944b for instance 901c62c9-5a4b-4513-b027-c464f1501864 on nch2-master-1 Mar 26 20:59:10.691701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-041804c5-a844-436a-949a-ae927d7b9247 req-4ebae3d3-0d36-43d8-829a-f29d8b6e098d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070290 Mar 26 20:59:10.692459 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1569/2932] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:10.700025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e58c91790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:10.932063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:10.934796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:10.935386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist Mar 26 20:59:10.935386 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-09d03613-1a94-42bb-9449-a3e77e824c76'] Mar 26 20:59:10.937204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist Mar 26 20:59:10.937204 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-09d03613-1a94-42bb-9449-a3e77e824c76'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:10.938490 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96d47bd9-6f96-4d2d-884e-7774388ea744 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53" status: 404 len: 194 microversion: 2.1 time: 0.244894 Mar 26 20:59:10.939712 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1570/2933] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:10 2022] GET /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53 => generated 194 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:10.946516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-957098264", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3aa0f23c-5368-46f1-b9c6-8664ee7325a2"}], "security_groups": [{"name": "tempest-securitygroup--691924202"}], "key_name": "tempest-keypair-1339957730", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5592d5c0-89ac-4148-a31c-07af1fa34169", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:11.234635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] validate_networks() for [('3aa0f23c-5368-46f1-b9c6-8664ee7325a2', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:59:11.352972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:11.363028 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92333fe2-cb56-4bdc-a95d-5841b31e87c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1314 microversion: 2.1 time: 0.752021 Mar 26 20:59:11.363936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1364/2934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:10 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:11.369245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:11.370160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:11.376699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:11.377419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:11.378733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:11.379410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:11.666686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:11.695031 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3225097d-f9fa-4077-a741-d09f723ca619 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.326840 Mar 26 20:59:11.697498 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1365/2935] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:11 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:11.710805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0883dbaa-9e6a-4a42-9bc3-95b18af8ddb1 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e593f04c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1442978439", "description": "tempest-description-99448722"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:12.034117 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0883dbaa-9e6a-4a42-9bc3-95b18af8ddb1 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.333635 Mar 26 20:59:12.043821 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1366/2936] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:12.057491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:12.058139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:12.065976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.066479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.067275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.067797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.283436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for project 586533ed0cf646c2945f68477b651e23. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:12.299347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for user 791eb951b71e493c82ce921d1f8f4174 and project 586533ed0cf646c2945f68477b651e23. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:12.326878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:59:12.327361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:59:12.338774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:59:12.339246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:59:12.344430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:59:12.344743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:12.356910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.357607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.358685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.359375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.364097 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7914c55-ad57-41a7-b321-49d740ba0f2e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.317887 Mar 26 20:59:12.376588 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1367/2937] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:12 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:12.386118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1301235b-6dcf-4282-889a-d52f2df9b10b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e592d69d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1982028383", "description": "tempest-description-247151838"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:12.408870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for project 586533ed0cf646c2945f68477b651e23. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:12.417561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Getting quotas for user 791eb951b71e493c82ce921d1f8f4174 and project 586533ed0cf646c2945f68477b651e23. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:12.512214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:59:12.518788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5592d5c0-89ac-4148-a31c-07af1fa34169',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:59:12.733908 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bfafbbde-2a8e-4d22-a62a-973c9aa8ef66 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.792904 Mar 26 20:59:12.735244 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1571/2938] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:59:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:59:12.748950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:12.750090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:12.758940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.759715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.760778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:12.763183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:12.958887 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1301235b-6dcf-4282-889a-d52f2df9b10b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.580170 Mar 26 20:59:12.966969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1368/2939] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:12.988512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:12.989391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:13.002516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.003189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.004467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.005100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.352538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:13.364349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10dcb3a7-c381-4310-92c4-470920b472c3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.393040 Mar 26 20:59:13.365649 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1369/2940] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:12 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:13.370227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:13.373767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:13.380839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.381423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.382226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.383288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.473061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:13.487030 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-836e8135-5c97-41a8-b39e-f98d54ebc67c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1171 microversion: 2.1 time: 0.117488 Mar 26 20:59:13.497105 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1370/2941] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:13 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1171 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:13.504347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f554643-18ad-4e59-a031-b18ef9e1afdb tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e593b8310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1273027397", "description": "tempest-description-498282563"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:13.746733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:13.759099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40889beb-4422-4cbb-9c84-67db2ea3a19f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1501 microversion: 2.1 time: 1.022409 Mar 26 20:59:13.771834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1572/2942] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:12 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1501 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:13.784415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:13.788471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:13.802088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.802559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.803369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:13.803823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:13.974519 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f554643-18ad-4e59-a031-b18ef9e1afdb tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.472816 Mar 26 20:59:13.976256 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1371/2943] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:13.986914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:13.995536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:14.050707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:14.053371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:14.057659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:14.061407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:14.109492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lazy-loading 'flavor' on Instance uuid 901c62c9-5a4b-4513-b027-c464f1501864 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:59:14.347695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b88b298d-5f9b-4047-a500-f6b12bd55544 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "POST /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864/action" status: 200 len: 32 microversion: 2.1 time: 0.370029 Mar 26 20:59:14.348690 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1372/2944] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:13 2022] POST /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:14.355260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fecd4107-913b-473b-9381-d130cbf91832 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e591d58b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:14.539336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:14.548679 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88e4137e-4f03-42c7-b874-fbface645d0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.775563 Mar 26 20:59:14.550224 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1573/2945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:13 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:14.556149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:14.557066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:14.572676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:14.574655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:14.583169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:14.585494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.091787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:15.102483 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5598960e-4c00-4b69-bea0-3b9bd393cb0e tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.550942 Mar 26 20:59:15.103077 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1574/2946] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:14 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:15.113816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:15.117639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:15.129154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.129613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.130435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.130884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.498091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:15.508298 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9fdcbf4d-b6ad-4757-9095-57183d4cec03 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.403934 Mar 26 20:59:15.517936 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1575/2947] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:15 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:15.520658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:15.522166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:15.529115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.529652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.530506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.531017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.574047 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fecd4107-913b-473b-9381-d130cbf91832 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.223126 Mar 26 20:59:15.574908 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1373/2948] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:59:14 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:15.588320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:15.593772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:15.606953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.607493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.608532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:15.610546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:15.683409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:15.691240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-361c07d0-4e9e-4e85-83fa-165874902d71 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1225 microversion: 2.1 time: 0.176283 Mar 26 20:59:15.691829 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1576/2949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:15 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:15.711125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-383a52b3-19ef-4369-a26c-541fafd06675 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5ed53820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.193445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:16.201353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5d87a210-59c4-4882-a4d0-42361c7a2ebe tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.624979 Mar 26 20:59:16.201952 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1374/2950] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:15 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:16.219650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.220304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:16.235435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:16.235877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:16.236707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:16.237140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:16.248797 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-383a52b3-19ef-4369-a26c-541fafd06675 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448" status: 202 len: 0 microversion: 2.1 time: 0.550435 Mar 26 20:59:16.250045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1577/2951] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:15 2022] DELETE /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:16.258423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5940dd30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.308663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:16.309615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 376307f1-3d1f-4313-9816-f91d820ae448 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:16.310353 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist Mar 26 20:59:16.310353 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-900b990a-f415-4ea4-9e86-fc818d584e76'] Mar 26 20:59:16.311114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist Mar 26 20:59:16.311114 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-900b990a-f415-4ea4-9e86-fc818d584e76'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:16.312305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60bfa05c-50da-4e61-9826-ffd3cf374ea5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448" status: 404 len: 194 microversion: 2.1 time: 0.058367 Mar 26 20:59:16.312991 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1578/2952] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:59:16.321825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2a874bd-591d-4d5d-87bc-40007e189ce4 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e58b02c10>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.691037 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2a874bd-591d-4d5d-87bc-40007e189ce4 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf" status: 202 len: 0 microversion: 2.1 time: 0.373370 Mar 26 20:59:16.693476 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1579/2953] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:16 2022] DELETE /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:59:16.728153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:16.739504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-daf5027a-d7aa-41d7-b650-f74a64dfc1a6 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.536313 Mar 26 20:59:16.751011 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1375/2954] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:16.757880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.758891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:16.768143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:16.768848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:16.769841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:16.770616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:16.811543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d12fd16-2697-49cb-a058-f5604ad3b4e6 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Calling method '.version_select at 0x7f6e59506940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.913069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d12fd16-2697-49cb-a058-f5604ad3b4e6 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.218251 Mar 26 20:59:16.922108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1580/2955] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:16.928860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5ed53700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:16.963488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:16.964587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 35516eea-ddb3-4689-b729-dce17be9a1bf not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:16.965737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist Mar 26 20:59:16.965737 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-ef5a615d-b2bf-485c-ad51-fe0cc98909ce'] Mar 26 20:59:16.966712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist Mar 26 20:59:16.966712 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-ef5a615d-b2bf-485c-ad51-fe0cc98909ce'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:16.967714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5b6f2c68-90ae-4b65-a2ff-14e5ec827980 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf" status: 404 len: 194 microversion: 2.1 time: 0.044235 Mar 26 20:59:16.972301 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1581/2956] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:17.019608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:17.020486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:17.035761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.036586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.037618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.038275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.224449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:17.236450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7817361-52f7-410b-bde9-8c50339ae978 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1511 microversion: 2.1 time: 0.481625 Mar 26 20:59:17.248402 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1376/2957] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:17.254958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92f64278-9034-4abe-89ff-1655ad158860 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Action: 'create', calling method: .version_select at 0x7f6e593f40d0>, body: {"pool": "non_exist_pool"} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:17.348854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-92f64278-9034-4abe-89ff-1655ad158860 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] HTTP exception thrown: Floating IP pool not found. Mar 26 20:59:17.349906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92f64278-9034-4abe-89ff-1655ad158860 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Returning 404 to user: Floating IP pool not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:17.350975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92f64278-9034-4abe-89ff-1655ad158860 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.101231 Mar 26 20:59:17.352096 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1377/2958] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 20:59:17 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:59:17.357142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db8be4c7-db0d-4fb3-bfa5-473808cec91b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e592349d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:17.470482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:17.481273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b8af030-e65a-4835-825b-7d25664701d4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.507437 Mar 26 20:59:17.481875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1582/2959] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:16 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:17.491558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:17.494532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:17.501218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.501803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.502480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.506997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.819000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:17.827780 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f656fef-5d02-4d1f-8fc0-347bddb70351 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.344616 Mar 26 20:59:17.830238 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1583/2960] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:17 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:17.840956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9ef2bd6-abc3-4cbd-a621-abf77ca12335 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Calling method '.version_select at 0x7f6e5ed53dc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:17.913287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-a9ef2bd6-abc3-4cbd-a621-abf77ca12335 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ed3ebd3b-3a1f-4fac-bde7-9281622c1f36 could not be found", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:17.918091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a9ef2bd6-abc3-4cbd-a621-abf77ca12335 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] HTTP exception thrown: Floating IP not found for ID ed3ebd3b-3a1f-4fac-bde7-9281622c1f36 Mar 26 20:59:17.920185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9ef2bd6-abc3-4cbd-a621-abf77ca12335 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] Returning 404 to user: Floating IP not found for ID ed3ebd3b-3a1f-4fac-bde7-9281622c1f36 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:17.922384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9ef2bd6-abc3-4cbd-a621-abf77ca12335 tempest-FloatingIPsNegativeTestJSON-1435337562 tempest-FloatingIPsNegativeTestJSON-1435337562-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/ed3ebd3b-3a1f-4fac-bde7-9281622c1f36" status: 404 len: 111 microversion: 2.1 time: 0.086566 Mar 26 20:59:17.923559 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1584/2961] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:59:17 2022] DELETE /compute/v2.1/os-floating-ips/ed3ebd3b-3a1f-4fac-bde7-9281622c1f36 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:17.940495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:17.944152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:17.964582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.965412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.966645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:17.967473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:17.984504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db8be4c7-db0d-4fb3-bfa5-473808cec91b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7" status: 202 len: 0 microversion: 2.1 time: 0.631072 Mar 26 20:59:17.985400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1378/2962] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:17 2022] DELETE /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7 => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:17.993469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e59f6cca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:18.051565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:18.054461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 8a462155-de76-4534-93ae-1c57a3a4abc7 not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:18.055234 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist Mar 26 20:59:18.055234 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-6ecddb48-1a7a-49c0-935b-cf2d9cd1d3f4'] Mar 26 20:59:18.056512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist Mar 26 20:59:18.056512 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-6ecddb48-1a7a-49c0-935b-cf2d9cd1d3f4'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:18.058087 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4f88928d-4f04-4da8-a727-5cb715743e1a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7" status: 404 len: 194 microversion: 2.1 time: 0.068914 Mar 26 20:59:18.063616 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1379/2963] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:17 2022] GET /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:59:18.069958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f74896ae-b8f3-4819-9bc9-fdd63fca7b9e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e593d99d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:18.420472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:18.431866 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7b8f30d-9e7b-4e20-9b90-86f6c38437e3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.506114 Mar 26 20:59:18.438358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1585/2964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:17 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:18.455556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:18.456551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:18.471634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:18.472270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:18.473645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:18.474675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:18.662306 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f74896ae-b8f3-4819-9bc9-fdd63fca7b9e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.596907 Mar 26 20:59:18.663441 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1380/2965] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 20:59:18 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:18.668272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:18.669185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:18.682559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:18.683186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:18.684173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:18.684805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:19.458011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:19.467961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2af68526-a2b5-4153-ad82-46235a9db394 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.802195 Mar 26 20:59:19.481909 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1381/2966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:18 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:19.486962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab94afb5-6a53-4529-8853-e9df2cbabe82 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e5ec9b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1162989145", "description": "tempest-description-348605776"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:19.633823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:19.646872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59e7f427-f0b4-4112-b534-2dc783b88f05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1488 microversion: 2.1 time: 1.197864 Mar 26 20:59:19.647993 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1586/2967] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:18 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1488 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:19.655057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:19.656780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:19.671080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:19.672077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:19.673439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:19.674106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.029318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab94afb5-6a53-4529-8853-e9df2cbabe82 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.546170 Mar 26 20:59:20.030224 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1382/2968] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:20.036265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-78890100-01c3-4b3b-8de4-cdcf9c42de65 req-38d2f232-9a65-4adc-a36d-6998f59c97dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09615731-6e79-49e6-b750-c6412628ecab", "tag": "74586d05-0a23-40a4-a976-8b3ddbbcbf41"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:20.061574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-78890100-01c3-4b3b-8de4-cdcf9c42de65 req-38d2f232-9a65-4adc-a36d-6998f59c97dd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.063877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-78890100-01c3-4b3b-8de4-cdcf9c42de65 req-38d2f232-9a65-4adc-a36d-6998f59c97dd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.093912 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-78890100-01c3-4b3b-8de4-cdcf9c42de65 req-38d2f232-9a65-4adc-a36d-6998f59c97dd service nova] Creating event network-changed:74586d05-0a23-40a4-a976-8b3ddbbcbf41 for instance 09615731-6e79-49e6-b750-c6412628ecab on nch1-master-1 Mar 26 20:59:20.106929 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-78890100-01c3-4b3b-8de4-cdcf9c42de65 req-38d2f232-9a65-4adc-a36d-6998f59c97dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073761 Mar 26 20:59:20.108773 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1383/2969] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:20.114389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:20.116055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:20.123084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.123858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.125503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.126075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.257479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:20.265925 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f30f9558-e386-422c-892c-add2befce472 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.616607 Mar 26 20:59:20.266681 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1587/2970] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:19 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:20.277261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:20.278478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:20.287578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.288690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.289800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.290417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.343282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:20.352291 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9cdaf86c-adde-489a-9da6-21993ab09882 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.242210 Mar 26 20:59:20.353433 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b306215-cccd-44bc-9859-54abf2b47521 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 200 len: 132 microversion: 2.1 time: 0.084856 Mar 26 20:59:20.354225 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1384/2971] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:20 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:20.359677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1588/2972] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:20 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 132 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:20.360217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4898ea8-f564-4c49-8dca-5bca09b83f06 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e5ec9b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-361795784", "description": "tempest-description-2023410492"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:20.368246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:20.369196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:20.376871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.377553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.378517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.378968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.825294 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4898ea8-f564-4c49-8dca-5bca09b83f06 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.469680 Mar 26 20:59:20.828149 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1385/2973] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:20.835687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:20.836974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:20.846348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.847069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.848477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:20.849713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:20.960293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:20.965854 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d044f91f-905a-47db-a955-8b783247145d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.604717 Mar 26 20:59:20.966434 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1589/2974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:20 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:20.981627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1774624618", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5f7a9847-066b-4899-88a9-f395e43c97c0"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:21.053833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] validate_networks() for [('5f7a9847-066b-4899-88a9-f395e43c97c0', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:59:21.211685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:21.221241 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23860a8b-36b8-4175-af49-d800719e53f9 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.391313 Mar 26 20:59:21.222317 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1386/2975] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:20 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:21.228231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:21.229026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:21.237554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.238169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:21.239909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.240418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:21.563940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:21.585072 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-867707a1-977f-4af1-9f95-b5f6a68df39d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.361360 Mar 26 20:59:21.586624 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1387/2976] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:21 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:21.593589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:21.594563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:21.604878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.605485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:21.606915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.607602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:21.979846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:59:21.980534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:59:21.981228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:59:21.981752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:59:21.982410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:59:21.993535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.993999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:21.994826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:21.995271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.018538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Getting quotas for project c3f87b02119a4e3f86e4fdc7a4bd93a6. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:22.027107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Getting quotas for user 0458cfbae7f945309c300d336b6dfd64 and project c3f87b02119a4e3f86e4fdc7a4bd93a6. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:22.041493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:59:22.043949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:59:22.086002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:22.095311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ea16927-726b-4cb7-ab5a-571c55bede7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.506562 Mar 26 20:59:22.096757 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1388/2977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:21 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:22.104135 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a81bf930-b08c-4be8-8aaf-932099688ce9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130287 Mar 26 20:59:22.107731 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1590/2978] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:59:22.109954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:22.110852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:22.121021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:22.121651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:22.122922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.123629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.124745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.125418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.127895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.128381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.129520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.130764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.425939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:22.442090 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a3d2f7c-59f6-444d-9e39-b7a82080db23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.332902 Mar 26 20:59:22.443447 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1591/2979] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:22 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:22.458654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebe7515f-dcbf-485e-a4ad-e3dfc4ad5aaf tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:22.459964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ebe7515f-dcbf-485e-a4ad-e3dfc4ad5aaf tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:22.562494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ebe7515f-dcbf-485e-a4ad-e3dfc4ad5aaf tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:22.576588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebe7515f-dcbf-485e-a4ad-e3dfc4ad5aaf tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1216 microversion: 2.1 time: 0.129699 Mar 26 20:59:22.578754 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1592/2980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:22 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:22.585159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:22.585979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:22.596355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.597246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.613561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.616364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.749680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:22.758522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-713e5f6b-8f3a-474d-88c9-61658ab000ec tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.660245 Mar 26 20:59:22.761768 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1389/2981] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:22 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:22.767185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:22.769530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:22.785180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.787900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:22.789257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:22.794984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:23.360163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:23.376925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:23.381374 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e758ff7-b607-4292-9fcc-3a1c073b3413 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.617134 Mar 26 20:59:23.384030 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1390/2982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:22 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:23.389573 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59926bcf-29cf-45d6-90a4-f37189cbd0d5 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.806704 Mar 26 20:59:23.395680 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1593/2983] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:22 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:23.414768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:23.417327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:23.435757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:23.438448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:23.444263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:23.445251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:23.561973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-589156567", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:23.631207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] validate_networks() for [('30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:59:24.105960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:24.117287 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6947a834-1bd2-459c-a2f1-04cffdd9cb52 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1523 microversion: 2.1 time: 0.731410 Mar 26 20:59:24.124756 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1391/2984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:23 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1523 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:24.132643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:24.133709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:24.140927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.141887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.142746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.143318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.260239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:24.270187 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88ef8830-c8a3-4669-8731-5ee486c11e68 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1274 microversion: 2.1 time: 0.143494 Mar 26 20:59:24.282002 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1392/2985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:24 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:24.288067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:24.288981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:24.296649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.297446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.298466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.299139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.497214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:59:24.497740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:59:24.498224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:59:24.498732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:59:24.499246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:59:24.535689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.536419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.537299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.537753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.574495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:24.587135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:24.606920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:59:24.609378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:59:24.677543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a934fd4f-821e-4991-b9f5-2efcf18067e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121029 Mar 26 20:59:24.678215 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1594/2986] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 20:59:24.685952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:24.686994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:24.694973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.695537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.696448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:24.696980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:24.874622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:24.886328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa05ff88-ffac-43a6-8bf1-8524eacae8ca tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.205439 Mar 26 20:59:24.887545 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1595/2987] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:24 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:24.893341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bb86297e-03bd-4de7-b576-7d674ce802f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:24.894100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bb86297e-03bd-4de7-b576-7d674ce802f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:24.950820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb86297e-03bd-4de7-b576-7d674ce802f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:24.958060 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bb86297e-03bd-4de7-b576-7d674ce802f5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1214 microversion: 2.1 time: 0.069162 Mar 26 20:59:24.959268 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1596/2988] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:24 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:25.083575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:25.092426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7632a743-d458-4581-aa7a-9e66069b9cae tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.808686 Mar 26 20:59:25.093279 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1393/2989] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:24 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:25.136032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:25.136562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:25.143794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.145900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.146965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.147418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.290623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:25.291294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:25.307334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.308303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.310713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.312566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.396377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:25.404201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c478335-f3c0-4a9c-be11-c88de006e76c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1503 microversion: 2.1 time: 0.272096 Mar 26 20:59:25.408361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1597/2990] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:25 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:25.428613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:25.429255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:25.438093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.438565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.439615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.440489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.715098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:25.739857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db41e82e-c97e-44e8-a1e9-a3a8e630915d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1516 microversion: 2.1 time: 0.316375 Mar 26 20:59:25.745308 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1598/2991] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:25 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:25.773245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a410a16c-ce9c-4682-9946-82edfd3a5baf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:25.775273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a410a16c-ce9c-4682-9946-82edfd3a5baf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: adb0fdda-584f-4572-979f-86426ed8b08e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:25.789759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a410a16c-ce9c-4682-9946-82edfd3a5baf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Instance adb0fdda-584f-4572-979f-86426ed8b08e could not be found. Mar 26 20:59:25.790868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a410a16c-ce9c-4682-9946-82edfd3a5baf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 404 to user: Instance adb0fdda-584f-4572-979f-86426ed8b08e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:25.807809 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a410a16c-ce9c-4682-9946-82edfd3a5baf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/adb0fdda-584f-4572-979f-86426ed8b08e/action" status: 404 len: 111 microversion: 2.1 time: 0.044490 Mar 26 20:59:25.820101 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1599/2992] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:25 2022] POST /compute/v2.1/servers/adb0fdda-584f-4572-979f-86426ed8b08e/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:25.835067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:25.836159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:25.855385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.858553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.859482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:25.865093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:25.998519 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3cab6eb-af06-406a-bdd1-b856223eaae6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action" status: 202 len: 0 microversion: 2.1 time: 0.176718 Mar 26 20:59:25.999797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1600/2993] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:25 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:26.010382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:26.015570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.032072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.032621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.039223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.039691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.368488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:26.385166 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cdb54f56-af1d-40f5-86cc-54baa20380bc tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 1.100172 Mar 26 20:59:26.385983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1394/2994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:25 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:26.390772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:26.391389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.405697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.406534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.407586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.408197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.412833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:26.421251 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-197b4a1c-454b-4c0b-b0d1-dfe500e4e2f8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 0.419328 Mar 26 20:59:26.425432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1601/2995] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:26 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:26.441347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:26.442026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.455049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.457091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.458712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.461824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.601799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:26.632835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0011b2a7-8b82-4917-bd07-30ef6b80b489 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1272 microversion: 2.1 time: 0.245463 Mar 26 20:59:26.633434 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1395/2996] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:26 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:26.643692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:26.652098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.661781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.662377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.664447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.669190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.770251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:26.790844 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8abf6ba7-e173-4ec0-b072-a11a32f55985 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1501 microversion: 2.1 time: 0.364043 Mar 26 20:59:26.807096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1602/2997] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:26 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:26.812107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a5cfc303-2d78-417b-a037-35082d8d88f3 req-be3b602f-709a-4b1f-b336-e3a719f9441d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09615731-6e79-49e6-b750-c6412628ecab", "name": "network-vif-plugged", "status": "completed", "tag": "74586d05-0a23-40a4-a976-8b3ddbbcbf41"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:26.821129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a5cfc303-2d78-417b-a037-35082d8d88f3 req-be3b602f-709a-4b1f-b336-e3a719f9441d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.821594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a5cfc303-2d78-417b-a037-35082d8d88f3 req-be3b602f-709a-4b1f-b336-e3a719f9441d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.834761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a5cfc303-2d78-417b-a037-35082d8d88f3 req-be3b602f-709a-4b1f-b336-e3a719f9441d service nova] Creating event network-vif-plugged:74586d05-0a23-40a4-a976-8b3ddbbcbf41 for instance 09615731-6e79-49e6-b750-c6412628ecab on nch1-master-1 Mar 26 20:59:26.840803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a5cfc303-2d78-417b-a037-35082d8d88f3 req-be3b602f-709a-4b1f-b336-e3a719f9441d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032449 Mar 26 20:59:26.841637 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1603/2998] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:26.849449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:26.850839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.857882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.858345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.859152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.859608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.890662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'flavor' on Instance uuid 181cdcdc-74c2-4b78-b19a-090890ca8a8b {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:59:26.904870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Cannot 'rescue' instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b while it is in vm_state paused Mar 26 20:59:26.905584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 409 to user: Cannot 'rescue' instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b while it is in vm_state paused {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:26.906456 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1760093-5f21-421e-9bbb-230777a056ae tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action" status: 409 len: 144 microversion: 2.1 time: 0.063176 Mar 26 20:59:26.907081 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1604/2999] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:26 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action => generated 144 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:59:26.915767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:26.916237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:26.922154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.922608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:26.923390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:26.923827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.020666 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e41d9d08-8bf9-4502-8002-f01d238173af tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action" status: 202 len: 0 microversion: 2.1 time: 0.106390 Mar 26 20:59:27.023957 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1605/3000] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:26 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:59:27.041682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:27.042375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:27.049400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.050465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.051261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.052318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.287626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:27.297433 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1bc8811-f96a-4024-ab15-a89b18651455 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1508 microversion: 2.1 time: 0.264357 Mar 26 20:59:27.308094 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1606/3001] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:27 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:27.403577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:27.404384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:27.409020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:27.426862 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b04a76bc-bc4f-440a-86cb-571f0f7edcc0 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.790783 Mar 26 20:59:27.431532 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1396/3002] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:26 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:27.431978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.432647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.434475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.435081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.449320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:27.451651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:27.460302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.464759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.468156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.472725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.721590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:27.733300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bf023a1d-683a-489a-b3b6-e6891ef50785 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.334162 Mar 26 20:59:27.735206 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1607/3003] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:27 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:27.749346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:27.752600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:27.763162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.763902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.764756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:27.765365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:27.850381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:27.857930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8eac4bd4-f4b9-4151-966a-ac013d5d4492 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1272 microversion: 2.1 time: 0.121494 Mar 26 20:59:27.858795 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1608/3004] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:27 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:28.316291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:28.317282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:28.324572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.325238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:28.326722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.327335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:28.538446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:28.553338 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f3b86fa-52b6-4097-b1e7-aad68bd6c169 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1292 microversion: 2.1 time: 1.108513 Mar 26 20:59:28.554846 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1397/3005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:27 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1292 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:28.561041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:28.562030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:28.570909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.571052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:28.571570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:28.572510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.573470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:28.581843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b88b4a0b-9b30-455d-ad0f-e281a12a1d91 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1516 microversion: 2.1 time: 0.270370 Mar 26 20:59:28.582451 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1609/3006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:28 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:28.752956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:28.755096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:28.766504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.770179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:28.772666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:28.773443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.209952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:29.217519 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f2101ac-715c-4a8d-8c51-25444a2cb231 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.471113 Mar 26 20:59:29.227226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1610/3007] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:28 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:29.232515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:29.233796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:29.240766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:29.241246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.242171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:29.242634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.334529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:29.348128 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1c2ea898-6cc6-48cc-8ded-0750ea3fb5f9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.792185 Mar 26 20:59:29.349239 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1398/3008] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:28 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:29.558405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-81846d75-a164-4953-95f4-80d1cc9214d0 req-ddc2475d-face-4345-ad61-0d24ded0647e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fea3714-7920-4e94-bf4c-ac35625e7bd0", "tag": "d49002ae-107b-4214-8a27-9406b4f5cade"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:29.573355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-81846d75-a164-4953-95f4-80d1cc9214d0 req-ddc2475d-face-4345-ad61-0d24ded0647e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:29.574070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-81846d75-a164-4953-95f4-80d1cc9214d0 req-ddc2475d-face-4345-ad61-0d24ded0647e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.587273 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-81846d75-a164-4953-95f4-80d1cc9214d0 req-ddc2475d-face-4345-ad61-0d24ded0647e service nova] Creating event network-changed:d49002ae-107b-4214-8a27-9406b4f5cade for instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 on nch1-master-1 Mar 26 20:59:29.593752 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-81846d75-a164-4953-95f4-80d1cc9214d0 req-ddc2475d-face-4345-ad61-0d24ded0647e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238637 Mar 26 20:59:29.594659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1399/3009] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:59:29.607745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:29.608792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:29.620524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:29.621295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.622480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:29.623189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:29.720210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:29.731740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf2ef1bd-5691-425c-9eab-ad37a0687678 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.503286 Mar 26 20:59:29.733014 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1611/3010] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:29 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:30.130822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:30.138907 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a0ee02fb-7be6-469d-8eb3-4dcfe1076bd8 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1482 microversion: 2.1 time: 0.535471 Mar 26 20:59:30.157960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:30.158713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1400/3011] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:29 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1482 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:30.159435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:30.167643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.168377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.169639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.170416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.173324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:30.173844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:30.182084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.182920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.184935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.185428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.202222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'flavor' on Instance uuid 181cdcdc-74c2-4b78-b19a-090890ca8a8b {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:59:30.303981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c0c5ea20-938a-47c1-8e85-09dda8ff67ca tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action" status: 200 len: 32 microversion: 2.1 time: 0.150183 Mar 26 20:59:30.305992 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1612/3012] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:30 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:30.315862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:30.317255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:30.327490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.328297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.329583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.330213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.601485 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-306829d6-96c3-4bbd-9aa9-94739df35b65 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.441522 Mar 26 20:59:30.602724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1401/3013] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 20:59:30 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:30.607745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:30.608540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:30.623837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.626643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.627726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.628394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.719770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:30.727872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7a76ce1-ff26-4598-9d66-a56fa2270626 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.419920 Mar 26 20:59:30.738940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1613/3014] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:30 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:30.752431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:30.753130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:30.761208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.761872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:30.764935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:30.765608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:31.255495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:31.264334 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04334187-4ce6-413f-a274-685dc2441cad tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.523507 Mar 26 20:59:31.274574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1614/3015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:30 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:31.274574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:31.278753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:31.283183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:31.283728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:31.285256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:31.285794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:31.528465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:31.539505 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60fd97ce-82b9-47ed-bb83-8cb36e148b16 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.270290 Mar 26 20:59:31.540017 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1615/3016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:31 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:31.744473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:31.745325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:31.753734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:31.754198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:31.754995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:31.755450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:31.899388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:31.907979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:31.908824 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ed5fd2ac-228e-441b-8093-ce27a26ddbff tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.167771 Mar 26 20:59:31.919119 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1616/3017] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:31 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:31.919423 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6fa5daa-3ff5-4524-91e2-7d7b38fdd77a tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 1.312588 Mar 26 20:59:31.919423 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1402/3018] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:30 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:32.286469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:32.286986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:32.294449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.294918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.295698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.296164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.438138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-12ab10a9-33e5-4b1c-b912-69ccd26affde req-2a2c0f32-123f-4042-bd54-a65a4825f459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66eb7a91-bf1d-40ca-882d-97bb20634c24", "tag": "731af6f7-c114-4f9d-be99-1eaeecb622c2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:32.456796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-12ab10a9-33e5-4b1c-b912-69ccd26affde req-2a2c0f32-123f-4042-bd54-a65a4825f459 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.459417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-12ab10a9-33e5-4b1c-b912-69ccd26affde req-2a2c0f32-123f-4042-bd54-a65a4825f459 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.469706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:32.478059 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-789eff56-61b5-4990-a3e8-d45a0ffaceee tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.195574 Mar 26 20:59:32.478660 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1617/3019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:32 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:32.489920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-12ab10a9-33e5-4b1c-b912-69ccd26affde req-2a2c0f32-123f-4042-bd54-a65a4825f459 service nova] Creating event network-changed:731af6f7-c114-4f9d-be99-1eaeecb622c2 for instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 on nch2-master-1 Mar 26 20:59:32.494939 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-12ab10a9-33e5-4b1c-b912-69ccd26affde req-2a2c0f32-123f-4042-bd54-a65a4825f459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060878 Mar 26 20:59:32.495637 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1403/3020] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 20:59:32.556848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:32.557560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:32.564569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.565031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.565823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.566270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.714026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:32.721551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7794942-61a8-4207-8391-bdac1e893950 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.168589 Mar 26 20:59:32.722323 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1618/3021] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:32 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:32.928037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:32.929126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:32.934172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:32.935364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:32.935574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.936249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.937036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.937737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.942592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.943052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:32.944597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:32.945261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:33.130146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:33.137838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10be6ed2-d562-4ac1-a8d0-0197f39742d7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.207882 Mar 26 20:59:33.140563 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1619/3022] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:32 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:33.506928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:33.507585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:33.515150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:33.516785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:33.517872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:33.518559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:33.684545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:33.694468 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31743251-a914-4a3b-a44d-b84b8b752608 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.201571 Mar 26 20:59:33.695204 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1620/3023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:33 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:33.858367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1146433647", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "bed7c102-81ae-4d0f-9222-79cbabeb217f"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:33.953412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] validate_networks() for [('bed7c102-81ae-4d0f-9222-79cbabeb217f', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 20:59:34.019523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:34.042815 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cfdd998d-ae60-400f-957b-6fad480786df tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 1.114867 Mar 26 20:59:34.051384 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1404/3024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:32 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:34.087738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:34.088795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:34.106404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.107125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.108688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.109269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.606672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:34.619047 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad8fd9bd-517a-420e-bba3-88b33a9e6524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.545915 Mar 26 20:59:34.628520 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1405/3025] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:34 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:34.638740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:34.639500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:34.646181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.646883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.647886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.648975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.690401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 20:59:34.691494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 20:59:34.692279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 20:59:34.693402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 20:59:34.694048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 20:59:34.706646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.707546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.708675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.709594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.729773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:34.735795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for user fdd16c1bdb3d416d8421202397566d1c and project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:34.751398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 20:59:34.754501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 20:59:34.828058 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49d3ac6f-2b9d-48a9-a253-65d452e67f03 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125869 Mar 26 20:59:34.836119 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1621/3026] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 20:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 20:59:34.843186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:34.844107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:34.870827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.871767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:34.873655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:34.875199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.385933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:35.394513 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84fb2c2a-5326-4d89-bda1-ffc0a5de6dd3 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.556266 Mar 26 20:59:35.397582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:35.398250 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1622/3027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:34 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:35.404567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b21f4da2-13c8-4bba-8854-9afa27c90894 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:35.405752 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-950b78dd-a34b-4b91-96c1-b66ee2963b3e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.776065 Mar 26 20:59:35.409150 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1406/3028] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:34 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:35.421280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:35.422483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b21f4da2-13c8-4bba-8854-9afa27c90894 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:35.424271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:35.436071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:35.436524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.437305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:35.437749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.542164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b21f4da2-13c8-4bba-8854-9afa27c90894 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:35.552447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b21f4da2-13c8-4bba-8854-9afa27c90894 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1208 microversion: 2.1 time: 0.152855 Mar 26 20:59:35.554151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1623/3029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:35 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:35.563271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:35.563886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:35.576366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:35.577042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.578955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:35.579652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.888489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:35.918494 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-159f0ace-a572-40c3-bbf9-149b364adc60 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.493654 Mar 26 20:59:35.925202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1407/3030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:35 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:35.941617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ffe81132-1ab6-4d83-8d51-8e6d6eb948ed req-2cf7d5bf-ba77-4696-bc06-2313e2727d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09615731-6e79-49e6-b750-c6412628ecab", "tag": "74586d05-0a23-40a4-a976-8b3ddbbcbf41"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:35.959339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ffe81132-1ab6-4d83-8d51-8e6d6eb948ed req-2cf7d5bf-ba77-4696-bc06-2313e2727d85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:35.963366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ffe81132-1ab6-4d83-8d51-8e6d6eb948ed req-2cf7d5bf-ba77-4696-bc06-2313e2727d85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:35.976408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:35.987991 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-485c7b0b-78be-4e33-b19f-7c6308e12d2a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1482 microversion: 2.1 time: 0.430526 Mar 26 20:59:35.994633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ffe81132-1ab6-4d83-8d51-8e6d6eb948ed req-2cf7d5bf-ba77-4696-bc06-2313e2727d85 service nova] Creating event network-changed:74586d05-0a23-40a4-a976-8b3ddbbcbf41 for instance 09615731-6e79-49e6-b750-c6412628ecab on nch1-master-1 Mar 26 20:59:35.996728 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1624/3031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:35 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1482 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:36.003381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:36.004524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:36.025418 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ffe81132-1ab6-4d83-8d51-8e6d6eb948ed req-2cf7d5bf-ba77-4696-bc06-2313e2727d85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098660 Mar 26 20:59:36.026329 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1408/3032] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:36.034181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.037161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:36.039508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.041436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:36.413235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:36.414537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:36.426830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.429645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:36.430624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.432773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:36.455218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:36.465514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d07895ce-fa17-4f22-a202-9ca1b2514aa2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.467401 Mar 26 20:59:36.478444 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1625/3033] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:35 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:36.484198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:36.493716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:36.501322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.501918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:36.502971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:36.503523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.482433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:37.492099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a0cfb8f7-2206-4f63-822c-a6ce93c247c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 1.011718 Mar 26 20:59:37.492874 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1626/3034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:36 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:37.502319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:37.503063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:37.509372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.509978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.512976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.513517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.604302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:37.607009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:37.616231 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8467c85e-e53c-4137-8e36-a1b3b11031e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1266 microversion: 2.1 time: 0.118313 Mar 26 20:59:37.617709 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1627/3035] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:37 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:37.621628 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-549a4f6e-459f-428b-9a9b-45ca2a0886d7 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 1.213697 Mar 26 20:59:37.624265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:37.625339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:37.627599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1409/3036] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:36 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:37.634418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.635004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.635279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:37.635901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:37.636188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.636828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.646504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.647284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.648596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:37.649200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:37.933718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:37.944176 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fbf91110-0de0-423e-a2db-2309ab7cbf35 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.315389 Mar 26 20:59:37.945113 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1410/3037] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:37 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:38.131681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b187ce01-e490-4662-a839-7aeb8b1e01ff req-3f32fc7d-a6cc-4a85-9647-6d44a25b76bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fea3714-7920-4e94-bf4c-ac35625e7bd0", "name": "network-vif-plugged", "status": "completed", "tag": "d49002ae-107b-4214-8a27-9406b4f5cade"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:38.142908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b187ce01-e490-4662-a839-7aeb8b1e01ff req-3f32fc7d-a6cc-4a85-9647-6d44a25b76bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.143316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:38.143904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b187ce01-e490-4662-a839-7aeb8b1e01ff req-3f32fc7d-a6cc-4a85-9647-6d44a25b76bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.158932 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b187ce01-e490-4662-a839-7aeb8b1e01ff req-3f32fc7d-a6cc-4a85-9647-6d44a25b76bf service nova] Creating event network-vif-plugged:d49002ae-107b-4214-8a27-9406b4f5cade for instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 on nch1-master-1 Mar 26 20:59:38.159165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e958bec-964a-42c3-afc3-31bf37375d73 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.539522 Mar 26 20:59:38.164546 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b187ce01-e490-4662-a839-7aeb8b1e01ff req-3f32fc7d-a6cc-4a85-9647-6d44a25b76bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 Mar 26 20:59:38.165021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1628/3038] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:37 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:38.165955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1411/3039] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:38.509445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:38.510644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:38.517010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.517579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.518453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.518898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.635069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:38.636426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:38.642777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.643300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.644435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.645108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.757820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:38.766579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ddfd09f-4a42-414b-934a-11b5df3d186e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.260836 Mar 26 20:59:38.767598 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1629/3040] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:38 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:38.773249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:38.774379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:38.782494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.783089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:38.784131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:38.784762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.010783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:39.034035 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87becfcb-26dd-4622-831f-463137e65423 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.403464 Mar 26 20:59:39.035500 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1412/3041] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:38 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:39.043383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:39.044440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:39.057705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.059489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.071130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.071814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.081721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:39.095867 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d083180a-72ad-4891-bc96-db4270afaa7c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.327018 Mar 26 20:59:39.096668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1630/3042] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:38 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:39.182106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:39.182762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:39.190155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.190886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.191675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.192702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.437564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:39.447838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fb8ea90-9a76-4441-a6f4-7be5dfcee33a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1316 microversion: 2.1 time: 0.268926 Mar 26 20:59:39.449241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1631/3043] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:39 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:39.558196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:39.567277 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-71fc597f-c3fc-4d6f-b63f-89e2a1b89bbe tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.529016 Mar 26 20:59:39.568279 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1413/3044] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:39 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:39.787819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:39.788598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:39.796184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.797243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.798585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.799316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.830779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e7e11127-904b-4c91-8be2-626a0da5c487 req-02568130-a9bd-4039-8f8f-7c54b5b0052e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724266e8-a6b9-48ad-8ae7-cebb995e13c2", "tag": "a7faa08b-872e-4394-814a-c7ee682c1e20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:39.841076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e7e11127-904b-4c91-8be2-626a0da5c487 req-02568130-a9bd-4039-8f8f-7c54b5b0052e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:39.841947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e7e11127-904b-4c91-8be2-626a0da5c487 req-02568130-a9bd-4039-8f8f-7c54b5b0052e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:39.855620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e7e11127-904b-4c91-8be2-626a0da5c487 req-02568130-a9bd-4039-8f8f-7c54b5b0052e service nova] Creating event network-changed:a7faa08b-872e-4394-814a-c7ee682c1e20 for instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 on nch1-master-1 Mar 26 20:59:39.864164 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e7e11127-904b-4c91-8be2-626a0da5c487 req-02568130-a9bd-4039-8f8f-7c54b5b0052e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134233 Mar 26 20:59:39.864850 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1632/3045] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:40.054276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:40.057730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:40.063474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:40.069071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10d6b88b-bd93-4182-b937-2da0c45da925 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.287658 Mar 26 20:59:40.070425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1414/3046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:39 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:40.079979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.080737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.081838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.082370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.114015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:40.114903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:40.124056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.126697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.129153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.129744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.393127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:40.400153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-42567bcb-703c-457d-b548-ba3ca6e53f33 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.290720 Mar 26 20:59:40.401133 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1415/3047] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:40 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:40.413029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6bfb07a8-835c-4db4-bb32-694be7e57534 req-f8d61ce6-03b3-4f12-bc64-da456ab05d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66eb7a91-bf1d-40ca-882d-97bb20634c24", "name": "network-vif-plugged", "status": "completed", "tag": "731af6f7-c114-4f9d-be99-1eaeecb622c2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:40.424207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bfb07a8-835c-4db4-bb32-694be7e57534 req-f8d61ce6-03b3-4f12-bc64-da456ab05d77 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.424942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bfb07a8-835c-4db4-bb32-694be7e57534 req-f8d61ce6-03b3-4f12-bc64-da456ab05d77 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.441209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6bfb07a8-835c-4db4-bb32-694be7e57534 req-f8d61ce6-03b3-4f12-bc64-da456ab05d77 service nova] Creating event network-vif-plugged:731af6f7-c114-4f9d-be99-1eaeecb622c2 for instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 on nch2-master-1 Mar 26 20:59:40.451791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6bfb07a8-835c-4db4-bb32-694be7e57534 req-f8d61ce6-03b3-4f12-bc64-da456ab05d77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044291 Mar 26 20:59:40.452542 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1416/3048] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:40.470518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:40.472101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:40.492945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.494170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.494998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.495448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.709560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:40.719167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f992f99d-f751-4a9a-92af-d55fff60198c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.672117 Mar 26 20:59:40.719775 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1633/3049] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:40 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:40.734079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:40.735467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:40.743584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.744951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:40.746025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:40.746723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.158837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:41.161365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:41.169454 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9799f866-822c-4a2c-8faa-2eb3b3a01b87 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.448294 Mar 26 20:59:41.179732 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1634/3050] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:40 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:41.179732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:41.179732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:41.182248 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da084787-5bc6-4cca-828b-7605542d8dea tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1505 microversion: 2.1 time: 0.718375 Mar 26 20:59:41.184206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.185169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.186555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1417/3051] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:40 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:41.187363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.189034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.203350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1162989145"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:41.204036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:41.212854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.214247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.217530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.218284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.489510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:41.497860 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d638bc2-0774-4a20-8fa2-0b02f5711e17 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.325921 Mar 26 20:59:41.498697 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1635/3052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:41 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:41.514263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:41.515419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:41.522939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.523510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.524590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.525239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.540142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.security_group_api [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Adding security group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 to port d49002ae-107b-4214-8a27-9406b4f5cade Mar 26 20:59:41.884507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:41.892743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3df58098-89bb-4f02-b3a8-7e79eccbf1c8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.383535 Mar 26 20:59:41.893668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1636/3053] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:41 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:41.898812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:41.899705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:41.906510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.907279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:41.908352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:41.908875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.229515 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-540a8439-31e3-496b-a6d1-6ca8040bf403 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action" status: 202 len: 0 microversion: 2.1 time: 1.030087 Mar 26 20:59:42.230134 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1418/3054] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:41 2022] POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:42.236719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:42.237714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:42.258206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.258692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.260905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.262073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.330044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:42.343746 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d581399-b8a8-4d28-a8a0-5c2e0ab40152 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.447779 Mar 26 20:59:42.344456 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1637/3055] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:41 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:42.361339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ccd38bee-4a4c-4a66-a336-a6ad537ec60a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e582f6280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:42.519089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:42.528934 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ebacf6b6-d3cf-46e9-85c1-8f6d4ccef20b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1314 microversion: 2.1 time: 0.297238 Mar 26 20:59:42.530004 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1419/3056] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:42 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:42.534841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5c5fb9bc-90e6-4215-b700-db70a91902b6 req-171eec07-2ed7-4198-bf7e-5a90197d75cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fea3714-7920-4e94-bf4c-ac35625e7bd0", "tag": "d49002ae-107b-4214-8a27-9406b4f5cade"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:42.545536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5c5fb9bc-90e6-4215-b700-db70a91902b6 req-171eec07-2ed7-4198-bf7e-5a90197d75cb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.546311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5c5fb9bc-90e6-4215-b700-db70a91902b6 req-171eec07-2ed7-4198-bf7e-5a90197d75cb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.562516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5c5fb9bc-90e6-4215-b700-db70a91902b6 req-171eec07-2ed7-4198-bf7e-5a90197d75cb service nova] Creating event network-changed:d49002ae-107b-4214-8a27-9406b4f5cade for instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 on nch1-master-1 Mar 26 20:59:42.569717 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5c5fb9bc-90e6-4215-b700-db70a91902b6 req-171eec07-2ed7-4198-bf7e-5a90197d75cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037885 Mar 26 20:59:42.570811 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1420/3057] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:42.578226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:42.579188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:42.587631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.588426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.589747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.590412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.694707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-ccd38bee-4a4c-4a66-a336-a6ad537ec60a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 in use.", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:42.696229 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ccd38bee-4a4c-4a66-a336-a6ad537ec60a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security Group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 in use. Mar 26 20:59:42.696229 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-a68cf21f-33f9-4968-8cf8-ae3f7c9d5e2a'] Mar 26 20:59:42.701742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ccd38bee-4a4c-4a66-a336-a6ad537ec60a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 400 to user: Security Group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 in use. Mar 26 20:59:42.701742 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-a68cf21f-33f9-4968-8cf8-ae3f7c9d5e2a'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:42.703091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ccd38bee-4a4c-4a66-a336-a6ad537ec60a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37" status: 400 len: 185 microversion: 2.1 time: 0.352203 Mar 26 20:59:42.704733 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1638/3058] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:42 2022] DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37 => generated 185 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:59:42.742925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:42.748687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:42.777483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.778817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.780600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.781619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.787342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:42.798191 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e129233d-7341-4845-9ad9-94094b1db5c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.225951 Mar 26 20:59:42.809602 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1421/3059] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:42 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:42.892218 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aae2f7bd-424d-457f-8bf5-4ea6fa2f2316 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action" status: 202 len: 0 microversion: 2.1 time: 0.182694 Mar 26 20:59:42.893163 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1639/3060] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:42 2022] POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 20:59:42.902687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:42.903653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:42.914838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.915601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.916849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.918139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.924904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:42.926156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:42.934977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.935763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:42.936858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:42.937554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.090193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:43.097631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-75e6ad99-f408-4784-b815-83611e95032e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1576 microversion: 2.1 time: 0.200244 Mar 26 20:59:43.098203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1422/3061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:42 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:43.361670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:43.363019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:43.373490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.375419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.376468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.377125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.416827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:43.431121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f7b9552-a26a-4f67-94ab-3cb32b9f9468 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.515557 Mar 26 20:59:43.432184 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1640/3062] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:42 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:43.546201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:43.547185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:43.554898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.555675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.556717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.557429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.571541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:43.595838 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44f934dd-1531-4ba9-a41d-4ed6e2815af8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.235255 Mar 26 20:59:43.596772 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1423/3063] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:43 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:43.827301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:43.828216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:43.837376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.838069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.838859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.839282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.877217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:43.891493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca48e0d5-9b51-4d30-8f32-11b149bcfa8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1500 microversion: 2.1 time: 0.343366 Mar 26 20:59:43.892167 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1641/3064] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:43 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1500 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:43.908944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:43.910111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:43.918595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.921857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.922968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:43.923887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:43.967368 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96a78393-6b97-4aa3-ac3d-c8910adaed59 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.062382 Mar 26 20:59:43.970986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1642/3065] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:43 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 20:59:44.123780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:44.127106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:44.140947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.142690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.143942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.144640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.380956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:44.389332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e5942f8d-816b-4058-a0ce-70667859bffb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.568385 Mar 26 20:59:44.390130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1424/3066] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:43 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:44.451041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:44.451816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:44.461640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.462346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.463360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.464079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.698887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:44.707806 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c4a7405-f8ab-46e8-b09c-67cd34f024e9 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1576 microversion: 2.1 time: 0.594030 Mar 26 20:59:44.717783 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1643/3067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:44 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1576 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:44.724780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:44.725502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:44.731685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:44.732908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.733254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.736305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.736305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.748453 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b091ad1-643e-46ee-b641-63de58b14111 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1487 microversion: 2.1 time: 0.302858 Mar 26 20:59:44.749641 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1425/3068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:44 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1487 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:44.768359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:44.769495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:44.778440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.779169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.780739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.781385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.868435 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60de746f-8a74-496f-87cf-677ef07f400b tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "POST /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864/action" status: 202 len: 0 microversion: 2.1 time: 0.106425 Mar 26 20:59:44.872501 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1426/3069] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:44 2022] POST /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:44.878932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:44.879958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:44.886774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.887617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:44.888664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:44.889288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.023873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:45.043729 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4b54315e-29f9-48dc-89f9-2e7df0f2ab37 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.324511 Mar 26 20:59:45.045591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1644/3070] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:44 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:45.058940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:45.060542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:45.069525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.070539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.071422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.071981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.126601 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f425fe4-bf2e-4f9e-bc43-af0ac0573f8b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.078120 Mar 26 20:59:45.128358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1645/3071] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:45 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:45.341002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:45.348638 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c862c18a-891e-4d0d-8ca0-83c31e87efa9 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1495 microversion: 2.1 time: 0.474565 Mar 26 20:59:45.349540 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1427/3072] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:44 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1495 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:45.407432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:45.408570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:45.417789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.418490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.419432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.419980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.618943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:45.629007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a6b18a8-916a-4051-b3e2-ab8e5203ddc8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.226083 Mar 26 20:59:45.630083 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1646/3073] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:45 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:45.727092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:45.728073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:45.735360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.736385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:45.737728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:45.738404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.066525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:46.068793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:46.081634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.082116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.083834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.084466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.411161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:46.414325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:46.418726 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3ebcd0b-b09a-4a97-88da-e08ca164bd8b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1574 microversion: 2.1 time: 0.697321 Mar 26 20:59:46.419501 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1428/3074] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:45 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1574 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:46.422254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1c6fb43a-b8c9-4dc0-95a2-86b43c3b3361 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.363239 Mar 26 20:59:46.425592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1647/3075] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:46 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:46.441259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:46.442749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:46.454853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.455480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.456904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.459081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.518011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e333cee-6bba-4dd3-a222-c0d7e4305cd7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.090987 Mar 26 20:59:46.522814 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1648/3076] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:46 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:46.528364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:46.529263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:46.539184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.539821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.540796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.541400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.590611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4f449344-8ebf-41fd-8af6-4db3d7f29b5c req-065a5f29-cea4-4658-968d-33a20b4b49ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724266e8-a6b9-48ad-8ae7-cebb995e13c2", "name": "network-vif-plugged", "status": "completed", "tag": "a7faa08b-872e-4394-814a-c7ee682c1e20"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:46.601641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4f449344-8ebf-41fd-8af6-4db3d7f29b5c req-065a5f29-cea4-4658-968d-33a20b4b49ca service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.602366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4f449344-8ebf-41fd-8af6-4db3d7f29b5c req-065a5f29-cea4-4658-968d-33a20b4b49ca service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.615560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4f449344-8ebf-41fd-8af6-4db3d7f29b5c req-065a5f29-cea4-4658-968d-33a20b4b49ca service nova] Creating event network-vif-plugged:a7faa08b-872e-4394-814a-c7ee682c1e20 for instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 on nch1-master-1 Mar 26 20:59:46.622375 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4f449344-8ebf-41fd-8af6-4db3d7f29b5c req-065a5f29-cea4-4658-968d-33a20b4b49ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201350 Mar 26 20:59:46.623720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1429/3077] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:46.631221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-361795784"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:46.632186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:46.639025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.640223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.641213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.642076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.888669 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.security_group_api [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Adding security group 34db9745-5cca-4366-a65c-30c2c58454dc to port d49002ae-107b-4214-8a27-9406b4f5cade Mar 26 20:59:46.952602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:46.961114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d87c168b-c177-4959-b737-450afbe82663 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1495 microversion: 2.1 time: 0.436873 Mar 26 20:59:46.961806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1649/3078] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:46 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:46.972893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:46.974254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:46.980482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.981742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:46.982059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:46.982377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.195908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:47.206276 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca7e4370-6949-4f3a-adb5-4543d461f7c9 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.237040 Mar 26 20:59:47.207226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1650/3079] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:46 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:47.442862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:47.444569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:47.456300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.457012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.458826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.459657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.608949 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c768aa66-8d5b-4f79-b501-8ce04b169f95 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action" status: 202 len: 0 microversion: 2.1 time: 0.983624 Mar 26 20:59:47.610070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1430/3080] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:46 2022] POST /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:47.615547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:47.616816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:47.623629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.630503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.631471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.634940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.688691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:47.702951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2f5874e-b7be-4da1-a2fb-ee20ef99dc1b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1308 microversion: 2.1 time: 0.267891 Mar 26 20:59:47.703888 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1651/3081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:47 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:47.704585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d4d6656-8b68-432e-aafc-887d316ac34a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.093140 Mar 26 20:59:47.705511 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1431/3082] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:47 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:47.712505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0128f74b-8602-438f-bea1-bdc3239b256a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e593ff160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:47.716763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0632fb4c-d590-40c3-9406-730aafd3c2c1 req-4665c1bd-b6a6-4d09-bf6f-254e4cc3f6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fea3714-7920-4e94-bf4c-ac35625e7bd0", "tag": "d49002ae-107b-4214-8a27-9406b4f5cade"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:47.735982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0632fb4c-d590-40c3-9406-730aafd3c2c1 req-4665c1bd-b6a6-4d09-bf6f-254e4cc3f6e7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.736450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0632fb4c-d590-40c3-9406-730aafd3c2c1 req-4665c1bd-b6a6-4d09-bf6f-254e4cc3f6e7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.758340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0632fb4c-d590-40c3-9406-730aafd3c2c1 req-4665c1bd-b6a6-4d09-bf6f-254e4cc3f6e7 service nova] Creating event network-changed:d49002ae-107b-4214-8a27-9406b4f5cade for instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 on nch1-master-1 Mar 26 20:59:47.763696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0632fb4c-d590-40c3-9406-730aafd3c2c1 req-4665c1bd-b6a6-4d09-bf6f-254e4cc3f6e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056641 Mar 26 20:59:47.764933 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1432/3083] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:47.979678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:47.980419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:47.995856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.996340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:47.997127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:47.997761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.307824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:48.316714 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc5e1220-5444-422f-b63e-0b2505bdbb1f tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1495 microversion: 2.1 time: 0.341955 Mar 26 20:59:48.320631 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1433/3084] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:47 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1495 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:48.322353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-0128f74b-8602-438f-bea1-bdc3239b256a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 34db9745-5cca-4366-a65c-30c2c58454dc in use.", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:48.323308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0128f74b-8602-438f-bea1-bdc3239b256a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security Group 34db9745-5cca-4366-a65c-30c2c58454dc in use. Mar 26 20:59:48.323308 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-a02abbd7-7bd0-41b3-a7d6-5c76b45a9a2a'] Mar 26 20:59:48.323935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0128f74b-8602-438f-bea1-bdc3239b256a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 400 to user: Security Group 34db9745-5cca-4366-a65c-30c2c58454dc in use. Mar 26 20:59:48.323935 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-a02abbd7-7bd0-41b3-a7d6-5c76b45a9a2a'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:48.324803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0128f74b-8602-438f-bea1-bdc3239b256a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc" status: 400 len: 185 microversion: 2.1 time: 0.619963 Mar 26 20:59:48.328391 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1652/3085] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:47 2022] DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc => generated 185 bytes in 621 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 20:59:48.334497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:48.334833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:48.335357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:48.337704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:48.350206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.350429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.350676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.351490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.351953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.353645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.355223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.357143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.411385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:59:48.512183 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31436732-e3bb-4fcc-ab15-84a42fad9865 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 204 len: 0 microversion: 2.1 time: 0.182250 Mar 26 20:59:48.513192 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1653/3086] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:59:48 2022] DELETE /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 20:59:48.527326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:48.530776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:48.542541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.543339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.543801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.544448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.718929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:48.727604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-146ea9d8-3552-4d4d-8fb2-e7969c81d5a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.405436 Mar 26 20:59:48.728232 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1434/3087] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:48 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:48.733309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:48.734476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:48.740343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.740804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.741649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.742096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.781674 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb9a2b71-0963-4541-877b-2df5fa78b3db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.051887 Mar 26 20:59:48.785248 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1435/3088] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:48 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:48.787638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:48.788371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:48.795075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.795531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.796350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:48.796798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:48.947442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:48.956630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3eab1b43-3e6d-4eb1-9101-e8fee3a47b6a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1648 microversion: 2.1 time: 0.438622 Mar 26 20:59:48.957787 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1654/3089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:48 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1648 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:49.064115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:49.076007 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ceeb54ba-e68a-4c4c-8a3f-08e1c0b68c58 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1488 microversion: 2.1 time: 0.292261 Mar 26 20:59:49.076859 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1436/3090] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:48 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1488 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:49.093240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:49.093820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.109882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.120531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.121395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.121856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.231230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3fbd65c6-da20-45bf-87c5-63db6db04aee tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2/action" status: 202 len: 0 microversion: 2.1 time: 0.140971 Mar 26 20:59:49.244265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1655/3091] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:49 2022] POST /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:49.252375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:49.253427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.260433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.261090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.274622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.275290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.338840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:49.340765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.349418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.350713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.352225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.352766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.545374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:49.554445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b28099a4-e42a-49a9-af03-3dc924509243 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1493 microversion: 2.1 time: 0.305935 Mar 26 20:59:49.555582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1437/3092] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:49 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1493 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:49.575180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:49.585037 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af2cb798-56e1-4e52-a4a3-1a15a8db9a2c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1501 microversion: 2.1 time: 0.251625 Mar 26 20:59:49.585723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1656/3093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:49 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:49.609161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:49.610603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.619490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.620151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.621160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.621994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.651763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:59:49.746827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:49.747642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.756282 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a8befce3-75fd-491d-aa20-1e5f63b55d59 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 204 len: 0 microversion: 2.1 time: 0.149633 Mar 26 20:59:49.757257 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1438/3094] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:59:49 2022] DELETE /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:59:49.758993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.760423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.761831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.762487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.766815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:49.767611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:49.774891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.775444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:49.776364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:49.776870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.282832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:50.300800 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-563ad2ff-6682-4043-a8c6-e9232dda50d4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.538607 Mar 26 20:59:50.303244 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1439/3095] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:49 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:50.309296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:50.311143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:50.318638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.319108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.319903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.320392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.341460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:50.350017 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-469d7e4a-dc6e-4c6a-8ce4-05a7dfd17bbd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 0.608670 Mar 26 20:59:50.350603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1657/3096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:49 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:50.360603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e266aa6-dacf-49d8-9ac0-6c9eacdbbfff tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.055536 Mar 26 20:59:50.361511 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1440/3097] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:50 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:50.365436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:50.366323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:50.373036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.373578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.374404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.374859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.576876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:50.578523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:50.589793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.590831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.592091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.592742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.740627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:50.763487 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ed6be35-4fa9-42a7-b777-d5468ffe0a89 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1648 microversion: 2.1 time: 0.410467 Mar 26 20:59:50.775624 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1658/3098] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:50 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1648 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:50.909534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:50.918741 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e5d4b60-ad0b-4c6f-80f3-16189368ed8e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 200 len: 1473 microversion: 2.1 time: 0.349667 Mar 26 20:59:50.930445 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1441/3099] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:50 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 1473 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:50.936209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-398154454"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:50.937519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:50.944222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.944882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:50.945852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:50.946291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.242364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e2911c3b-6f1e-4353-bb34-da9eef46026a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2/action" status: 202 len: 0 microversion: 2.1 time: 0.309885 Mar 26 20:59:51.243210 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1659/3100] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:50 2022] POST /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 20:59:51.255416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b37607d-115e-4085-a671-844a8ac53476 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5ecf9280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:51.321782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:51.323089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.342254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.344064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.345439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.345992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.358615 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b37607d-115e-4085-a671-844a8ac53476 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.109467 Mar 26 20:59:51.365284 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1442/3101] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:51 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:51.369757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:51.370510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.378209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.378993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.380190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.380876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.655560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:51.664114 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c468f36-fab7-4dc5-9c2d-7f1e78f5e0c7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1502 microversion: 2.1 time: 0.300841 Mar 26 20:59:51.664955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1443/3102] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:51 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:51.670726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:51.671719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.677720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.678186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.678975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.679454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.726277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:51.727394 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c69e7afe-ce8d-4d29-a67a-69d6bfae02d5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.059426 Mar 26 20:59:51.732555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1444/3103] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:51 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:51.737784 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f129765-75f4-46b6-bac8-0a2380020881 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.422435 Mar 26 20:59:51.747135 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1660/3104] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:51 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:51.747795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bd763159-4564-42e0-906e-bbaad13f97b3 req-92c63d15-72e8-4c50-8ee7-f2b6e999ed49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fea3714-7920-4e94-bf4c-ac35625e7bd0", "name": "network-vif-deleted", "tag": "d49002ae-107b-4214-8a27-9406b4f5cade"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:51.751091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e8e8ba-7a91-417d-bf04-163b8cd8d805"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:51.752241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.758507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bd763159-4564-42e0-906e-bbaad13f97b3 req-92c63d15-72e8-4c50-8ee7-f2b6e999ed49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.758954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bd763159-4564-42e0-906e-bbaad13f97b3 req-92c63d15-72e8-4c50-8ee7-f2b6e999ed49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.764229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.764979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.766154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.766752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.775946 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bd763159-4564-42e0-906e-bbaad13f97b3 req-92c63d15-72e8-4c50-8ee7-f2b6e999ed49 service nova] Creating event network-vif-deleted:d49002ae-107b-4214-8a27-9406b4f5cade for instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 on nch1-master-1 Mar 26 20:59:51.783934 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bd763159-4564-42e0-906e-bbaad13f97b3 req-92c63d15-72e8-4c50-8ee7-f2b6e999ed49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050889 Mar 26 20:59:51.784810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1445/3105] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:51.791181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:51.791950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.794286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Cannot 'attach_volume' instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b while it is in vm_state rescued Mar 26 20:59:51.795076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 409 to user: Cannot 'attach_volume' instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b while it is in vm_state rescued {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:51.796633 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85ddf3b7-a198-4377-9e90-78dbb5730fb1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057135 Mar 26 20:59:51.797488 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1661/3106] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 20:59:51 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 20:59:51.799038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.799505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.800534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.800968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.813825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:51.814248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.821621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.822183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.823528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.824107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.847585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.848915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.849550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lazy-loading 'fault' on Instance uuid 6fea3714-7920-4e94-bf4c-ac35625e7bd0 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 20:59:51.909132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bce7cb28-69fe-4f0e-8d00-1f6b2b2b819c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action" status: 202 len: 0 microversion: 2.1 time: 0.104010 Mar 26 20:59:51.911309 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1662/3107] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:51 2022] POST /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:51.920385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:51.921367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:51.931375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.932421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.933686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:51.934303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:51.940156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:51.949614 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87f131fb-6335-41a7-b9d5-f73699b8b532 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 200 len: 1306 microversion: 2.1 time: 0.163689 Mar 26 20:59:51.950297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1446/3108] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:51 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 1306 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:52.268425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:52.276663 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b04a6697-71a5-4263-9248-58782817ff16 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1510 microversion: 2.1 time: 0.360854 Mar 26 20:59:52.277836 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1663/3109] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:51 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:52.375727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47cb0f09-5ffb-48c1-aee0-27a5c92ab89e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5ebe5af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:52.480814 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47cb0f09-5ffb-48c1-aee0-27a5c92ab89e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.109658 Mar 26 20:59:52.484462 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1447/3110] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:52 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:52.741170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:52.742859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:52.755401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:52.756364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:52.762593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.763200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:52.764199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.764715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:52.769382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.770764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:52.771744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.776593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:52.824931 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-338e6623-8f3d-47b5-80d0-5c68ce5146e6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.089047 Mar 26 20:59:52.826435 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1664/3111] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:52 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:52.973971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:52.975118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:52.983064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.983835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:52.985237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:52.985966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:53.003858 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. Mar 26 20:59:53.016564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:53.025089 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b780b753-baf0-435d-b105-11cf9c5c4830 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 404 len: 111 microversion: 2.1 time: 0.062100 Mar 26 20:59:53.029952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1665/3112] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:52 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 20:59:53.038590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bf41e8f0-7b00-4560-813e-844abf31c1e3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e59529550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:53.230085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:53.247089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b074397-88d7-48e2-b41b-70fbc7ceb1f4 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.496150 Mar 26 20:59:53.249196 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1448/3113] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:52 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:53.281215 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bf41e8f0-7b00-4560-813e-844abf31c1e3 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37" status: 202 len: 0 microversion: 2.1 time: 0.249278 Mar 26 20:59:53.287737 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1666/3114] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:53 2022] DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:53.293990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f16af1e6-d06c-497b-9588-0b7afe023d82 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5890d700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:53.303737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:53.307106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:53.324695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:53.325652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:53.326812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:53.327354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:53.509135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:53.518713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb17e9aa-811e-4322-b710-a82b882b4d06 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1510 microversion: 2.1 time: 0.228590 Mar 26 20:59:53.519632 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1667/3115] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:53 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:53.533411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cedcf4d-b1c3-4e3d-93bf-dbd4b442b0bc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5eb2c8b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:53.594612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cedcf4d-b1c3-4e3d-93bf-dbd4b442b0bc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.073422 Mar 26 20:59:53.596259 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1668/3116] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:53 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:53.839377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:53.840566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:53.848925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:53.849705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:53.850714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:53.851367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:53.935907 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-42679782-ee83-4185-a997-ec749a38e2b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.092558 Mar 26 20:59:53.941860 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1669/3117] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:53 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:54.266803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:54.267528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:54.282005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:54.282243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:54.284070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:54.284716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:54.586489 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f16af1e6-d06c-497b-9588-0b7afe023d82 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc" status: 202 len: 0 microversion: 2.1 time: 1.296595 Mar 26 20:59:54.593905 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1449/3118] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:53 2022] DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:54.602034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:54.603155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:54.616509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:54.617371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:54.619599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:54.621090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:54.837474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:54.858178 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f9b4ed0-c555-4f5c-8535-c6a1d2569771 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 200 len: 1507 microversion: 2.1 time: 0.595308 Mar 26 20:59:54.868379 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1670/3119] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:54 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 20:59:54.874115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6e7c81b6-33ba-4cbf-8485-17dbe8009f74 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'create', calling method: .version_select at 0x7f6e58acc820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-362803533", "description": "tempest-description-1341549170"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:55.340192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:55.349647 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6e7c81b6-33ba-4cbf-8485-17dbe8009f74 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.479716 Mar 26 20:59:55.351140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1671/3120] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 20:59:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:55.354607 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6ca3c47-b162-4c88-bc80-c910857d977c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1510 microversion: 2.1 time: 0.758946 Mar 26 20:59:55.360396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae8bf0b1-be25-4ca6-a7ba-39e3d94e33ab tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e582c9ee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:55.366191 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1450/3121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:54 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1510 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:55.391995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:55.393922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:55.408634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:55.409117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:55.410033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:55.411028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:55.453217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae8bf0b1-be25-4ca6-a7ba-39e3d94e33ab tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.100688 Mar 26 20:59:55.453882 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1672/3122] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:55 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:55.465639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c603545e-ad4d-4f0d-b916-0337f7f467e7 req-d54dbe90-ceb7-4691-a252-c6badf89f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901c62c9-5a4b-4513-b027-c464f1501864", "name": "network-vif-deleted", "tag": "9734139e-042e-4a25-9ed4-1e990314944b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:55.486870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c603545e-ad4d-4f0d-b916-0337f7f467e7 req-d54dbe90-ceb7-4691-a252-c6badf89f2f6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:55.487600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c603545e-ad4d-4f0d-b916-0337f7f467e7 req-d54dbe90-ceb7-4691-a252-c6badf89f2f6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:55.496118 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c66b6ce7-e04b-4e83-8634-a96158a52de4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 14 microversion: 2.1 time: 0.126409 Mar 26 20:59:55.498111 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1451/3123] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:55 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 20:59:55.510515 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c603545e-ad4d-4f0d-b916-0337f7f467e7 req-d54dbe90-ceb7-4691-a252-c6badf89f2f6 service nova] Creating event network-vif-deleted:9734139e-042e-4a25-9ed4-1e990314944b for instance 901c62c9-5a4b-4513-b027-c464f1501864 on nch2-master-1 Mar 26 20:59:55.513060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7f34752-d595-4af3-82ab-6ac6d3cd4544 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Action: 'update', calling method: .version_select at 0x7f6e5ecf93a0>, body: {"security_group": {"name": "tempest-sg-hth-1185817038", "description": "tempest-description-hth-1801081091"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:55.525791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c603545e-ad4d-4f0d-b916-0337f7f467e7 req-d54dbe90-ceb7-4691-a252-c6badf89f2f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070641 Mar 26 20:59:55.527122 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1673/3124] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:55.885148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:55.891252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 901c62c9-5a4b-4513-b027-c464f1501864] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:55.925454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:55.934015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:55.937211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:55.941022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:55.986113 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] HTTP exception thrown: Instance 901c62c9-5a4b-4513-b027-c464f1501864 could not be found. Mar 26 20:59:55.987768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Returning 404 to user: Instance 901c62c9-5a4b-4513-b027-c464f1501864 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:55.991011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5e21d77e-21f0-4021-b1ab-13f2c4d1b94a tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864" status: 404 len: 111 microversion: 2.1 time: 0.116610 Mar 26 20:59:55.996138 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1674/3125] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:55 2022] GET /compute/v2.1/servers/901c62c9-5a4b-4513-b027-c464f1501864 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:56.006408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:56.007288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:56.015579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.017016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.018227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.018899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.095280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 20:59:56.293310 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f4cb782-b0c9-4cf9-9e9e-b20cce2f304c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 204 len: 0 microversion: 2.1 time: 0.291174 Mar 26 20:59:56.295152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1675/3126] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:59:56 2022] DELETE /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 20:59:56.304646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:56.305841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:56.318029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.321594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.321594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.321594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.337203 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7f34752-d595-4af3-82ab-6ac6d3cd4544 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d" status: 200 len: 218 microversion: 2.1 time: 0.837002 Mar 26 20:59:56.340176 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1452/3127] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Mar 26 20:59:55 2022] PUT /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d => generated 218 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:56.349670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22b56bea-bb62-481c-8317-f4a4a2eef895 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e597251f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:56.572920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:56.582275 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba7f66a4-b708-415b-a6a7-1e1e02f567a8 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1491 microversion: 2.1 time: 0.283656 Mar 26 20:59:56.592175 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1676/3128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:56 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1491 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:56.592271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:56.593000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:56.602024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.602607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.603452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.604144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.635818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22b56bea-bb62-481c-8317-f4a4a2eef895 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d" status: 200 len: 218 microversion: 2.1 time: 0.290851 Mar 26 20:59:56.637288 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1453/3129] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 20:59:56 2022] GET /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d => generated 218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:56.650415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6da4f5ec-7d10-4c1d-9dd1-6e0b767590bf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5ecf9550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:56.741719 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6da4f5ec-7d10-4c1d-9dd1-6e0b767590bf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.101829 Mar 26 20:59:56.746187 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1454/3130] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:56 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:56.757235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:56.758353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:56.796143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.796743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.797607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:56.813354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:56.918394 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d94174b-9792-414d-925d-997e652d4522 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action" status: 200 len: 8208 microversion: 2.1 time: 0.169512 Mar 26 20:59:56.919044 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1455/3131] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 20:59:56 2022] POST /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24/action => generated 8208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:56.933371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47df62e4-6eac-4560-822c-4b802f1d334b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e593f4e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.053552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:57.074627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec3022fb-7241-4cc3-a90a-4bc59eb308fd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1516 microversion: 2.1 time: 0.488631 Mar 26 20:59:57.090783 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1677/3132] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:56 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1516 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:57.098592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-18b05c3a-6936-4a31-885c-f086dfcb847c req-4a6d1af4-38fb-4c54-856f-2b8ad29302ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724266e8-a6b9-48ad-8ae7-cebb995e13c2", "name": "network-vif-plugged", "status": "completed", "tag": "a7faa08b-872e-4394-814a-c7ee682c1e20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:57.119228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-18b05c3a-6936-4a31-885c-f086dfcb847c req-4a6d1af4-38fb-4c54-856f-2b8ad29302ad service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.119693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-18b05c3a-6936-4a31-885c-f086dfcb847c req-4a6d1af4-38fb-4c54-856f-2b8ad29302ad service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.141728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-18b05c3a-6936-4a31-885c-f086dfcb847c req-4a6d1af4-38fb-4c54-856f-2b8ad29302ad service nova] Creating event network-vif-plugged:a7faa08b-872e-4394-814a-c7ee682c1e20 for instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 on nch1-master-1 Mar 26 20:59:57.152158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-18b05c3a-6936-4a31-885c-f086dfcb847c req-4a6d1af4-38fb-4c54-856f-2b8ad29302ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058184 Mar 26 20:59:57.153843 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1678/3133] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 20:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 20:59:57.172657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.175846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:57.199296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.200140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.202510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.204233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.337967 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47df62e4-6eac-4560-822c-4b802f1d334b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d" status: 202 len: 0 microversion: 2.1 time: 0.417277 Mar 26 20:59:57.339328 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1456/3134] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:56 2022] DELETE /compute/v2.1/os-security-groups/2714f440-b833-4684-82ef-590a6db7d06d => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 20:59:57.349499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.350201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:57.361769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.362656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.363743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.364373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.402926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. Mar 26 20:59:57.405936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:57.407806 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59441b8a-5c89-4ebb-9470-807c200dae6c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 404 len: 111 microversion: 2.1 time: 0.064301 Mar 26 20:59:57.408672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1457/3135] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:59:57 2022] DELETE /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:57.434481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.435179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6fea3714-7920-4e94-bf4c-ac35625e7bd0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:57.456521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.463435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.466984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.468482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.503746 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. Mar 26 20:59:57.505215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Instance 6fea3714-7920-4e94-bf4c-ac35625e7bd0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:57.506289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4224f17-d1db-486e-8225-3f14f3dd5b43 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0" status: 404 len: 111 microversion: 2.1 time: 0.091484 Mar 26 20:59:57.507473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1458/3136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:57 2022] GET /compute/v2.1/servers/6fea3714-7920-4e94-bf4c-ac35625e7bd0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:57.525125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e588cbee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.556922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34db9745-5cca-4366-a65c-30c2c58454dc does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:57.557663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 34db9745-5cca-4366-a65c-30c2c58454dc not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:57.558299 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 34db9745-5cca-4366-a65c-30c2c58454dc does not exist Mar 26 20:59:57.558299 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-693fc613-4000-4342-8cd3-e562ede0d510'] Mar 26 20:59:57.559076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 34db9745-5cca-4366-a65c-30c2c58454dc does not exist Mar 26 20:59:57.559076 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-693fc613-4000-4342-8cd3-e562ede0d510'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:57.560379 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4d334eb-0c01-4ba2-ae25-c4b7b40ff0f7 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc" status: 404 len: 194 microversion: 2.1 time: 0.039292 Mar 26 20:59:57.564498 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1459/3137] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:57 2022] DELETE /compute/v2.1/os-security-groups/34db9745-5cca-4366-a65c-30c2c58454dc => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:57.574043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e593a1dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.607280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:57.607898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:57.608447 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 does not exist Mar 26 20:59:57.608447 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-6d6f018f-3392-48f0-a43d-b6f91f4464bc'] Mar 26 20:59:57.609385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 04a2dfb4-e403-45b1-8f7f-e705e0f00e37 does not exist Mar 26 20:59:57.609385 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-6d6f018f-3392-48f0-a43d-b6f91f4464bc'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:57.620347 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59736494-b240-4bb3-a52a-7bab8c94504b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37" status: 404 len: 194 microversion: 2.1 time: 0.053986 Mar 26 20:59:57.621692 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1460/3138] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:57 2022] DELETE /compute/v2.1/os-security-groups/04a2dfb4-e403-45b1-8f7f-e705e0f00e37 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:57.628418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:57.630290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:57.636796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.637732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:57.638492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:57.638854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:58.007203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:58.028333 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-243f1b00-37d7-4c42-9bf0-05d167d011d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.867637 Mar 26 20:59:58.029115 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1679/3139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:57 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:58.056299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e582abb80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:58.141142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:58.141857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 8a462155-de76-4534-93ae-1c57a3a4abc7 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:58.142623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist Mar 26 20:59:58.142623 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-f658d189-e809-4e3b-a0d3-483d4c5a5010'] Mar 26 20:59:58.143415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 8a462155-de76-4534-93ae-1c57a3a4abc7 does not exist Mar 26 20:59:58.143415 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-f658d189-e809-4e3b-a0d3-483d4c5a5010'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:58.144582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58d21b55-6d60-4c8c-b14e-1dab5eab45d8 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7" status: 404 len: 194 microversion: 2.1 time: 0.105521 Mar 26 20:59:58.145923 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1680/3140] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:58 2022] DELETE /compute/v2.1/os-security-groups/8a462155-de76-4534-93ae-1c57a3a4abc7 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:58.152626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a934f72f-1144-476f-a698-b07078e58238 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5933aca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:58.165288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:58.211426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4cadd4fe-4a29-4cb4-85d3-fc68d919d98c tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1491 microversion: 2.1 time: 0.583522 Mar 26 20:59:58.229651 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1461/3141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:57 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1491 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:58.254944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:58.264650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:58.302321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:58.304971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:58.307101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:58.308803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:58.313236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a934f72f-1144-476f-a698-b07078e58238 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.166153 Mar 26 20:59:58.314275 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1681/3142] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:58 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:58.324566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e595294c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:58.738079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:58.754830 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-711b1d58-be23-411d-bd3f-ad13143aabd5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.522679 Mar 26 20:59:58.755592 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1462/3143] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:58 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:58.766479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:58.767164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 35516eea-ddb3-4689-b729-dce17be9a1bf not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:58.767707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist Mar 26 20:59:58.767707 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-0d2402de-49d4-41c4-af74-d6aecbb20db3'] Mar 26 20:59:58.768348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 35516eea-ddb3-4689-b729-dce17be9a1bf does not exist Mar 26 20:59:58.768348 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-0d2402de-49d4-41c4-af74-d6aecbb20db3'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:58.768733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: .version_select at 0x7f6e5890d430>, body: {"keypair": {"name": "tempest-keypair-70019513"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 20:59:58.769205 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a02eca7-06bc-44dd-8638-c94312705d4c tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf" status: 404 len: 194 microversion: 2.1 time: 0.453870 Mar 26 20:59:58.770081 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1682/3144] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:58 2022] DELETE /compute/v2.1/os-security-groups/35516eea-ddb3-4689-b729-dce17be9a1bf => generated 194 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:58.776503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:58.780709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:58.796614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:58.797378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:58.798969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:58.799610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:58.829834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:58.850049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for user 3cb495ec547743d38a7502110a166b1a and project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:59.197810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 20:59:59.206010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for user 3cb495ec547743d38a7502110a166b1a and project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 20:59:59.229067 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df63772c-b924-42ef-a0ce-9a6318529732 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.470416 Mar 26 20:59:59.235977 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1463/3145] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 20:59:58 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:59.242423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e5890dc10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.354726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG neutronclient.v2_0.client [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist", "detail": ""}} {{(pid=141580) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:59.355608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 376307f1-3d1f-4313-9816-f91d820ae448 not found {{(pid=141580) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:59.356349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist Mar 26 20:59:59.356349 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-88dfceff-ed16-4554-8ce5-07f15c5fcf72'] Mar 26 20:59:59.357156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 376307f1-3d1f-4313-9816-f91d820ae448 does not exist Mar 26 20:59:59.357156 ncdv-master-1 devstack@n-api.service[141580]: Neutron server returns request_ids: ['req-88dfceff-ed16-4554-8ce5-07f15c5fcf72'] {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:59.358106 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3669959-4259-453f-969e-e701abb8ad1d tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448" status: 404 len: 194 microversion: 2.1 time: 0.120733 Mar 26 20:59:59.361177 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1464/3146] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:59 2022] DELETE /compute/v2.1/os-security-groups/376307f1-3d1f-4313-9816-f91d820ae448 => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:59.373169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.373766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:59.373913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:59.385504 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1f61ae12-5b9d-44d1-8455-44650f543426 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.612127 Mar 26 20:59:59.386114 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1683/3147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:58 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:59.392659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.393108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.394047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.394453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.396438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78420390-031b-4670-a047-2ebb1be5f716 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e59529940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.482416 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78420390-031b-4670-a047-2ebb1be5f716 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.095210 Mar 26 20:59:59.488433 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1684/3148] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:59 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:59.496365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e582c9280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.615174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG neutronclient.v2_0.client [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist", "detail": ""}} {{(pid=141581) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 26 20:59:59.615720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.security_group_api [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Neutron security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 not found {{(pid=141581) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 26 20:59:59.616278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist Mar 26 20:59:59.616278 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-856ff773-0255-49e1-a7d6-8b6d913c7e2f'] Mar 26 20:59:59.616867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Security group 8f48f5df-32ea-4cc7-9f35-35705cf89c53 does not exist Mar 26 20:59:59.616867 ncdv-master-1 devstack@n-api.service[141581]: Neutron server returns request_ids: ['req-856ff773-0255-49e1-a7d6-8b6d913c7e2f'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 20:59:59.618555 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fa1b18f-adc6-42a6-a8d5-4b32ee107997 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53" status: 404 len: 194 microversion: 2.1 time: 0.133384 Mar 26 20:59:59.619827 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1685/3149] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 20:59:59 2022] DELETE /compute/v2.1/os-security-groups/8f48f5df-32ea-4cc7-9f35-35705cf89c53 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 20:59:59.626515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.633318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:59.645682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.646137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.646923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.647421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.813013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 20:59:59.837034 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-380d2f50-3aa5-4a4c-bcfc-3447e9c7a836 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1491 microversion: 2.1 time: 0.473653 Mar 26 20:59:59.851240 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1465/3150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:59 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1491 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 20:59:59.858926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 20:59:59.859794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 20:59:59.883675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.889998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.891715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 20:59:59.892771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 20:59:59.973556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:00:00.162468 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58f96455-8128-43ef-8f57-69d1a0d05730 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 204 len: 0 microversion: 2.1 time: 0.309213 Mar 26 21:00:00.163802 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1466/3151] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 20:59:59 2022] DELETE /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:00:00.178309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:00.179755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:00.190241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.195655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.198817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.199787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.545899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:00.562855 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ece8cb53-dada-4413-8a32-50dae07602ac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.937304 Mar 26 21:00:00.565882 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1686/3152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:59:59 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:00.590327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-255851a6-a3e4-4b00-8ca5-92eb5ba0b3e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e582c7ca0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:00.652724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:00.679666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6991e72b-476e-4707-9fc3-17472c5b4655 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1647 microversion: 2.1 time: 0.509285 Mar 26 21:00:00.691742 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1467/3153] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:00 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1647 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:00.697891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-255851a6-a3e4-4b00-8ca5-92eb5ba0b3e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.129441 Mar 26 21:00:00.707045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1687/3154] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:00 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:00.707429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:00.708123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:00.719464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.719961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.720842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.721299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.831192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Locking {{(pid=141580) lock /opt/stack/nova/nova/compute/api.py:4698}} Mar 26 21:00:00.864706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:00.868044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:00.910774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.912716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.913601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.914130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.938896 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b342b57d-5f69-4fbc-8c67-e1572eb9f50b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.239638 Mar 26 21:00:00.947133 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1468/3155] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:00 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:00.960427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:00.962675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:00.989928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.990784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:00.993921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:00.994615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.124997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e2a79f7ce548d5b39cd657ac6d578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e64b94cc37456185389445ddc56877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:01.147096 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6adbbcdc-7b60-48a4-884f-5807a97db936 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 200 len: 1449 microversion: 2.1 time: 0.292117 Mar 26 21:00:01.159123 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1688/3156] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:00 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 1449 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:01.176991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ac5b7521-6892-48ff-b916-919606338dfe req-67125058-5ecb-44fd-94b9-e2a16271549d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b3ccf8-2570-48db-aa78-3a673c02d3da", "name": "network-vif-deleted", "tag": "41328fe6-d504-4051-8089-d948e97d3fa2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:01.200043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ac5b7521-6892-48ff-b916-919606338dfe req-67125058-5ecb-44fd-94b9-e2a16271549d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.201215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ac5b7521-6892-48ff-b916-919606338dfe req-67125058-5ecb-44fd-94b9-e2a16271549d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.214561 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ac5b7521-6892-48ff-b916-919606338dfe req-67125058-5ecb-44fd-94b9-e2a16271549d service nova] Creating event network-vif-deleted:41328fe6-d504-4051-8089-d948e97d3fa2 for instance 62b3ccf8-2570-48db-aa78-3a673c02d3da on nch1-master-1 Mar 26 21:00:01.220735 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ac5b7521-6892-48ff-b916-919606338dfe req-67125058-5ecb-44fd-94b9-e2a16271549d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059978 Mar 26 21:00:01.226680 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1689/3157] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:01.457178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:01.474820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ebb78f1-9b75-499a-a7c3-6af6bd7fa9c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.525401 Mar 26 21:00:01.493247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:01.496375 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1469/3158] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:00 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:01.507510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.508327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.567642 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance 70f4d369-22fa-469b-b4f9-dca38fa6eede is locked Mar 26 21:00:01.568373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 409 to user: Instance 70f4d369-22fa-469b-b4f9-dca38fa6eede is locked {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:00:01.569193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62848d8d-4b2b-45fb-b8e8-e556d4afd199 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 409 len: 107 microversion: 2.1 time: 0.081707 Mar 26 21:00:01.575961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1690/3159] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:01 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 107 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:00:01.581470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:01.582801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:01.603546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.604898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.605409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.605877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.671226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Unlocking {{(pid=141580) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 26 21:00:01.717425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d11b6123-282f-4c1c-88d6-b11b5dee9f33 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5933a8b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:01.749549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a71a3893-6b3b-431d-89ff-df3ec91b6fac tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.171987 Mar 26 21:00:01.755606 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1470/3160] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:01 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:01.762052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:01.762347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:01.770832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.771306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.772957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.773435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.802706 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d11b6123-282f-4c1c-88d6-b11b5dee9f33 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.092948 Mar 26 21:00:01.803675 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1691/3161] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:01 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:01.815816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b6beb59b-f6a3-4e13-89c9-73c55ec651ec tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:01.834708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6beb59b-f6a3-4e13-89c9-73c55ec651ec tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.835730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b6beb59b-f6a3-4e13-89c9-73c55ec651ec tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.869881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b6beb59b-f6a3-4e13-89c9-73c55ec651ec tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:00:01.931627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b6beb59b-f6a3-4e13-89c9-73c55ec651ec tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.126322 Mar 26 21:00:01.933093 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1692/3162] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:01 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:01.948625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:01.951726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:01.969632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.970408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:01.974008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:01.974794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:02.451485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:02.461597 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40de0db9-423b-4477-a205-c312df3f0188 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.523618 Mar 26 21:00:02.472622 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1693/3163] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:01 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:02.478622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:02.479604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] [instance: 62b3ccf8-2570-48db-aa78-3a673c02d3da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:02.486185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:02.486995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:02.488148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:02.489231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:02.507583 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] HTTP exception thrown: Instance 62b3ccf8-2570-48db-aa78-3a673c02d3da could not be found. Mar 26 21:00:02.508576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] Returning 404 to user: Instance 62b3ccf8-2570-48db-aa78-3a673c02d3da could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:00:02.509716 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e724e23c-6714-4834-ab27-541d4a961659 tempest-ServerRescueTestJSON-900015085 tempest-ServerRescueTestJSON-900015085-project] 10.222.0.16 "GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da" status: 404 len: 111 microversion: 2.1 time: 0.035193 Mar 26 21:00:02.514161 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1694/3164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:02 2022] GET /compute/v2.1/servers/62b3ccf8-2570-48db-aa78-3a673c02d3da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:00:02.777669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:02.784596 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d069bc9-8fe9-454b-9101-0b47a9d3b843 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1647 microversion: 2.1 time: 1.027645 Mar 26 21:00:02.804419 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1471/3165] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:01 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1647 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:02.819239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1378574a-1541-4746-9892-e3d6440a2e2c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58265310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:02.976935 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1378574a-1541-4746-9892-e3d6440a2e2c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.164673 Mar 26 21:00:02.977926 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1695/3166] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:02 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:03.278855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-811f16df-eed9-4081-b4c8-9cc68d4ca761 req-6f0c2ae4-15a3-4a54-9bf9-918ecab530b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1cff63-8d2d-4534-b4f6-d4c0493e58c0", "name": "network-vif-deleted", "tag": "191321a7-1166-4f60-ae78-2ca65861dc95"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:03.321506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-811f16df-eed9-4081-b4c8-9cc68d4ca761 req-6f0c2ae4-15a3-4a54-9bf9-918ecab530b3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.322309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-811f16df-eed9-4081-b4c8-9cc68d4ca761 req-6f0c2ae4-15a3-4a54-9bf9-918ecab530b3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.356256 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-811f16df-eed9-4081-b4c8-9cc68d4ca761 req-6f0c2ae4-15a3-4a54-9bf9-918ecab530b3 service nova] Creating event network-vif-deleted:191321a7-1166-4f60-ae78-2ca65861dc95 for instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 on nch1-master-1 Mar 26 21:00:03.379592 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-811f16df-eed9-4081-b4c8-9cc68d4ca761 req-6f0c2ae4-15a3-4a54-9bf9-918ecab530b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105183 Mar 26 21:00:03.380491 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1472/3167] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:03.481439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:03.482304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:03.496416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.497732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.500623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.503304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.803660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:03.805131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:03.826942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.830032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.833673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.835374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.924841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:03.927746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:03.930204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lazy-loading 'fault' on Instance uuid 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:04.011209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:04.042057 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-175c5d12-cb2a-4fcd-828a-07964fb4185b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.563405 Mar 26 21:00:04.043544 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1696/3168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:03 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:04.072264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c2e407ef-3cbd-493c-86aa-eb44603d4dc1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e582c91f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:04.190812 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c2e407ef-3cbd-493c-86aa-eb44603d4dc1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.133116 Mar 26 21:00:04.191804 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1697/3169] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:04 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:04.199049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458cfbae7f945309c300d336b6dfd64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:04.210775 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96d5542a-7d2b-4cdc-b1f7-cd0e143a383a tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 200 len: 1306 microversion: 2.1 time: 0.409288 Mar 26 21:00:04.212935 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1473/3170] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:03 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:05.064225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:05.066455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:05.080900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:05.084534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:05.085453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:05.085909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:05.204638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f78d100b-0970-411a-84a8-6fe51f285bca tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5924b9d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:05.288224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f78d100b-0970-411a-84a8-6fe51f285bca tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.087513 Mar 26 21:00:05.290289 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1474/3171] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:05 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:05.303357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:05.311736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] [instance: 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:05.324832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:05.325297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:05.326107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:05.326560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:05.354873 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] HTTP exception thrown: Instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 could not be found. Mar 26 21:00:05.355900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Returning 404 to user: Instance 6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:00:05.357224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22ab7652-61c2-47b6-903d-d97bcfc9469b tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0" status: 404 len: 111 microversion: 2.1 time: 0.065791 Mar 26 21:00:05.357983 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1475/3172] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:05 2022] GET /compute/v2.1/servers/6d1cff63-8d2d-4534-b4f6-d4c0493e58c0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:00:05.366889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86f05e48-3baf-4fd5-8997-52966089ae4e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e589479d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:05.779080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:05.791189 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ece5f466-8aeb-4ba1-ab9a-9473e57edf05 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.731966 Mar 26 21:00:05.793716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1698/3173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:05 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:06.302607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4fa23250-68d4-4a64-83dd-deb1ac16399b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58265a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:06.339798 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86f05e48-3baf-4fd5-8997-52966089ae4e tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/82e03f28-d7fd-4ddc-908f-268e1e2a4ab5" status: 202 len: 0 microversion: 2.1 time: 0.977243 Mar 26 21:00:06.344063 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1476/3174] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 21:00:05 2022] DELETE /compute/v2.1/os-security-groups/82e03f28-d7fd-4ddc-908f-268e1e2a4ab5 => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:06.349957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-385ab685-6309-47d3-82e4-f5ab1a4322e5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] Calling method '.version_select at 0x7f6e588eedc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:06.387591 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4fa23250-68d4-4a64-83dd-deb1ac16399b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.088759 Mar 26 21:00:06.388277 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1699/3175] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:06 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:06.695765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1732814272", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "774ec06c-09d0-4daf-abd3-72e75f21ab7d"}], "security_groups": [{"name": "tempest-securitygroup--374845154"}], "key_name": "tempest-keypair-70019513", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:06.878606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] validate_networks() for [('774ec06c-09d0-4daf-abd3-72e75f21ab7d', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:00:07.607427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-385ab685-6309-47d3-82e4-f5ab1a4322e5 tempest-SecurityGroupsTestJSON-567837585 tempest-SecurityGroupsTestJSON-567837585-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/13df4862-a8b7-4bd9-9aa6-daedcf47e691" status: 202 len: 0 microversion: 2.1 time: 1.262065 Mar 26 21:00:07.614521 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1477/3176] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 21:00:06 2022] DELETE /compute/v2.1/os-security-groups/13df4862-a8b7-4bd9-9aa6-daedcf47e691 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:07.622253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:07.623168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:07.645765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:07.651163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:07.653617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:07.655860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:08.194745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:08.220886 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-efefe793-e8f9-41b1-9eb5-cd12445b89c1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.604774 Mar 26 21:00:08.232323 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1478/3177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:07 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:08.239270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e1985bf-3fed-4bf9-96e9-f9bcab459bb2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5888aaf0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:08.325022 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e1985bf-3fed-4bf9-96e9-f9bcab459bb2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.091175 Mar 26 21:00:08.327886 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1479/3178] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:08 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:08.578200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:08.578881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:08.579545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:08.580147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:08.580854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:08.597308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:08.598767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:08.599804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:08.600735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:08.632169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:08.644950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Getting quotas for user 3cb495ec547743d38a7502110a166b1a and project dff0b12b0e8843e99f5aac63876e13fb. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:08.671944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:08.674627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:08.738115 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5a6c4745-4e89-46c2-9406-ac90a9d12529 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.048019 Mar 26 21:00:08.750217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46e92dd3-467a-4bb7-af56-e6933dd405f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:08.752149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-46e92dd3-467a-4bb7-af56-e6933dd405f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:08.757121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1700/3179] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:00:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:00:08.913850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-46e92dd3-467a-4bb7-af56-e6933dd405f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:08.930396 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46e92dd3-467a-4bb7-af56-e6933dd405f0 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1244 microversion: 2.1 time: 0.183259 Mar 26 21:00:08.945625 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1480/3180] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:08 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1244 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:09.242705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:09.243580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:09.266134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:09.273507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:09.291154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:09.297468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:09.344988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2607bed-2cf6-4729-8b7b-c46c43c3a2f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e588e68b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:09.455854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2607bed-2cf6-4729-8b7b-c46c43c3a2f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.118344 Mar 26 21:00:09.468061 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1481/3181] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:09 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:09.883455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:09.893985 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4abb0e52-d9dc-43d1-9060-6de7cd9e47b8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.657193 Mar 26 21:00:09.900813 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1701/3182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:09 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:09.950849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:09.951551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:09.965995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:09.966731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:09.973368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:09.974048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:10.206494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:10.232930 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76895316-fd70-403c-a9d5-e30e42f528dd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1240 microversion: 2.1 time: 0.286825 Mar 26 21:00:10.236055 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1482/3183] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:09 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:10.476805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ba14e79-acd8-483a-8900-a9ee22145d0c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58271040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:10.552467 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ba14e79-acd8-483a-8900-a9ee22145d0c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.080018 Mar 26 21:00:10.553715 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1702/3184] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:10 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:10.920119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:10.920998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:10.933136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:10.938676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:10.939784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:10.940812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:11.252654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:11.254701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:11.272864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:11.276947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:11.277999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:11.278456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:11.432922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:11.453737 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-65ce4f2b-4e88-48a2-8d22-a8a7996010e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.539768 Mar 26 21:00:11.455250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1483/3185] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:10 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:11.522470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:11.538507 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc6ca8ad-1a26-4402-91de-275548708d55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1302 microversion: 2.1 time: 0.291098 Mar 26 21:00:11.540047 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1703/3186] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:11 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1302 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:11.568889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-245e38ee-494d-4880-b8d8-8e167f76ca89 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e593a1dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:11.629703 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-245e38ee-494d-4880-b8d8-8e167f76ca89 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.065999 Mar 26 21:00:11.639540 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1484/3187] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:11 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:12.478577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:12.480682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:12.501285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:12.502794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:12.503655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:12.506189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:12.558545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:12.559545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:12.574894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:12.576658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:12.580594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:12.583003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:12.989495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:12.998157 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8cbb07e5-d11a-47c4-ad20-2009bc916fb0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1657 microversion: 2.1 time: 0.525801 Mar 26 21:00:13.001370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1704/3188] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:12 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1657 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:13.016580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e6750ce-8064-4dca-8eb5-2b427131acdc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58288b80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:13.116060 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e6750ce-8064-4dca-8eb5-2b427131acdc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.110719 Mar 26 21:00:13.117372 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1705/3189] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:13 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:13.125448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69b43404-d4b0-4055-b7f2-6b3147c37423 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:13.139837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69b43404-d4b0-4055-b7f2-6b3147c37423 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:13.140639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69b43404-d4b0-4055-b7f2-6b3147c37423 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:13.168099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69b43404-d4b0-4055-b7f2-6b3147c37423 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:00:13.232804 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69b43404-d4b0-4055-b7f2-6b3147c37423 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.112838 Mar 26 21:00:13.235076 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1706/3190] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:13 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:13.254311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:13.255423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:13.281831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:13.282308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:13.283131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:13.283582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:13.548179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:13.583825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3abe9bdd-f89c-4570-b3f2-93d276061257 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 1.030525 Mar 26 21:00:13.584548 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1485/3191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:12 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:14.147300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db60a08c-99ad-49e2-86c2-4cd9a1379732 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58945820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:14.225680 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db60a08c-99ad-49e2-86c2-4cd9a1379732 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.099032 Mar 26 21:00:14.226315 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1486/3192] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:14 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:14.428612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:14.439420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4542edd8-af00-4dd3-8a25-d475455e1d6c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1666 microversion: 2.1 time: 1.200521 Mar 26 21:00:14.444914 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1707/3193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:13 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1666 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:14.600767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:14.601411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:14.614920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:14.616420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:14.618235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:14.620163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:15.239654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac2a291a-648f-4ddf-a45f-a30a4e7e8161 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5820baf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:15.335320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac2a291a-648f-4ddf-a45f-a30a4e7e8161 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1411 microversion: 2.1 time: 0.100287 Mar 26 21:00:15.336722 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1708/3194] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:15 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:15.367025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:15.389696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f6a4d07-662f-479d-b49e-9903b48b4986 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 0.793232 Mar 26 21:00:15.401958 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1487/3195] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:14 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:15.462621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:15.463246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:15.479683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:15.481870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:15.485906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:15.486842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:16.053621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7e2a11e4-cf02-47ee-b855-cb80b99c43dc req-38ab8edf-7fd7-4bbe-b091-fe3faad9fbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:16.082140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e2a11e4-cf02-47ee-b855-cb80b99c43dc req-38ab8edf-7fd7-4bbe-b091-fe3faad9fbe0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:16.082942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e2a11e4-cf02-47ee-b855-cb80b99c43dc req-38ab8edf-7fd7-4bbe-b091-fe3faad9fbe0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:16.120433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7e2a11e4-cf02-47ee-b855-cb80b99c43dc req-38ab8edf-7fd7-4bbe-b091-fe3faad9fbe0 service nova] Creating event network-changed:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:00:16.133261 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7e2a11e4-cf02-47ee-b855-cb80b99c43dc req-38ab8edf-7fd7-4bbe-b091-fe3faad9fbe0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085707 Mar 26 21:00:16.142665 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1488/3196] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:16.311646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:16.335528 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93d67df8-2402-47a6-bf07-545a7222b43f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1666 microversion: 2.1 time: 0.875831 Mar 26 21:00:16.342471 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1709/3197] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:15 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1666 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:16.352218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59db9248-ae52-4254-96ff-5d11e5cb19ad tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58945820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:16.424445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59db9248-ae52-4254-96ff-5d11e5cb19ad tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1420 microversion: 2.1 time: 0.078227 Mar 26 21:00:16.424596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:16.426386 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1489/3198] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:16 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:16.434076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:16.442765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:16.443761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:16.444910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:16.445578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:16.446560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b416ff7f-dfc7-4d7e-888a-6c600a88827b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e589455e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:16.540995 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b416ff7f-dfc7-4d7e-888a-6c600a88827b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 200 len: 1420 microversion: 2.1 time: 0.100659 Mar 26 21:00:16.542457 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1490/3199] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:16 2022] GET /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:16.571942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b538a863-f7f9-4f02-aa49-d315e7ec7aef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5889cb80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:17.465315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:17.480984 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e1864ea-bf67-4f64-9358-d0dd41346ebd tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 1.062239 Mar 26 21:00:17.510155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1710/3200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:16 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:17.524156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:17.531227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:17.546002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:17.548324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:17.549295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:17.551944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:17.750480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b538a863-f7f9-4f02-aa49-d315e7ec7aef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 204 len: 0 microversion: 2.1 time: 1.187694 Mar 26 21:00:17.751250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1491/3201] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:16 2022] DELETE /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 0 bytes in 1191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:00:17.760374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:17.761063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:17.780498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:17.781444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:17.783781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:17.786183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:17.864473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:00:18.087911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ebf92df8-1115-42f5-8a9b-57601afc2533 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 204 len: 0 microversion: 2.1 time: 0.331198 Mar 26 21:00:18.093070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1492/3202] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:00:17 2022] DELETE /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:00:18.340518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-908378056", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "bed7c102-81ae-4d0f-9222-79cbabeb217f"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:18.455248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] validate_networks() for [('bed7c102-81ae-4d0f-9222-79cbabeb217f', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:00:18.640313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:18.649041 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a7d9f1b-3354-4646-a1d1-d74f81555534 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1666 microversion: 2.1 time: 1.136675 Mar 26 21:00:18.661020 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1711/3203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:17 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1666 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:18.666298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:18.667096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:18.689913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:18.690410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:18.692589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:18.693054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:19.751267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:19.788487 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ef59ef3-7d54-488f-9a0c-f81eca18fce8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 1.122578 Mar 26 21:00:19.802356 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1712/3204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:18 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:19.824340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:19.827304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:19.845290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:19.848484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:19.852257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:19.853027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:20.036218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:20.037337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:20.038020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:20.038595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:20.039084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:20.055061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:20.058151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:20.059263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:20.061228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:20.113901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:20.125048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for user fdd16c1bdb3d416d8421202397566d1c and project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:20.170013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:20.179320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:20.331232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-322762c1-bb3f-43c3-b82a-fae3dd64a814 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996001 Mar 26 21:00:20.341108 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1493/3205] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:00:20.351868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc3d7b5e-1e07-4762-9901-5b3713d5ee35 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:20.354375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc3d7b5e-1e07-4762-9901-5b3713d5ee35 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:20.534454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc3d7b5e-1e07-4762-9901-5b3713d5ee35 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:20.544450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc3d7b5e-1e07-4762-9901-5b3713d5ee35 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1207 microversion: 2.1 time: 0.197443 Mar 26 21:00:20.545151 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1494/3206] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:20 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1207 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:20.553890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4ee6bb6b-c810-4f82-8fe5-5e3ef983149f req-cb348c31-e6e1-4742-8eb4-53f90c6f7164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724266e8-a6b9-48ad-8ae7-cebb995e13c2", "name": "network-vif-unplugged", "status": "completed", "tag": "a7faa08b-872e-4394-814a-c7ee682c1e20"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:20.584017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4ee6bb6b-c810-4f82-8fe5-5e3ef983149f req-cb348c31-e6e1-4742-8eb4-53f90c6f7164 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:20.585189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4ee6bb6b-c810-4f82-8fe5-5e3ef983149f req-cb348c31-e6e1-4742-8eb4-53f90c6f7164 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:20.609668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4ee6bb6b-c810-4f82-8fe5-5e3ef983149f req-cb348c31-e6e1-4742-8eb4-53f90c6f7164 service nova] Creating event network-vif-unplugged:a7faa08b-872e-4394-814a-c7ee682c1e20 for instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 on nch1-master-1 Mar 26 21:00:20.633240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4ee6bb6b-c810-4f82-8fe5-5e3ef983149f req-cb348c31-e6e1-4742-8eb4-53f90c6f7164 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086486 Mar 26 21:00:20.634696 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1495/3207] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:20.819047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:20.820415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:20.842692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:20.845800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:20.851004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:20.853313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:21.066962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:21.080964 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-12834a6b-52e2-4f36-9472-9447d8ae325d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.275203 Mar 26 21:00:21.097230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1713/3208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:19 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:21.111387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:21.113618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:21.132374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:21.133251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:21.135175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:21.138553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:21.689463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:21.702524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69535f13-095d-4aef-bec6-06e2d382f07b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 0.892940 Mar 26 21:00:21.705894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1496/3209] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:20 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:21.720031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:21.730309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:21.735442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:21.744664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-189e3c5f-f256-419c-a86c-7e450bfca72f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.643770 Mar 26 21:00:21.757442 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1714/3210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:21 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:21.775050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:21.775791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:21.778263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:21.779805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:22.049034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:22.059939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1949491324", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3d0ca72a-ff8d-4f72-8621-13d680eaf95f"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:22.075585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-20484496-8946-4fe5-96bb-da32c80610e9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1259 microversion: 2.1 time: 0.367743 Mar 26 21:00:22.076220 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1497/3211] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:21 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1259 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:22.088254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:22.088806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:22.118164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:22.118629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:22.124073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:22.126816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:22.185275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] validate_networks() for [('3d0ca72a-ff8d-4f72-8621-13d680eaf95f', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:00:22.240622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Unlocking {{(pid=141580) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 26 21:00:22.339289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f5457c5-c6e2-4629-bebf-be67e67c8f38 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.254835 Mar 26 21:00:22.346017 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1498/3212] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:22 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:22.354406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:22.356785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:22.373870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:22.374452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:22.375254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:22.378300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.331121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:23.333451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:23.334221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:23.335536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:23.336458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:23.360331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.361712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.362897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.372727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.417479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Getting quotas for project 95b182d640d24ff9ab5c8da47efdc110. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:23.417718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:23.431646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Getting quotas for user 95881858fbbb418aac62a64f4d0754d7 and project 95b182d640d24ff9ab5c8da47efdc110. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:23.432794 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-956a8de6-0637-4c6e-b823-d6cdb82bef56 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.085248 Mar 26 21:00:23.436127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1499/3213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:22 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:23.449221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:23.450461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:23.473859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.474822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.477462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.477946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.483598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:23.486890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:23.601231 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a268fbc-63c7-4a28-bb39-307ffa2584a4 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.839937 Mar 26 21:00:23.604806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1715/3214] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:00:23.616498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d111c6a5-d2d7-418e-b7a3-bb9c737d4a7a req-76dc7620-7210-4ac7-b6c7-d7b6a6bbef12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724266e8-a6b9-48ad-8ae7-cebb995e13c2", "name": "network-vif-deleted", "tag": "a7faa08b-872e-4394-814a-c7ee682c1e20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:23.654382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d111c6a5-d2d7-418e-b7a3-bb9c737d4a7a req-76dc7620-7210-4ac7-b6c7-d7b6a6bbef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.656577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d111c6a5-d2d7-418e-b7a3-bb9c737d4a7a req-76dc7620-7210-4ac7-b6c7-d7b6a6bbef12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.676165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d111c6a5-d2d7-418e-b7a3-bb9c737d4a7a req-76dc7620-7210-4ac7-b6c7-d7b6a6bbef12 service nova] Creating event network-vif-deleted:a7faa08b-872e-4394-814a-c7ee682c1e20 for instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 on nch1-master-1 Mar 26 21:00:23.684474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d111c6a5-d2d7-418e-b7a3-bb9c737d4a7a req-76dc7620-7210-4ac7-b6c7-d7b6a6bbef12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076368 Mar 26 21:00:23.685729 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1716/3215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:23.696627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:23.698274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:23.710367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.711637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.712809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.715173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:23.884153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:23.904427 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3adcc2a5-da5e-49a2-a63f-7c3fc22e21d0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1265 microversion: 2.1 time: 0.214310 Mar 26 21:00:23.909771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1717/3216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:23 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:23.936596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-74a9d904-8964-4302-92ae-df919ccf346e req-30619c6c-80a5-4dcc-86f9-5d118d3f92a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "name": "network-vif-plugged", "status": "completed", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:23.970370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-74a9d904-8964-4302-92ae-df919ccf346e req-30619c6c-80a5-4dcc-86f9-5d118d3f92a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:23.970841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-74a9d904-8964-4302-92ae-df919ccf346e req-30619c6c-80a5-4dcc-86f9-5d118d3f92a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:24.014389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-74a9d904-8964-4302-92ae-df919ccf346e req-30619c6c-80a5-4dcc-86f9-5d118d3f92a6 service nova] Creating event network-vif-plugged:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:00:24.028638 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-74a9d904-8964-4302-92ae-df919ccf346e req-30619c6c-80a5-4dcc-86f9-5d118d3f92a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115028 Mar 26 21:00:24.030333 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1718/3217] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:24.096669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:24.104502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:24.150396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:24.152200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:24.155131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:24.156296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:24.513546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:24.526174 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-62be09b8-cdba-4eb6-a8bb-dd4212917f74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 1.088309 Mar 26 21:00:24.528863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1500/3218] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:23 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:24.544097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:24.547850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:24.934151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:24.963610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:24.965637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:24.970881 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a90cff1-4e15-4a7d-98a7-ad59ec20fb92 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1262 microversion: 2.26 time: 0.439461 Mar 26 21:00:24.977313 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1501/3219] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:24 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1262 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:24.983347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:24.987505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:25.003207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:25.006447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:25.007539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:25.008565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:25.610967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:25.622875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4bff44e3-c925-4499-9928-e3464162cb1e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.590285 Mar 26 21:00:25.629419 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1719/3220] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:24 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:25.648166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:25.649032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:25.661935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:25.662402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:25.663209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:25.663695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:26.355170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:26.365562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d015e037-df7a-4c03-976e-3a772e30ce5d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1369 microversion: 2.1 time: 0.734943 Mar 26 21:00:26.366737 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1720/3221] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:25 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1369 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:26.371637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:26.372489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:26.386785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:26.387471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:26.388567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:26.389170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:26.656301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:26.671328 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-367bac3d-07a8-40eb-bde5-42f27f7e53ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 1.691237 Mar 26 21:00:26.675022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1502/3222] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:24 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:26.689336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:26.694954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:26.716548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:26.717091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:26.717901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:26.718360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:26.846569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:26.865038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:26.866826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:26.868129 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85a0c58a-f2c1-4d73-9a75-06eb9445ac2f tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1320 microversion: 2.26 time: 0.191055 Mar 26 21:00:26.880774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1503/3223] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:26 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:27.384660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:27.385536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:27.411352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.411857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.412704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.413144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.413257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:27.442411 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-688d40dd-31cb-44f3-92d9-3f5dae530a23 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.068929 Mar 26 21:00:27.443465 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1721/3224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:26 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:27.468762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:27.469297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:27.485759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.486431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.488468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.491238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.679722 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8101dfb5-f32a-47cc-9595-6bbb0cbc6266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.218494 Mar 26 21:00:27.690653 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1722/3225] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:27 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:27.739822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b0706bfc-6748-4ed9-8fdd-1d2e326ab9aa req-b5083746-f165-440b-b132-7f8e327f6377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384155c0-abdb-4448-ab0e-797be0db4df6", "tag": "607e9bc9-d63e-4f18-b20e-8c045ee4124b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:27.768546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b0706bfc-6748-4ed9-8fdd-1d2e326ab9aa req-b5083746-f165-440b-b132-7f8e327f6377 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.769774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b0706bfc-6748-4ed9-8fdd-1d2e326ab9aa req-b5083746-f165-440b-b132-7f8e327f6377 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.798599 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b0706bfc-6748-4ed9-8fdd-1d2e326ab9aa req-b5083746-f165-440b-b132-7f8e327f6377 service nova] Creating event network-changed:607e9bc9-d63e-4f18-b20e-8c045ee4124b for instance 384155c0-abdb-4448-ab0e-797be0db4df6 on nch1-master-1 Mar 26 21:00:27.811170 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b0706bfc-6748-4ed9-8fdd-1d2e326ab9aa req-b5083746-f165-440b-b132-7f8e327f6377 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112472 Mar 26 21:00:27.813070 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1723/3226] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:27.828908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:27.830804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:27.850409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.851174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:27.852521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:27.859221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.100257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.128811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7dcb68ca-0c8a-4271-9193-2f65cd19e01c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1564 microversion: 2.1 time: 0.748039 Mar 26 21:00:28.129805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1504/3227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:27 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1564 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:28.140796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:28.141893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:28.150409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.151462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.152787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.154207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.407199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.414729 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f448592e-ce01-4abf-b640-1f75ef2c09a9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.600153 Mar 26 21:00:28.416007 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1724/3228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:27 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:28.429922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:28.430784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:28.438077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.438502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.439303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.439761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.843691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.861630 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bf88cc1d-c5b2-4bc2-ac12-73353518103a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1655 microversion: 2.1 time: 0.728070 Mar 26 21:00:28.863383 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1505/3229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:28 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1655 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:28.926499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.949633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.956210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:28.958395 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88dad0a4-ef81-4534-937e-4922274eaf64 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 0.532461 Mar 26 21:00:28.960991 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1725/3230] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:28 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:28.971856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:28.973418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:28.994518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.995315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:28.997196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:28.997816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.015830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Action: 'create', calling method: .version_select at 0x7f6e588ee160>, body: {"keypair": {"name": "tempest-keypair-696706182"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:29.041961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:29.047893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for user 6f4376fd9ace4887af0b56483b90a23d and project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:29.324362 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd463195-3f31-4c73-b2e4-552bea777db8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.360102 Mar 26 21:00:29.325297 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1726/3231] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:00:28 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:29.337808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:29.339365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:29.353791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.354734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.355802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.357294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.391386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:29.399271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for user 6f4376fd9ace4887af0b56483b90a23d and project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:29.445151 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9132f5b0-bf7d-4740-8fd1-db87e019e307 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.573604 Mar 26 21:00:29.446226 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1506/3232] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:00:28 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:29.451773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:29.452719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:29.477932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.478670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.479652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.480363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.482756 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4c01cb7-372a-4993-a9f9-0a371ccffc3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.155470 Mar 26 21:00:29.487419 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1727/3233] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:29 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:00:29.498389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:29.499528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:29.509485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.510262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:29.511831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:29.512667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:30.167802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:30.178018 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-490b72e8-7529-45b6-94e1-84d83d66cf72 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.730593 Mar 26 21:00:30.184203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1507/3234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:29 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:30.193741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:30.201137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:30.220506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:30.221332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:30.222311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:30.222899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:31.125522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:31.136793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03c72980-88ae-4165-9d8c-a8d708eb6dc2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1662 microversion: 2.1 time: 1.643698 Mar 26 21:00:31.143861 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1728/3235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:29 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1662 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:31.167007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:31.185280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:31.191971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:31.195523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63198141-775f-4691-8489-f44494f63122 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 1.009918 Mar 26 21:00:31.199998 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1508/3236] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:30 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:31.212747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:31.214898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:31.240672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:31.242121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:31.243272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:31.244015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.140227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:32.148702 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-75613490-6d1e-40e1-9213-7adae1929eae tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.950501 Mar 26 21:00:32.158913 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1729/3237] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:31 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:32.163824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:32.165097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:32.173906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.174511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.175306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.175753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.216922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:32.217836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:32.226231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.229729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.230742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.232665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.565175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:32.575260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ddbb2d9-fd5f-44d6-bb07-4b96798ebe3e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.419378 Mar 26 21:00:32.576440 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1509/3238] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:32 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:32.596310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-79d4a5ad-f035-43ec-adf6-c0c019c2fc28 req-48224147-022f-454e-a826-ebd90e270c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ae58a2-4795-46d7-859a-f92d5b6fd418", "tag": "0686aad7-4468-4e9e-b65b-e1160202b5b5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:32.606610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-79d4a5ad-f035-43ec-adf6-c0c019c2fc28 req-48224147-022f-454e-a826-ebd90e270c21 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.620774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-79d4a5ad-f035-43ec-adf6-c0c019c2fc28 req-48224147-022f-454e-a826-ebd90e270c21 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.641636 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-79d4a5ad-f035-43ec-adf6-c0c019c2fc28 req-48224147-022f-454e-a826-ebd90e270c21 service nova] Creating event network-changed:0686aad7-4468-4e9e-b65b-e1160202b5b5 for instance c4ae58a2-4795-46d7-859a-f92d5b6fd418 on nch2-master-1 Mar 26 21:00:32.653987 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-79d4a5ad-f035-43ec-adf6-c0c019c2fc28 req-48224147-022f-454e-a826-ebd90e270c21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062148 Mar 26 21:00:32.656069 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1510/3239] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:32.667226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:32.672041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:32.708374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.708838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:32.709683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:32.712504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:33.421240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:33.430237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:33.434777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:33.435652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:33.439080 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-be8eeb74-60be-4cce-97cc-867fc3fb6ce2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.780301 Mar 26 21:00:33.442807 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1511/3240] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:32 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:33.444744 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da2a7f41-e265-4b69-b2da-a26add58c451 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 1.231089 Mar 26 21:00:33.446275 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1730/3241] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:32 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:00:33.454760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:33.455838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:33.462701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:33.463512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:33.472457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:33.473005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:33.474111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:33.474688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:33.484714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:33.485264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:33.486130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:33.486805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:34.268647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:34.280677 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4fd02d1e-002d-473a-8ac0-f2e7cee70bc5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.822651 Mar 26 21:00:34.285125 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1731/3242] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:33 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:34.299083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:34.301696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:34.320228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:34.320698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:34.321561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:34.322438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:34.423124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:34.436859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9fca26ec-01f5-4c49-a75b-01d79d36840f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.988281 Mar 26 21:00:34.438659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1512/3243] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:33 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:34.466625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:34.468753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:34.495007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:34.496164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:34.504734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:34.506934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:34.940392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:34.957094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7fcfc8aa-dcd1-4b68-8602-25e0063c7cb8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.661307 Mar 26 21:00:34.957715 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1732/3244] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:34 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:34.980674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8f018c52-d30c-4082-9c89-307a91e310d9 req-35b8248f-6fe6-4b0e-81a9-04fd4a54f5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:35.004302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8f018c52-d30c-4082-9c89-307a91e310d9 req-35b8248f-6fe6-4b0e-81a9-04fd4a54f5cd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:35.005044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8f018c52-d30c-4082-9c89-307a91e310d9 req-35b8248f-6fe6-4b0e-81a9-04fd4a54f5cd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:35.031568 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8f018c52-d30c-4082-9c89-307a91e310d9 req-35b8248f-6fe6-4b0e-81a9-04fd4a54f5cd service nova] Creating event network-changed:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:00:35.037991 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8f018c52-d30c-4082-9c89-307a91e310d9 req-35b8248f-6fe6-4b0e-81a9-04fd4a54f5cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073985 Mar 26 21:00:35.046128 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1733/3245] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:35.051947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:35.052889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:35.061087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:35.061811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:35.062768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:35.063445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:35.432900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:35.457441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:35.461778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:35.479329 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c79944b4-ea1b-4bad-9fb5-3ca8b993b94a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 1.019568 Mar 26 21:00:35.482466 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1513/3246] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:34 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:35.501223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:35.506920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:35.541580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:35.542892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:35.544087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:35.544744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:35.787808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:35.799891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-835d00d4-9795-4868-aabe-7bbe3ec5e860 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.752315 Mar 26 21:00:35.809508 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1734/3247] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:35 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:35.832152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d07b83d2-7e40-44b8-8583-83257c1ad25d"}], "security_groups": [{"name": "tempest-securitygroup--1308411697"}], "key_name": "tempest-keypair-696706182", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:36.111647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] validate_networks() for [('d07b83d2-7e40-44b8-8583-83257c1ad25d', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:00:36.280867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:36.301207 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f697aff6-518e-4981-8a0e-f6bc08e7ba5e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.816263 Mar 26 21:00:36.301833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1514/3248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:35 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:36.307785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:36.314739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:36.330921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:36.332393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:36.339680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:36.339680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:36.913409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:36.931982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51e85f9c-74fc-4f3b-9876-be76a6f9562c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.619951 Mar 26 21:00:36.932704 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1515/3249] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:36 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:36.944259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:36.944259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:36.953223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:36.953920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:36.956953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:36.957585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:37.335509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:37.353399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:37.355484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:37.358013 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51b7e513-0173-4fae-a149-6e55a381ce88 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 0.424215 Mar 26 21:00:37.358637 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1516/3250] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:36 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:37.370042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8a1747e5-914c-4fc0-ad02-2bb03bf0a57d req-d68277fc-c350-40b3-9b33-7e8edc17f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384155c0-abdb-4448-ab0e-797be0db4df6", "name": "network-vif-plugged", "status": "completed", "tag": "607e9bc9-d63e-4f18-b20e-8c045ee4124b"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:37.383081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8a1747e5-914c-4fc0-ad02-2bb03bf0a57d req-d68277fc-c350-40b3-9b33-7e8edc17f7b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:37.384322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8a1747e5-914c-4fc0-ad02-2bb03bf0a57d req-d68277fc-c350-40b3-9b33-7e8edc17f7b5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:37.401875 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8a1747e5-914c-4fc0-ad02-2bb03bf0a57d req-d68277fc-c350-40b3-9b33-7e8edc17f7b5 service nova] Creating event network-vif-plugged:607e9bc9-d63e-4f18-b20e-8c045ee4124b for instance 384155c0-abdb-4448-ab0e-797be0db4df6 on nch1-master-1 Mar 26 21:00:37.410377 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8a1747e5-914c-4fc0-ad02-2bb03bf0a57d req-d68277fc-c350-40b3-9b33-7e8edc17f7b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045075 Mar 26 21:00:37.412548 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1517/3251] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:37.422866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:37.423894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:37.437398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:37.438348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:37.439499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:37.440226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:37.893487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:37.908788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b7c85da-0f71-454f-842b-af0818bd5213 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.494770 Mar 26 21:00:37.910330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1518/3252] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:37 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:37.930884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:37.931996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:37.934621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:37.937443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:37.939100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:37.958451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:37.959515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:37.961561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:37.962027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:38.012985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:38.024836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Getting quotas for user 6f4376fd9ace4887af0b56483b90a23d and project 62b213fd60a44c2481f49b4ed4711a67. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:38.060078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:38.070709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:38.137010 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f935e77e-e76b-4fe7-baf1-95db6ffc8aff tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.313574 Mar 26 21:00:38.141834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1735/3253] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:00:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:00:38.163758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8523b912-5105-4866-888f-c59752225fb0 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:38.166471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8523b912-5105-4866-888f-c59752225fb0 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:38.379022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:38.379990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:38.390128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:38.390799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:38.392162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:38.393253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:38.660781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:38.674134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:38.679779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:38.682449 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58d7f0c1-25ef-4984-8c8c-bda355a1be0c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 0.308682 Mar 26 21:00:38.685597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1736/3254] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:38 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:38.782554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8523b912-5105-4866-888f-c59752225fb0 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:38.790977 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8523b912-5105-4866-888f-c59752225fb0 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1225 microversion: 2.1 time: 0.639622 Mar 26 21:00:38.794822 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1519/3255] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:38 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1225 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:38.928547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:38.929351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:38.941954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:38.950430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:38.953349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:38.955758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:39.372155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:39.394407 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dafd371b-ead1-4fa8-a7c8-84d28c9be6d3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1307 microversion: 2.1 time: 0.467734 Mar 26 21:00:39.397579 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1737/3256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:38 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:39.448528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-21a38fd5-2de8-4ee7-8c53-06edc880c9b8 req-38b121be-52da-4fe8-b5aa-4cf136c004a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ae58a2-4795-46d7-859a-f92d5b6fd418", "name": "network-vif-plugged", "status": "completed", "tag": "0686aad7-4468-4e9e-b65b-e1160202b5b5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:39.476111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-21a38fd5-2de8-4ee7-8c53-06edc880c9b8 req-38b121be-52da-4fe8-b5aa-4cf136c004a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:39.477793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-21a38fd5-2de8-4ee7-8c53-06edc880c9b8 req-38b121be-52da-4fe8-b5aa-4cf136c004a4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:39.514289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-21a38fd5-2de8-4ee7-8c53-06edc880c9b8 req-38b121be-52da-4fe8-b5aa-4cf136c004a4 service nova] Creating event network-vif-plugged:0686aad7-4468-4e9e-b65b-e1160202b5b5 for instance c4ae58a2-4795-46d7-859a-f92d5b6fd418 on nch2-master-1 Mar 26 21:00:39.527037 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-21a38fd5-2de8-4ee7-8c53-06edc880c9b8 req-38b121be-52da-4fe8-b5aa-4cf136c004a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086424 Mar 26 21:00:39.527677 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1520/3257] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:39.705523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:39.707086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:39.724249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:39.724813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:39.725843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:39.726312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:39.812943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:39.813593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:39.826285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:39.826744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:39.827534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:39.827997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:40.019850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:40.027561 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36908d3d-1dc2-4a8d-9bbb-c82364fdb2af tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1295 microversion: 2.1 time: 0.219008 Mar 26 21:00:40.028605 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1521/3258] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:39 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:40.051680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:40.062759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:40.064529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:40.066604 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-078acf37-f83d-4d1f-884e-e4e14507a8b3 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1362 microversion: 2.26 time: 0.367022 Mar 26 21:00:40.067404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1738/3259] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:39 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:40.415311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:40.416231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:40.424361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:40.425651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:40.426732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:40.427653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:40.709853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:40.720822 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-323ab262-7928-42e1-84c7-38371ccb6c01 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1486 microversion: 2.1 time: 0.308744 Mar 26 21:00:40.734808 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1522/3260] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:40 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1486 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:40.740894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54f8bf39-9e32-4dce-9c51-85ba5cb5c33f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:40.757514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54f8bf39-9e32-4dce-9c51-85ba5cb5c33f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:40.758622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54f8bf39-9e32-4dce-9c51-85ba5cb5c33f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:40.811975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54f8bf39-9e32-4dce-9c51-85ba5cb5c33f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:00:40.872399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54f8bf39-9e32-4dce-9c51-85ba5cb5c33f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6/action" status: 202 len: 0 microversion: 2.1 time: 0.137515 Mar 26 21:00:40.874001 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1739/3261] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:00:40 2022] POST /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:00:40.884892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:40.885662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:40.895171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:40.895876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:40.897097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:40.897957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.045875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.046605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:41.058214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.058768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.059475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.059942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.205459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:41.219697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7f76c7df-37c6-44cf-842b-740806457c95 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.339305 Mar 26 21:00:41.221016 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1523/3262] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:40 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:41.231659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.232780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:41.240793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.241574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.242562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.243207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.448146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:41.456271 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40b41dae-64da-4ec3-8cfd-885cc6ce0701 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.414798 Mar 26 21:00:41.456867 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1740/3263] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:41 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:41.520835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:41.534774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:41.536764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:41.538606 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-affbc3bd-f00a-4760-8adf-6acb6d739003 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1547 microversion: 2.26 time: 0.314588 Mar 26 21:00:41.555218 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1524/3264] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:41 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1547 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:41.561388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e58265a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.570726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.571644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.572753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:41.580443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.582066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.583025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.583704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.617866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.618929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.639523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.640652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.687131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:41.712510 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7823e7a1-5e2a-4859-82bc-5649549fc533 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-83794650" status: 201 len: 0 microversion: 2.26 time: 0.152890 Mar 26 21:00:41.714087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1741/3265] 10.222.0.16 () {62 vars in 1373 bytes} [Sat Mar 26 21:00:41 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-83794650 => generated 0 bytes in 159 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Mar 26 21:00:41.729147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4625c0fc-b520-487b-89fb-9168fbf8d69d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588c0820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.741624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4625c0fc-b520-487b-89fb-9168fbf8d69d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.742254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4625c0fc-b520-487b-89fb-9168fbf8d69d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.768058 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4625c0fc-b520-487b-89fb-9168fbf8d69d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-83794650" status: 204 len: 0 microversion: 2.26 time: 0.040602 Mar 26 21:00:41.773249 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1525/3266] 10.222.0.16 () {60 vars in 1354 bytes} [Sat Mar 26 21:00:41 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-83794650 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:41.779322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e582c7670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.798030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.800547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.806048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:41.818214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.821953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.823301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.823848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.880160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.885761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.915615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:41.945808 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8287c711-441c-4239-b01c-67219d2f0f61 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 204 len: 0 microversion: 2.26 time: 0.171440 Mar 26 21:00:41.951887 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1742/3267] 10.222.0.16 () {60 vars in 1294 bytes} [Sat Mar 26 21:00:41 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 26 21:00:41.961829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87edf077-68e4-4422-a143-3ec311610055 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588c08b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:41.979433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87edf077-68e4-4422-a143-3ec311610055 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:41.980209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87edf077-68e4-4422-a143-3ec311610055 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:41.995263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87edf077-68e4-4422-a143-3ec311610055 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 12 microversion: 2.26 time: 0.038030 Mar 26 21:00:41.998429 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1526/3268] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 21:00:41 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:42.010334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e582c7e50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.026555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.026555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.028125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.037046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.037657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.038828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.039201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.068186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.068828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.110288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.111373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.123509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1564ca25-cfcb-4de0-857d-6bff1806d4ea req-61852d8e-c982-4a7f-844b-9636d4be7fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f475fc0-4e21-44c8-9f02-75bf36a19d79", "tag": "3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:42.142869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1564ca25-cfcb-4de0-857d-6bff1806d4ea req-61852d8e-c982-4a7f-844b-9636d4be7fb8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.143345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1564ca25-cfcb-4de0-857d-6bff1806d4ea req-61852d8e-c982-4a7f-844b-9636d4be7fb8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.173468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:42.181686 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1564ca25-cfcb-4de0-857d-6bff1806d4ea req-61852d8e-c982-4a7f-844b-9636d4be7fb8 service nova] Creating event network-changed:3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7 for instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 on nch1-master-1 Mar 26 21:00:42.187178 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1564ca25-cfcb-4de0-857d-6bff1806d4ea req-61852d8e-c982-4a7f-844b-9636d4be7fb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067064 Mar 26 21:00:42.188229 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1527/3269] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:00:42.225186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9296c6e5-7c0e-4da9-a53d-311e3441627a tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1057016705" status: 201 len: 0 microversion: 2.26 time: 0.219540 Mar 26 21:00:42.231301 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1743/3270] 10.222.0.16 () {62 vars in 1379 bytes} [Sat Mar 26 21:00:42 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1057016705 => generated 0 bytes in 227 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 26 21:00:42.237790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8282e9bd-446b-48e2-baf9-972c852ba716 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588c0c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.251758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8282e9bd-446b-48e2-baf9-972c852ba716 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.252737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8282e9bd-446b-48e2-baf9-972c852ba716 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.270929 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8282e9bd-446b-48e2-baf9-972c852ba716 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 36 microversion: 2.26 time: 0.038921 Mar 26 21:00:42.273076 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1528/3271] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 21:00:42 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 36 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:42.278600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.279963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.290080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.290561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.291428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.291888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.292104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e59397e50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.305340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.306657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.307484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.316589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.317243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.318333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.318957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.366731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.367267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.409852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:42.431090 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6da7c362-8d6a-4063-bf65-32ce9003e8ff tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1057016705" status: 204 len: 0 microversion: 2.26 time: 0.152600 Mar 26 21:00:42.438672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1529/3272] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Mar 26 21:00:42 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1057016705 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:42.445346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36c344eb-43b8-4bf2-a2d0-c95cd3ec1a7b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588bc430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.457074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36c344eb-43b8-4bf2-a2d0-c95cd3ec1a7b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.457796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36c344eb-43b8-4bf2-a2d0-c95cd3ec1a7b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.475734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36c344eb-43b8-4bf2-a2d0-c95cd3ec1a7b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 12 microversion: 2.26 time: 0.034920 Mar 26 21:00:42.485870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1530/3273] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 21:00:42 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:42.493098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.494594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.504025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.505125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.506159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.507190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.792592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:42.812526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d0a6683-5841-4d33-b47a-17ae367de3e8 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.323640 Mar 26 21:00:42.823844 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1531/3274] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:42 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:42.825517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588bc9d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.832948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.833409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.833890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.845063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.845527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.846331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.846826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.880718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.881216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.886369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:42.896121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:42.896327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-442eac40-ed07-448d-b6e6-5308bc099663 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.659991 Mar 26 21:00:42.897429 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1744/3275] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:42 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:42.924117 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3901b990-6210-495b-b350-6c991d0beb89 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 204 len: 0 microversion: 2.26 time: 0.107286 Mar 26 21:00:42.924689 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1532/3276] 10.222.0.16 () {60 vars in 1294 bytes} [Sat Mar 26 21:00:42 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:42.934866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e582718b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:42.947978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.948718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.949395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:42.956860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.957699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:42.958671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:42.959298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.017205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.017677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.033476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.033585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.059445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.077051 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4acdb229-88a9-4411-94b3-ec9defcd483d tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-659057929" status: 201 len: 0 microversion: 2.26 time: 0.145748 Mar 26 21:00:43.078980 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1745/3277] 10.222.0.16 () {62 vars in 1376 bytes} [Sat Mar 26 21:00:42 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-659057929 => generated 0 bytes in 148 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 26 21:00:43.087232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e5893d790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.095591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.096105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.096587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.102977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.104001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.104777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.105611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.135956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.136965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.149949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.150846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.189979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.212739 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2590fb32-1ffa-48a6-81b1-92433d03df95 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1356732493" status: 201 len: 0 microversion: 2.26 time: 0.129198 Mar 26 21:00:43.213908 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1533/3278] 10.222.0.16 () {62 vars in 1379 bytes} [Sat Mar 26 21:00:43 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-1356732493 => generated 0 bytes in 131 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 26 21:00:43.223830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e581cde50>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.236392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.237161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.238411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.244967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.245959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.246958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.247614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.271808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.272791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.289714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.308412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9c6be0b-ae0d-4f0b-830c-58b9d9192f25 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 204 len: 0 microversion: 2.26 time: 0.089461 Mar 26 21:00:43.313232 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1746/3279] 10.222.0.16 () {60 vars in 1294 bytes} [Sat Mar 26 21:00:43 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:43.318126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2706cc1-71d9-460c-965d-e8a06dd70523 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e588eed30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.326957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2706cc1-71d9-460c-965d-e8a06dd70523 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.327477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2706cc1-71d9-460c-965d-e8a06dd70523 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.337899 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2706cc1-71d9-460c-965d-e8a06dd70523 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 12 microversion: 2.26 time: 0.023768 Mar 26 21:00:43.339297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1534/3280] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 21:00:43 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:43.349049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e5820b9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.356791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.357247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.357734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.364123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.364586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.365423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.365938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.391507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.392232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.404646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.421480 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e492b559-ef11-4cb8-8028-38fb96a473bc tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 204 len: 0 microversion: 2.26 time: 0.077085 Mar 26 21:00:43.427687 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1747/3281] 10.222.0.16 () {60 vars in 1294 bytes} [Sat Mar 26 21:00:43 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:43.432899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e5890d9d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.443065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.443904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.444931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.454254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.456082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.457104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.458128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.489831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.490624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.502356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.503074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.532721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.555530 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a588b96e-3f4c-4f81-a7f6-482cc1162624 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-687001542" status: 201 len: 0 microversion: 2.26 time: 0.126785 Mar 26 21:00:43.564198 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1535/3282] 10.222.0.16 () {62 vars in 1376 bytes} [Sat Mar 26 21:00:43 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-687001542 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 26 21:00:43.568262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e58271700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.576985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.577585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.578301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.585209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.585904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.587064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.587724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.615483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.615969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.625929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.626618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.656473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.676566 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d79f245-2771-44cc-ba48-23b7b8ba7c1b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-818723747" status: 201 len: 0 microversion: 2.26 time: 0.113749 Mar 26 21:00:43.681598 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1748/3283] 10.222.0.16 () {62 vars in 1376 bytes} [Sat Mar 26 21:00:43 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags/tempest-tag-818723747 => generated 0 bytes in 116 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 26 21:00:43.687806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Action: 'update_all', calling method: .version_select at 0x7f6e5890d0d0>, body: {"tags": ["tempest-tag-1319615131", "tempest-tag-2040649386"]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:43.697436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.698035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.698739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.705539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.706752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.707855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.711990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.750324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.750916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.778696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:43.814145 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1182232b-50c4-4d33-a579-75d83b6907e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 62 microversion: 2.26 time: 0.130690 Mar 26 21:00:43.816171 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1536/3284] 10.222.0.16 () {62 vars in 1311 bytes} [Sat Mar 26 21:00:43 2022] PUT /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 62 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:43.832177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60a60682-0844-4064-846c-d2dea757065c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e581cd160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.862657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.863288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.869933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60a60682-0844-4064-846c-d2dea757065c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.870644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60a60682-0844-4064-846c-d2dea757065c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.880281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.880281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.881948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.885373 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60a60682-0844-4064-846c-d2dea757065c tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 200 len: 62 microversion: 2.26 time: 0.063452 Mar 26 21:00:43.886389 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1749/3285] 10.222.0.16 () {60 vars in 1291 bytes} [Sat Mar 26 21:00:43 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 62 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:43.895895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.902537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '.version_select at 0x7f6e581cdb80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:43.924056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.924841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.925494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:43.937926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.948154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.949234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.951154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:43.979698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:43.981155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.000371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lazy-loading 'flavor' on Instance uuid c4ae58a2-4795-46d7-859a-f92d5b6fd418 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:00:44.040813 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3db03c46-f1f6-41ad-88fb-5c84d6ed60e8 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags" status: 204 len: 0 microversion: 2.26 time: 0.147346 Mar 26 21:00:44.041829 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1750/3286] 10.222.0.16 () {60 vars in 1294 bytes} [Sat Mar 26 21:00:43 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418/tags => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:44.048536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:44.049170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:44.058141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.058554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.059512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.059961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.316792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:44.326031 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-71db0411-3fe6-49e5-a4af-566b3988129c tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.488176 Mar 26 21:00:44.332584 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1537/3287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:43 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:44.338094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:44.338634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:44.365619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.366607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.368701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.369825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.413800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:00:44.435241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:44.444526 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64c83496-3e13-4110-8aea-80f2b9188525 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.401528 Mar 26 21:00:44.449707 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1751/3288] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:44 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:44.574239 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0daacd30-4dec-4971-aafd-26c9ca914030 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 204 len: 0 microversion: 2.26 time: 0.240324 Mar 26 21:00:44.574919 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1538/3289] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:00:44 2022] DELETE /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:00:44.584147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:44.584983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:44.592929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.593754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.594563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:44.595254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:44.964269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:44.974737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:44.976323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:44.977640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5dc3fcad-37e4-4e93-8a71-cfd264796008 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1553 microversion: 2.26 time: 0.398525 Mar 26 21:00:44.978437 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1752/3290] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:44 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1553 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:45.355071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:45.356475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:45.366308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:45.367013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:45.368001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:45.368616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:45.472975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:45.482041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:45.499029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:45.500052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:45.503865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:45.504493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:45.596880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:45.605654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed3900b4-d8e0-4bf5-b747-40cc29808599 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.259904 Mar 26 21:00:45.606206 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1539/3291] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:45 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:45.989566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:45.998066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:45.998823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:46.002416 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b00c9b3-a12e-469c-85aa-a9c6e194b657 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.539075 Mar 26 21:00:46.004901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1753/3292] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:45 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:46.023325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:46.026159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:46.028368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:46.028940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:46.392097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:46.406851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:46.412586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:46.415147 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-37490502-c999-4b5c-87a8-282cae5eb5e6 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1553 microversion: 2.26 time: 0.420810 Mar 26 21:00:46.418496 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1540/3293] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:45 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:46.623026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:46.623863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:46.633332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:46.633825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:46.634981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:46.635701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:46.986114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:47.001904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78d07660-afd3-4960-b2f6-34fe00dd3f91 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.382903 Mar 26 21:00:47.003547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1754/3294] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:46 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:47.027550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:47.028646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:47.036883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:47.037338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:47.038347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:47.038938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:47.406977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:47.423054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b5118e4-9dc2-434f-bb36-04e576482f06 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.400199 Mar 26 21:00:47.424327 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1541/3295] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:47 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:47.437696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:47.438776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:47.448529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:47.449421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:47.450513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:47.451105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:47.530035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:47.548014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9f5fedfd-27be-4386-b9ee-17a7cdb28352 req-abba87a0-bbf6-455c-9331-41de6525b8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ae58a2-4795-46d7-859a-f92d5b6fd418", "name": "network-vif-deleted", "tag": "0686aad7-4468-4e9e-b65b-e1160202b5b5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:47.555558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:47.557842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95881858fbbb418aac62a64f4d0754d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b182d640d24ff9ab5c8da47efdc110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:47.571209 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef9520d8-9f8f-4108-8b80-55ba8d14c2f2 tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 200 len: 1511 microversion: 2.26 time: 0.137870 Mar 26 21:00:47.574942 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1755/3296] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:47 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:47.580489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f5fedfd-27be-4386-b9ee-17a7cdb28352 req-abba87a0-bbf6-455c-9331-41de6525b8b1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:47.581153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f5fedfd-27be-4386-b9ee-17a7cdb28352 req-abba87a0-bbf6-455c-9331-41de6525b8b1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:47.600231 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9f5fedfd-27be-4386-b9ee-17a7cdb28352 req-abba87a0-bbf6-455c-9331-41de6525b8b1 service nova] Creating event network-vif-deleted:0686aad7-4468-4e9e-b65b-e1160202b5b5 for instance c4ae58a2-4795-46d7-859a-f92d5b6fd418 on nch2-master-1 Mar 26 21:00:47.607006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9f5fedfd-27be-4386-b9ee-17a7cdb28352 req-abba87a0-bbf6-455c-9331-41de6525b8b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065230 Mar 26 21:00:47.607829 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1542/3297] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:48.027305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:48.028531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:48.043862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.044417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.045291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.045785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.406895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:48.427276 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a5bf5885-dd3a-4437-acbd-67b68446a6ba tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.410566 Mar 26 21:00:48.430055 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1756/3298] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:48 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:48.445467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:48.448012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:48.459547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.461325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.463514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.463514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.594625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:48.595572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] [instance: c4ae58a2-4795-46d7-859a-f92d5b6fd418] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:48.612271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.613387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.617383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.617933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.650881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] HTTP exception thrown: Instance c4ae58a2-4795-46d7-859a-f92d5b6fd418 could not be found. Mar 26 21:00:48.652464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] Returning 404 to user: Instance c4ae58a2-4795-46d7-859a-f92d5b6fd418 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:00:48.653528 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a96d7007-084c-4916-9971-df09ba3b4b2b tempest-ServerTagsTestJSON-226672373 tempest-ServerTagsTestJSON-226672373-project] 10.222.0.16 "GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418" status: 404 len: 111 microversion: 2.26 time: 0.065482 Mar 26 21:00:48.654495 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1757/3299] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:48 2022] GET /compute/v2.1/servers/c4ae58a2-4795-46d7-859a-f92d5b6fd418 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:00:48.780373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-97557b20-78e3-408a-9e69-b657edd5e304 req-93bc85b2-0329-4f31-81e7-0933a8923067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f475fc0-4e21-44c8-9f02-75bf36a19d79", "name": "network-vif-plugged", "status": "completed", "tag": "3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:48.780628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:48.794832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-97557b20-78e3-408a-9e69-b657edd5e304 req-93bc85b2-0329-4f31-81e7-0933a8923067 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:48.807633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-97557b20-78e3-408a-9e69-b657edd5e304 req-93bc85b2-0329-4f31-81e7-0933a8923067 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:48.812745 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40b9a5c2-e7a8-4d4f-baae-b7e464ea08d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.373190 Mar 26 21:00:48.823959 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1543/3300] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:48 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:48.845118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-97557b20-78e3-408a-9e69-b657edd5e304 req-93bc85b2-0329-4f31-81e7-0933a8923067 service nova] Creating event network-vif-plugged:3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7 for instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 on nch1-master-1 Mar 26 21:00:48.859459 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-97557b20-78e3-408a-9e69-b657edd5e304 req-93bc85b2-0329-4f31-81e7-0933a8923067 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095370 Mar 26 21:00:48.860626 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1758/3301] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:00:49.446698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:49.447609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:49.459458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:49.459852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:49.462796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:49.466694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:49.771534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:49.780037 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2313b999-519f-4771-af8f-e3103ba94ebd tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1351 microversion: 2.1 time: 0.337252 Mar 26 21:00:49.781717 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1544/3302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:49 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1351 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:49.839794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:49.841194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:49.849537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:49.850164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:49.851986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:49.852714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:50.113779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:50.121696 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1375c08-c55a-487e-84d5-43626bb899b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.288800 Mar 26 21:00:50.123966 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1759/3303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:49 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:50.800274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:50.800890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:50.809886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:50.810848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:50.811665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:50.812178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.135708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:51.142136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:51.142821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:51.148210 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f29ed6a8-b027-4e78-a6ae-86281e9c8103 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1541 microversion: 2.1 time: 0.353000 Mar 26 21:00:51.149262 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1545/3304] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:50 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1541 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:51.167217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:51.168435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:51.174263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.176738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.176874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.177536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.178518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.179148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.185188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.185966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.350874 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f93b9b62-3ce9-4f2b-b248-e340b72acab2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185963 Mar 26 21:00:51.353986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1546/3305] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:00:51 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:00:51.623220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:51.648951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2bf3f38-179c-4c06-8e41-4cd8a95aa240 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.505726 Mar 26 21:00:51.650096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1760/3306] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:51 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:51.742590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1375615589", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:51.845364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:51.846687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:51.847449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:51.848374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:51.849028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:51.863116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.864010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.865185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:51.865718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:51.887622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Getting quotas for project 436249e4501a43dd95fd98fc53d74b30. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:51.894563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Getting quotas for user 7eac57fcd76942d28f51d0f6ee6eeb0f and project 436249e4501a43dd95fd98fc53d74b30. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:51.912614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:51.915446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:51.982239 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc0de9ad-c1da-4d13-9ac4-8cb6503132b8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.430184 Mar 26 21:00:51.996373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1547/3307] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:00:52.001325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:52.001911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:52.118314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:52.130493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:52.135156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:52.142473 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55d968f5-7744-4883-9ed5-65fb066f5f32 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8" status: 200 len: 1278 microversion: 2.47 time: 0.145012 Mar 26 21:00:52.145141 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1761/3308] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:51 2022] GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:00:52.263691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-364306805", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:52.353129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:52.353890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:52.354446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:52.355443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:52.355443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:52.396181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.396718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.399720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.400432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.483075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Getting quotas for project 436249e4501a43dd95fd98fc53d74b30. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:00:52.509516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Getting quotas for user 7eac57fcd76942d28f51d0f6ee6eeb0f and project 436249e4501a43dd95fd98fc53d74b30. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:00:52.559510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:00:52.562234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:00:52.570771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:52.578049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:52.581993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Searching by: {'deleted': False, 'project_id': '586533ed0cf646c2945f68477b651e23'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:00:52.592282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.593290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.595108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.595786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.632101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:00:52.685704 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1afeb04f-68b6-42f6-9392-4425c15e6ebd tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.120604 Mar 26 21:00:52.696375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1762/3309] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 21:00:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:52.702202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:52.703041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:52.712445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.713125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.714155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.714750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.750626 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf5ceb02-c2c6-4b48-bfd4-561bb8834ee2 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.503172 Mar 26 21:00:52.757952 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1548/3310] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:00:52.776326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:52.803411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:52.804575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Searching by: {'deleted': False, 'project_id': '586533ed0cf646c2945f68477b651e23'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:00:52.813823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.814555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.816134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:52.816753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:52.897067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:00:53.071403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:53.085652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:53.086796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:53.807382 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ce5621a-47cc-48f6-93ed-44c953374112 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 1.046375 Mar 26 21:00:53.809238 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1549/3311] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:00:52 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:53.817924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:53.823599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:53.841692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:53.845511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:53.847788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:53.849673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:53.947656 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-abaae202-32e2-4d1b-a15c-fff08a39e2a5 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "PUT /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 991 microversion: 2.47 time: 0.136871 Mar 26 21:00:53.948753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1550/3312] 10.222.0.16 () {62 vars in 1296 bytes} [Sat Mar 26 21:00:53 2022] PUT /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 991 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:00:53.949848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:53.960852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a3b114ed-75c5-47ed-8877-89ccb1d83af4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 1.262785 Mar 26 21:00:53.961502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc345949-4481-4e57-a7a7-798a27b7efba tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:53.961746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1763/3313] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:52 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:53.976024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:53.977153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:53.985943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc345949-4481-4e57-a7a7-798a27b7efba tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035755 Mar 26 21:00:53.986884 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1551/3314] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:00:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:53.993572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:53.996673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:53.997846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:53.998552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:54.127429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:54.146148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:54.155350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:54.156990 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f5bb49a-3529-4770-9fd4-7e343e82e0e8 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1273 microversion: 2.47 time: 0.194194 Mar 26 21:00:54.157997 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1764/3315] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:53 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:54.315747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:54.316572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:54.327956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:54.332377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:54.333446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:54.334062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:54.393304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:00:54.685006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e470676-6644-4278-bfdc-75b2eb58211a tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 204 len: 0 microversion: 2.1 time: 0.373027 Mar 26 21:00:54.689088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1552/3316] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:00:54 2022] DELETE /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:00:54.703616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:54.704500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:54.714098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:54.714986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:54.716074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:54.716769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:54.993980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:54.995754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:55.032617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:55.042978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:55.044379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:55.046324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:55.051816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:55.054280 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-13e0f86e-3799-4ae0-94ad-f021b21715c4 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1606 microversion: 2.1 time: 0.358870 Mar 26 21:00:55.066521 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1765/3317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:54 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1606 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:55.178409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:55.179171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:55.188278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:55.188859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:55.190870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:55.191958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:55.418651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:55.462682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:55.479102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:55.482292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3c21645-238e-4c1f-81be-ce66566ee499 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1335 microversion: 2.47 time: 0.308823 Mar 26 21:00:55.491973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1766/3318] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:55 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1335 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:55.498858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-628533ea-d410-471f-9f65-f43712ad4c4a req-8bdc9d6c-532f-4f1a-a869-cb3c851a18be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f475fc0-4e21-44c8-9f02-75bf36a19d79", "tag": "3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:55.512763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-628533ea-d410-471f-9f65-f43712ad4c4a req-8bdc9d6c-532f-4f1a-a869-cb3c851a18be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:55.513487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-628533ea-d410-471f-9f65-f43712ad4c4a req-8bdc9d6c-532f-4f1a-a869-cb3c851a18be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:55.541499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-628533ea-d410-471f-9f65-f43712ad4c4a req-8bdc9d6c-532f-4f1a-a869-cb3c851a18be service nova] Creating event network-changed:3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7 for instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 on nch1-master-1 Mar 26 21:00:55.564975 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-628533ea-d410-471f-9f65-f43712ad4c4a req-8bdc9d6c-532f-4f1a-a869-cb3c851a18be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070757 Mar 26 21:00:55.566902 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1767/3319] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:55.567361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:55.578457 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f328b58d-4b0f-4c1c-a107-e06b0085af4a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.601917 Mar 26 21:00:55.579050 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1553/3320] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:54 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:56.073592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:56.075443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:56.104826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.106925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.109487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.110890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.512598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:56.513430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:56.529733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.538969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.540237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.542545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.734015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:56.748008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:56.749823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:56.756424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa60da4b-575a-4e3e-ab7d-25c29d6a67e3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1335 microversion: 2.47 time: 0.244623 Mar 26 21:00:56.757993 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1554/3321] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:56 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1335 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:56.773619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:56.775110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:56.794926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.796214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.798394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:56.799007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:56.912887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:56.924495 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e99819d4-2900-4735-8bcb-b37072a9835c tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1606 microversion: 2.1 time: 0.855465 Mar 26 21:00:56.926551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1768/3322] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:56 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1606 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:57.091193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:57.102397 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f38458eb-5a03-4102-878e-e49604b39424 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.342590 Mar 26 21:00:57.103003 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1555/3323] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:56 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:57.778389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:57.779426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:57.796553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.801236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:57.802493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.804625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:57.941684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:57.942299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:57.944242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:57.954503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:57.957058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:57.957194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.957583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:57.958641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.958863 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-239a681d-97e1-4bc5-9425-fd9f4dbcb47c tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1356 microversion: 2.47 time: 0.186884 Mar 26 21:00:57.959085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:57.968014 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1769/3324] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:57 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:57.980709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:57.983582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:57.994983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.995808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:57.997208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:57.997826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.134420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:00:58.135186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:00:58.136705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:00:58.137496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:00:58.138103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:00:58.267825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:58.295827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.296583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.298801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.300983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.361276 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4b0c80e-81fa-4b21-85bd-15b32da2494e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "POST /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1/action" status: 202 len: 1078 microversion: 2.47 time: 0.385767 Mar 26 21:00:58.374126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1770/3325] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:00:57 2022] POST /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1/action => generated 1078 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 26 21:00:58.381257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:58.382247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:58.408323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.409614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.410893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.411557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.612764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:58.627417 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c84b71d2-2fac-454b-b15c-7e15d0de990b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1606 microversion: 2.1 time: 0.689486 Mar 26 21:00:58.640188 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1556/3326] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:57 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1606 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:00:58.656699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:58.657755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:58.665309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.666181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.667180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:58.668236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:58.882956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:58.899399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:58.900957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:58.902163 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc7606d3-c5c2-4bec-a2ca-97541d24071d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.260388 Mar 26 21:00:58.902736 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1557/3327] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:58 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:00:59.214047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:59.223220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58022ec5-2345-4914-af57-35ea49906817 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.847709 Mar 26 21:00:59.233207 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1771/3328] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:58 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:00:59.527551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ec6e743f-d257-4309-8c43-0176ef5702cf req-8b079fcf-573c-4495-a8be-352b7f23fa96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09615731-6e79-49e6-b750-c6412628ecab", "name": "network-vif-deleted", "tag": "74586d05-0a23-40a4-a976-8b3ddbbcbf41"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:00:59.551061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec6e743f-d257-4309-8c43-0176ef5702cf req-8b079fcf-573c-4495-a8be-352b7f23fa96 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:59.552579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec6e743f-d257-4309-8c43-0176ef5702cf req-8b079fcf-573c-4495-a8be-352b7f23fa96 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:59.588928 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ec6e743f-d257-4309-8c43-0176ef5702cf req-8b079fcf-573c-4495-a8be-352b7f23fa96 service nova] Creating event network-vif-deleted:74586d05-0a23-40a4-a976-8b3ddbbcbf41 for instance 09615731-6e79-49e6-b750-c6412628ecab on nch1-master-1 Mar 26 21:00:59.604885 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ec6e743f-d257-4309-8c43-0176ef5702cf req-8b079fcf-573c-4495-a8be-352b7f23fa96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083585 Mar 26 21:00:59.606467 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1558/3329] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:00:59.645190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:59.645811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:59.658110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:59.658575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:59.659942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:59.660388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:59.926046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:00:59.927774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:00:59.943497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:59.944063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:59.952442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:00:59.953444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:00:59.976047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791eb951b71e493c82ce921d1f8f4174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586533ed0cf646c2945f68477b651e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:00:59.990079 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-763c8d82-a2f5-401a-aa3b-531e6dc89380 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 200 len: 1252 microversion: 2.1 time: 0.348610 Mar 26 21:00:59.996961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1772/3330] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:00:59 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:00.145609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:00.161075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:00.180244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:00.185384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1148371-8427-4768-aa72-88d1b22de946 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.265915 Mar 26 21:01:00.188003 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1559/3331] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:00:59 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:00.242114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:00.243292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:00.264206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.264965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.265928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.266534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.466520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:00.467561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:00.485210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.486182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.488269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.488900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.683676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:00.692434 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfd5659a-345e-487a-80d9-8f4d3b983cf1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.455300 Mar 26 21:01:00.693996 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1773/3332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:00 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:00.731035 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9119ad30-ae61-403b-87b0-01b9004d5600 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.315255 Mar 26 21:01:00.732715 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1560/3333] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:01:00 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:01:00.744315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:00.747866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:00.761789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.762661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.763808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:00.764942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:00.980127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:00.991318 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-300a1372-e97c-478c-98f6-708e179f63dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1672 microversion: 2.1 time: 0.253238 Mar 26 21:01:00.995970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1774/3334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:00 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1672 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:01.026758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:01.027558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] [instance: 09615731-6e79-49e6-b750-c6412628ecab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:01.037837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.039169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:01.040443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.042117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:01.067725 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] HTTP exception thrown: Instance 09615731-6e79-49e6-b750-c6412628ecab could not be found. Mar 26 21:01:01.072901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Returning 404 to user: Instance 09615731-6e79-49e6-b750-c6412628ecab could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:01:01.073907 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-041c37be-837d-4021-928c-a519ac155e62 tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab" status: 404 len: 111 microversion: 2.1 time: 0.057798 Mar 26 21:01:01.075655 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1561/3335] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:01 2022] GET /compute/v2.1/servers/09615731-6e79-49e6-b750-c6412628ecab => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:01:01.085617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56f3ecfd-6a7f-4303-bb75-c907963b010b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] Calling method '.version_select at 0x7f6e581a15e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:01.113516 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56f3ecfd-6a7f-4303-bb75-c907963b010b tempest-ServersTestBootFromVolume-299370577 tempest-ServersTestBootFromVolume-299370577-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339957730" status: 202 len: 0 microversion: 2.1 time: 0.032701 Mar 26 21:01:01.115614 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1775/3336] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339957730 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:01:01.206902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:01.207520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:01.217905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.218355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:01.219136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.219573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:01.338695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:01.347509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:01.353554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:01.356602 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29e8d473-c349-47ee-ad5b-a925e8bf91f6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.154254 Mar 26 21:01:01.360083 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1562/3337] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:01 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:01.710970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:01.711582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:01.722632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.723113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:01.723956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:01.728639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.001268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e8c875b-50fe-4f77-bc0e-a4f6256e714d"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:02.002393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:02.016257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.016973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.017948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.018751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.209146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:02.219366 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dfddef8b-1394-401a-9740-024070824d2b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.512570 Mar 26 21:01:02.219984 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1776/3338] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:01 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:02.238429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:02.240169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:02.264021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.264530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.265672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.265792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.419759 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76c1c4aa-758a-4406-b044-2f0381d7ccb5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406891 Mar 26 21:01:02.422011 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1563/3339] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:01:01 2022] POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:02.436073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:02.438110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:02.446585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.447637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.449321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:02.449996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:02.645518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:02.660761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:02.668099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:02.671629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-64a39c90-0adb-4a07-8756-57048b7d8387 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.248144 Mar 26 21:01:02.676951 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1564/3340] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:02 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:02.708078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:02.720899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6ba2e48-de71-41f7-b08e-67793bbdc99a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1672 microversion: 2.1 time: 0.499448 Mar 26 21:01:02.722269 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1777/3341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:02 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1672 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:03.237743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:03.239071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:03.254380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.254865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.255633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.256102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.694871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:03.695503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:03.707629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.708130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.708934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.709380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.837337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:03.854887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:03.862729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:03.869977 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fb995914-b1e8-4fa5-901f-ff365f1baa48 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.178976 Mar 26 21:01:03.872519 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1778/3342] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:03 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:03.883015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:03.883667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:03.900129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.900594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.903712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:03.904274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:03.952964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:03.960555 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eef175f5-1a00-4789-90e8-4b99d550f6ff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.727364 Mar 26 21:01:03.961143 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1565/3343] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:03 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:04.313543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:04.323894 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1b4b918-99cc-4c0a-8dc0-591fbd42e3d4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.449564 Mar 26 21:01:04.325675 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1779/3344] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:03 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:04.888621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:04.889326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:04.896934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:04.897424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:04.898207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:04.898653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:04.978547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:04.979894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:04.987080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:04.987865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:04.988983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:04.989691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:05.041626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:05.054577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:05.057173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:05.058648 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcaaaf97-8365-4bbc-b3b6-ef51f116e1c6 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.174084 Mar 26 21:01:05.059202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1566/3345] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:04 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:05.191075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:05.203811 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9493e34-e18e-4760-b095-3ae849186a3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.229792 Mar 26 21:01:05.205469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1780/3346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:04 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:05.838344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:05.839810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:05.846942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:05.847403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:05.848313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:05.848762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:05.873933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'flavor' on Instance uuid 400d840e-75b6-4886-9f10-30b56c2c4886 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:01:06.034607 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c477eeb4-5793-4920-b1ff-9af5ac4c316f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/action" status: 200 len: 32 microversion: 2.1 time: 0.200212 Mar 26 21:01:06.035293 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1567/3347] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:01:05 2022] POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:01:06.044756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:06.046097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:06.055534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.056046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.058172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.058778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.080260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:06.081712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:06.092833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.093283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.096762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.097726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.240937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:06.253102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:06.255211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:06.256831 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3c1af2f-dea0-49c6-8162-8806c6c0866d tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.182141 Mar 26 21:01:06.271230 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1568/3348] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:06 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:06.277847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:06.278528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:06.285570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.286219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.287542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:06.288184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:06.381001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:06.393747 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ded0497d-b21c-42cd-acb3-fd4e1136609d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.351335 Mar 26 21:01:06.394442 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1781/3349] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:06 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:06.719585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:06.730801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9bf60bd-ce0c-462c-b3dd-0f20bcc8c3c0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.458122 Mar 26 21:01:06.731316 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1569/3350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:06 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:07.279731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:07.280378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:07.287480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.288260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.289042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.289504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.412044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:07.413057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:07.420347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.421227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.422176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.422727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.472763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:07.481385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:07.483283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:07.484687 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-040c7c7f-e23e-4966-ba4c-ab25ea48a4cb tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.209885 Mar 26 21:01:07.486326 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1782/3351] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:07 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:07.748216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:07.748938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:07.764622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.765445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.767427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:07.769440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:07.802122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:07.812088 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f4cd021-8430-426c-896d-0d81a42efc0c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.404402 Mar 26 21:01:07.819272 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1570/3352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:07 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:08.098235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:08.115668 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c555ae0f-6404-4555-91b3-6350d683b157 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.371826 Mar 26 21:01:08.129008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1783/3353] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:07 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:08.505298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:08.506717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:08.517504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:08.518463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:08.519257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:08.519706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:08.687097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:08.697685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:08.699211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:08.700423 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-832bb190-2491-4f68-8d5a-ed129523c9a4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.200175 Mar 26 21:01:08.700987 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1571/3354] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:08 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:08.838087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:08.838761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:08.852972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:08.853685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:08.854542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:08.854985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:09.133916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:09.134523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:09.142325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:09.143427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:09.144900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:09.145661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:09.346199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:09.359015 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-412f6f2e-c5e5-4d92-9bf3-b775ced3fab6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.228952 Mar 26 21:01:09.362303 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1572/3355] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:09 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:09.377137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:09.389594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6dfdaf9b-815c-4ff5-8514-ba48ff444a48 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.555568 Mar 26 21:01:09.391132 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1784/3356] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:08 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:09.719717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:09.720398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:09.729282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:09.729979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:09.731013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:09.731670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:09.954087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:09.964483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:09.966772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:09.975994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08fee055-ee05-4ddf-8ca1-ce2d6b07e41e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.252338 Mar 26 21:01:09.978720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1573/3357] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:09 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:10.380878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:10.381618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:10.393398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:10.394297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:10.395668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:10.396263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:10.406368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:10.407178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:10.413412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:10.413869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:10.414830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:10.415602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:10.685659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:10.695242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b167dcd-fc6e-4e49-b3b2-69eee6a8181e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.292592 Mar 26 21:01:10.700498 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1574/3358] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:10 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:10.805120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:10.816350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ff85d8ab-fcb9-4fab-8707-1f7bdc15f23e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1496 microversion: 2.1 time: 0.440340 Mar 26 21:01:10.817940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1785/3359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:10 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:11.020100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:11.021438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:11.049746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.050454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:11.051861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.052551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:11.185276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:11.201280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:11.203030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:11.204940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60e7e019-75dc-41dc-bfc7-da11a5887245 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.210639 Mar 26 21:01:11.231519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1575/3360] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:10 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:11.714576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:11.715202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:11.722367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.723065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:11.723860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.725098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:11.840709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:11.841750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:11.853904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.854707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:11.856482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:11.857333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:12.158639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:12.177922 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-174762c7-7d74-47c0-a5df-47a544828bfa tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 200 len: 1473 microversion: 2.1 time: 0.347676 Mar 26 21:01:12.181103 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1576/3361] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:11 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:12.201192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1977102313"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:12.202731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:12.211347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:12.212048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:12.213232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:12.217252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:12.507584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:12.516545 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f88af63-506e-4d77-b247-6c592925d64d tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.805775 Mar 26 21:01:12.536329 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1786/3362] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:11 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:12.541374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:12.542003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:12.556900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:12.557375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:12.558225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:12.558680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:12.726225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:12.735407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:12.737704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:12.739291 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1daff45-7f10-4e92-8944-340d5d784935 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.201892 Mar 26 21:01:12.740404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1787/3363] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:12 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:12.883504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-327f4905-5da7-4c05-8be3-55af7623c9b8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6/action" status: 202 len: 0 microversion: 2.1 time: 0.688355 Mar 26 21:01:12.884936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1577/3364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:01:12 2022] POST /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 26 21:01:12.894995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82e4537d-696f-4b75-80cf-910e46f4ed29 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581f3dc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:12.978370 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82e4537d-696f-4b75-80cf-910e46f4ed29 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.087395 Mar 26 21:01:12.981083 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1788/3365] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:12 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:13.536704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:13.538123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:13.546091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:13.546831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:13.547889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:13.548552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:13.746754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:13.758103 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d612a50-6689-401c-b486-ac2e64004b55 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.227617 Mar 26 21:01:13.759267 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1578/3366] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:13 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:13.768917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:13.769580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:13.782036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:13.782696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:13.783723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:13.784558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:13.885529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:13.894978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:13.896828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:13.898144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e744c77d-85dc-45c3-9058-65b74e002269 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.142563 Mar 26 21:01:13.898815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1789/3367] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:13 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:13.995423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7962447f-07d3-49bf-91e5-a5e0c6124eeb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e588cbe50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:14.053889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7962447f-07d3-49bf-91e5-a5e0c6124eeb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.062872 Mar 26 21:01:14.054935 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1579/3368] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:13 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:14.792446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:14.800158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:14.822350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:14.823198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:14.824492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:14.825968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:14.917312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:14.922475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:14.945139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:14.950935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:14.951810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:14.953713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:15.071204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:15.083049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:15.085251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:15.100034 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7459f9fa-83f9-462c-bb90-7dd482ef88d9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.184394 Mar 26 21:01:15.113331 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1580/3369] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:14 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:15.126761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61469eec-6d31-410b-b35a-8fc4a5df190c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e59725af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:15.196296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61469eec-6d31-410b-b35a-8fc4a5df190c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.081452 Mar 26 21:01:15.197860 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1581/3370] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:15 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:15.601106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:15.614229 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eaf6b567-6029-43df-8984-853a9e0a8e4e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.840430 Mar 26 21:01:15.636213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1790/3371] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:14 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:16.120892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:16.121517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:16.136496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:16.140695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:16.141721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:16.142348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:16.211382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d358077f-5ea2-4683-9e7a-f53f4fd6ffa3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5820b1f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:16.290098 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d358077f-5ea2-4683-9e7a-f53f4fd6ffa3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.083369 Mar 26 21:01:16.291854 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1791/3372] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:16 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:16.324154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:16.335781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:16.338634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:16.342256 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80d47d6b-bda4-4f09-b5eb-537b763300ff tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.224874 Mar 26 21:01:16.355278 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1582/3373] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:16 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:16.634926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:16.635824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:16.646951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:16.648606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:16.650702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:16.653210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:17.019273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:17.034864 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9400dd87-7b95-48d0-a5ce-c9e539990e54 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.404112 Mar 26 21:01:17.035650 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1792/3374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:16 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:17.307250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24990f0f-f748-45bf-82f8-8c1c0f983785 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e588670d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:17.363432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:17.365378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:17.380602 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24990f0f-f748-45bf-82f8-8c1c0f983785 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.080291 Mar 26 21:01:17.381218 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1583/3375] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:17 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:17.382813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:17.383527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:17.384594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:17.385286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:17.560850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:17.570309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:17.574346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:17.577395 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d18a8b1-e941-44d2-8d61-47c78b6cc447 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.219530 Mar 26 21:01:17.586116 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1793/3376] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:17 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:18.054580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:18.055213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:18.069697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:18.071190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:18.072994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:18.074890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:18.325242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:18.337872 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0e695e6f-2874-47e0-be80-3c1d7cd6af83 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.289951 Mar 26 21:01:18.339395 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1584/3377] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:18 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:18.393925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03bc9b0b-0842-461a-8ec0-80f75719509a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b1550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:18.508067 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03bc9b0b-0842-461a-8ec0-80f75719509a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.118069 Mar 26 21:01:18.515758 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1794/3378] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:18 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:18.602809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:18.603646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:18.620161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:18.621364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:18.622376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:18.624674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:18.773737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:18.784496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:18.786985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:18.788250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-327e7e61-a14c-456a-a4a3-aeb85fa3f165 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.189881 Mar 26 21:01:18.788836 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1585/3379] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:18 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:19.357116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:19.357985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:19.373954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:19.375984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:19.377651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:19.378261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:19.524559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7432804-5866-468d-841c-c4baeb7c4267 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587f4c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:19.587142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7432804-5866-468d-841c-c4baeb7c4267 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.067502 Mar 26 21:01:19.588787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1586/3380] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:19 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:19.810492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:19.811172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:19.827673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:19.828353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:19.829204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:19.829756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:19.964633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:19.973997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:19.975516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:19.983718 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a597e3e1-2f85-40cd-ae42-993c83872b22 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.170274 Mar 26 21:01:19.985186 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1587/3381] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:19 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:20.602176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9e3646e-af88-42b1-9544-1d699479165e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587d2280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:20.631538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:20.666084 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a84f5bcb-4e5a-469b-a143-4eb9be1dfe1f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 1.312901 Mar 26 21:01:20.667329 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1795/3382] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:19 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:20.715037 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9e3646e-af88-42b1-9544-1d699479165e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.116992 Mar 26 21:01:20.723193 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1588/3383] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:20 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:20.738092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-29c171a4-bb45-4d1e-91a8-000d0763daaf req-88a11c82-c3b4-4a7d-b6c6-5dc7ab4a4d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384155c0-abdb-4448-ab0e-797be0db4df6", "name": "network-vif-plugged", "status": "completed", "tag": "607e9bc9-d63e-4f18-b20e-8c045ee4124b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:20.763385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-29c171a4-bb45-4d1e-91a8-000d0763daaf req-88a11c82-c3b4-4a7d-b6c6-5dc7ab4a4d9a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:20.764247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-29c171a4-bb45-4d1e-91a8-000d0763daaf req-88a11c82-c3b4-4a7d-b6c6-5dc7ab4a4d9a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:20.806902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-29c171a4-bb45-4d1e-91a8-000d0763daaf req-88a11c82-c3b4-4a7d-b6c6-5dc7ab4a4d9a service nova] Creating event network-vif-plugged:607e9bc9-d63e-4f18-b20e-8c045ee4124b for instance 384155c0-abdb-4448-ab0e-797be0db4df6 on nch1-master-1 Mar 26 21:01:20.815249 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-29c171a4-bb45-4d1e-91a8-000d0763daaf req-88a11c82-c3b4-4a7d-b6c6-5dc7ab4a4d9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082630 Mar 26 21:01:20.821346 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1796/3384] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:21.003130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:21.003748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:21.013886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:21.014354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:21.015153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:21.017018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:21.183872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:21.199329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:21.202410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:21.208720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c31f10ad-e016-4a14-a7bf-8a2e63aa34dc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.209941 Mar 26 21:01:21.209583 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1589/3385] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:20 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:21.689082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:21.699527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:21.719469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:21.720032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:21.720923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:21.723563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:21.728851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db41923f-f04b-4f42-a723-308444e7b4e8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5883ac10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:21.815572 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db41923f-f04b-4f42-a723-308444e7b4e8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.090776 Mar 26 21:01:21.826713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1590/3386] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:21 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:22.233687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:22.235278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:22.250319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:22.255053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:22.256985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:22.260685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:22.299331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:22.308625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b3d42d8-720f-4e17-88a1-649fa1fee2f3 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.628241 Mar 26 21:01:22.324723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1797/3387] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:21 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:22.441475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:22.460112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:22.466151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:22.469975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f37ca72-5efe-4cc7-8940-37e307d33411 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.245146 Mar 26 21:01:22.473259 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1591/3388] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:22 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:22.835975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c5125e1-2c24-474c-8fb9-3ceaacf6ed2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5819b310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:22.930675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c5125e1-2c24-474c-8fb9-3ceaacf6ed2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.099404 Mar 26 21:01:22.931985 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1798/3389] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:22 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:23.331371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:23.332070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:23.345575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:23.346050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:23.350231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:23.350860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:23.491632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:23.492494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:23.506817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:23.508598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:23.512294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:23.513266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:23.662598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:23.680012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:23.684230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:23.686115 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c466565-3532-4509-a490-29014700cebc tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.198640 Mar 26 21:01:23.689963 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1799/3390] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:23 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:23.833672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:23.867243 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4640243-7f2f-4bc0-be54-3751941eb314 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.517299 Mar 26 21:01:23.875019 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1592/3391] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:23 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:23.946635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-740774f0-4f2a-4b55-90be-3ada75ffa931 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b1d30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:24.046370 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-740774f0-4f2a-4b55-90be-3ada75ffa931 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.105193 Mar 26 21:01:24.058788 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1800/3392] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:23 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:24.708766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:24.712513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:24.727231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:24.727691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:24.732867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:24.735577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:24.889423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:24.890353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:24.911938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:24.912465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:24.913278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:24.913722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:25.244696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:25.257954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:25.268306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:25.278235 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59e12ad7-2b37-4c12-80e0-8c48b6d73719 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.574189 Mar 26 21:01:25.280508 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1593/3393] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:24 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:25.300486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-06274b3f-e132-4d69-b4ff-e41d858ba6d4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5883a550>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:25.417062 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-06274b3f-e132-4d69-b4ff-e41d858ba6d4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.135324 Mar 26 21:01:25.418001 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1594/3394] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:25 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:25.649453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:25.672990 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-073f3d61-e563-44d9-b2b0-9bbb32f6b4a1 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1734 microversion: 2.1 time: 0.789020 Mar 26 21:01:25.680720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1801/3395] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:24 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1734 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:26.299989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:26.300611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:26.314079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:26.317296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:26.320302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:26.323475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:26.431613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d98dbc85-df21-45d5-8514-acae71cd927f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5819b4c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:26.496938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:26.506270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:26.511231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:26.514070 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-79089bef-47dc-412d-9e55-43124de534c9 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.220551 Mar 26 21:01:26.528027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d98dbc85-df21-45d5-8514-acae71cd927f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.100182 Mar 26 21:01:26.528243 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1595/3396] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:26 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:26.528695 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1802/3397] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:26 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:26.702800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:26.709426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:26.728379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:26.732747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:26.733877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:26.734555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:27.396792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:27.412440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb078f2a-f4c5-4876-8057-158abbebb52f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1714 microversion: 2.1 time: 0.717354 Mar 26 21:01:27.416085 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1803/3398] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:26 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1714 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:27.535169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:27.536502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:27.546535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fad6a8ec-0394-4a6f-86d6-8936a5a850d8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581fdee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:27.551142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:27.560068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:27.562422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:27.565394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:27.645327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fad6a8ec-0394-4a6f-86d6-8936a5a850d8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.103740 Mar 26 21:01:27.646142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1804/3399] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:27 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:27.685516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:27.686139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:27.709952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:27.710525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:27.711134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:27.711571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:27.963083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Cannot 'detach_volume' instance 400d840e-75b6-4886-9f10-30b56c2c4886 while it is in vm_state rescued Mar 26 21:01:27.975388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 409 to user: Cannot 'detach_volume' instance 400d840e-75b6-4886-9f10-30b56c2c4886 while it is in vm_state rescued {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:01:27.980955 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8ded9df-9f68-42ed-b538-f95d39f28882 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments/7e8c875b-50fe-4f77-bc0e-a4f6256e714d" status: 409 len: 152 microversion: 2.1 time: 0.296897 Mar 26 21:01:27.984536 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1805/3400] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:01:27 2022] DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments/7e8c875b-50fe-4f77-bc0e-a4f6256e714d => generated 152 bytes in 305 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:01:27.993085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:28.002868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:28.004909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:28.006850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2997084b-212f-4b5b-8403-961b6282713b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.475708 Mar 26 21:01:28.018098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:28.018098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:28.019754 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1596/3401] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:27 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:28.040492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:28.041377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:28.041719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:28.042175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:28.195325 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-925acad5-c4a3-4829-88e8-947546722dd8 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/action" status: 202 len: 0 microversion: 2.1 time: 0.205590 Mar 26 21:01:28.198370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1806/3402] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:01:27 2022] POST /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:01:28.207947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:28.208852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:28.217179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:28.218002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:28.219012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:28.225265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:28.621715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:28.631219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03331b8c-55b6-4e17-be2e-46f03333c22f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1722 microversion: 2.1 time: 0.429125 Mar 26 21:01:28.639374 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1597/3403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:28 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:28.663865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cecf62e6-a776-4954-8d33-905857359752 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b65e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:28.750756 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cecf62e6-a776-4954-8d33-905857359752 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.093628 Mar 26 21:01:28.753004 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1807/3404] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:28 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:29.028885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:29.029514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:29.045027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:29.045499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:29.046384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:29.046842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:29.485748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:29.507248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:29.515689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:29.517619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-759db4a3-49c3-40e8-99d4-d61c9c344848 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1365 microversion: 2.47 time: 0.492675 Mar 26 21:01:29.519503 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1598/3405] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:29 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1365 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:29.659463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:29.660652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:29.672801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:29.673337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:29.685876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:29.686353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:29.765948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd0c8fd5-a1f3-44ef-ba08-fefc1833875e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587d9a60>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:29.828083 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bd0c8fd5-a1f3-44ef-ba08-fefc1833875e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.066422 Mar 26 21:01:29.835301 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1599/3406] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:29 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:30.186038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:30.196416 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37dae941-1034-43ee-b450-ee11e8d2fb0b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1722 microversion: 2.1 time: 0.542109 Mar 26 21:01:30.206847 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1808/3407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:29 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1722 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:30.539881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:30.540451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:30.552604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:30.554282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:30.556134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:30.560617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:30.683685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:30.693298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:30.695686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:30.698045 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-704544d5-d51a-429b-8f99-c88cd0a15d60 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1371 microversion: 2.47 time: 0.163165 Mar 26 21:01:30.710411 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1600/3408] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:30 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:30.844627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd844d42-f985-4fdc-b879-885ebba1cbc3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b6790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:30.922161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd844d42-f985-4fdc-b879-885ebba1cbc3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.084213 Mar 26 21:01:30.923066 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1809/3409] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:30 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:31.224749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:31.225998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:31.245895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:31.252915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:31.253730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:31.257953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:31.714740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:31.716402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:31.732894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:31.739572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:31.742204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:31.742986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:31.818555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:01:32.054837 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88a36ef4-8dcb-4af7-a013-6d51a8f11754 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 204 len: 0 microversion: 2.1 time: 0.345554 Mar 26 21:01:32.058757 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1810/3410] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:01:31 2022] DELETE /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:01:32.071154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:32.074713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:32.088546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:32.089042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:32.092015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:32.093174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:32.209609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:32.225862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:32.233000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:32.240381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf5b41be-ef37-454d-b1bb-d8392dcf38c3 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1371 microversion: 2.47 time: 0.178073 Mar 26 21:01:32.254807 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1811/3411] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:32 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:32.263182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-29548831-3929-4eb8-944d-e3f08cf78bda tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b1940>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:32.351590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-29548831-3929-4eb8-944d-e3f08cf78bda tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.102339 Mar 26 21:01:32.353009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1812/3412] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:32 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:32.365951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:32.366567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:32.387335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:32.388862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:32.390884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:32.391617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:32.491669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:32.504860 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e45727e6-f1d0-4bc8-8250-926de40919a7 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1722 microversion: 2.1 time: 1.284230 Mar 26 21:01:32.506566 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1601/3413] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:31 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1722 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:32.995483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:33.014399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6346d3fd-f691-4817-b8ab-32f22f18f640 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1665 microversion: 2.1 time: 0.652186 Mar 26 21:01:33.015654 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1813/3414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:32 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1665 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:33.264529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:33.265571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:33.284644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.286072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.287317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.288080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.365858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2708bd0a-a2ee-40f4-812c-da7405501f44 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5816ed30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:33.396057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:33.409918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:33.413786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:33.419387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-54d1b907-808d-449f-a063-08f26c19fce4 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1356 microversion: 2.47 time: 0.160216 Mar 26 21:01:33.426056 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2708bd0a-a2ee-40f4-812c-da7405501f44 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.064007 Mar 26 21:01:33.426642 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1814/3416] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:33 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:33.434158 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1602/3416] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:33 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:33.444010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:33.453822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:33.461632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Searching by: {'deleted': False, 'project_id': '436249e4501a43dd95fd98fc53d74b30'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:01:33.474514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.479943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.481327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.482103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.527032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:33.535048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:33.554739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.556233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.557410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:33.561683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:33.814144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:01:34.097386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:34.121942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:34.123160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:34.153259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:34.155841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:34.313335 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd9c66c9-64f7-4f3d-b957-ba2241f022e1 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.873498 Mar 26 21:01:34.324673 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1815/3417] 10.222.0.16 () {60 vars in 1186 bytes} [Sat Mar 26 21:01:33 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:34.329035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:34.338014 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f52b8af3-7966-47c9-b068-d212dc0c2e7f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1728 microversion: 2.1 time: 0.819841 Mar 26 21:01:34.347990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:34.348690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:34.349129 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1603/3418] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:33 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1728 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:34.362870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:34.368870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:34.373104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:34.374011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:34.374927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:34.375352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:34.381589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:34.387618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:34.388664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:34.389269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:35.112387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:01:35.211294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:35.232759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4b3364f5-1a11-4290-8a57-a31f59bf86d2 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1665 microversion: 2.1 time: 0.894760 Mar 26 21:01:35.233588 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1816/3419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:34 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1665 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:35.252017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:35.253950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:35.275185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:35.275667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:35.288587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:35.289712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:35.358493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bd40ecf5-f9d3-4aca-837b-8ab2ad92440b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 204 len: 0 microversion: 2.47 time: 1.004784 Mar 26 21:01:35.361254 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1604/3420] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:01:34 2022] DELETE /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:01:35.374527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f375357-f316-4c03-ab1f-455950e7dcc1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5882dee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:35.437101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f375357-f316-4c03-ab1f-455950e7dcc1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.073266 Mar 26 21:01:35.442863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1605/3421] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:35 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:35.445175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:35.448750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:35.455600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:35.456117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:35.456967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:35.457420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:36.351292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:36.367394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:36.369740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:36.375509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1267d727-b822-46e8-97f5-e4538b14923e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1362 microversion: 2.47 time: 0.930325 Mar 26 21:01:36.376208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1606/3422] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:35 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1362 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:36.395424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:36.396097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:36.430582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:36.431097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:36.431949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:36.432492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:36.445254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3273fab-639b-4c36-981d-0ec018100c67 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.205468 Mar 26 21:01:36.446146 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1817/3423] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:01:35 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-interface => generated 285 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:36.453252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-031f344c-8d3b-4f51-b8f9-824b25a0f4c9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5822e0d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:36.567114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-031f344c-8d3b-4f51-b8f9-824b25a0f4c9 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.117215 Mar 26 21:01:36.568366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1818/3424] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:36 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:36.850685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:36.866313 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19a6967e-ec11-48b0-ae94-09278d73c234 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1597 microversion: 2.1 time: 0.488379 Mar 26 21:01:36.866917 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1607/3425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:36 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1597 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:37.396086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c301889a-9c66-4180-b4e2-c5d220db6e76 req-a9e4f2c5-7009-49df-a3bd-375d999909fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f475fc0-4e21-44c8-9f02-75bf36a19d79", "name": "network-vif-deleted", "tag": "3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:37.396405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:37.396853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:37.414398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:37.416959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:37.421616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:37.428865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:37.434638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c301889a-9c66-4180-b4e2-c5d220db6e76 req-a9e4f2c5-7009-49df-a3bd-375d999909fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:37.453654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c301889a-9c66-4180-b4e2-c5d220db6e76 req-a9e4f2c5-7009-49df-a3bd-375d999909fc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:37.515023 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c301889a-9c66-4180-b4e2-c5d220db6e76 req-a9e4f2c5-7009-49df-a3bd-375d999909fc service nova] Creating event network-vif-deleted:3f4b8c9a-5523-4528-9f82-b2ceaf5d2ca7 for instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 on nch1-master-1 Mar 26 21:01:37.547497 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c301889a-9c66-4180-b4e2-c5d220db6e76 req-a9e4f2c5-7009-49df-a3bd-375d999909fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159061 Mar 26 21:01:37.548143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1819/3426] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:37.594451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c157c39-9da8-49ae-9d5d-5893ccda0351 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5822e280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:37.694040 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c157c39-9da8-49ae-9d5d-5893ccda0351 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.113156 Mar 26 21:01:37.694874 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1820/3427] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:37 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:37.702163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:37.712558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:37.722923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:37.724535 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c27031b-6345-4729-a65a-e018ad63b89b tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1362 microversion: 2.47 time: 0.332776 Mar 26 21:01:37.750825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1608/3428] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:37 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:37.884168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:37.885325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:37.901918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:37.906316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:37.909090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:37.909552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:38.069079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:38.081268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:38.084875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lazy-loading 'fault' on Instance uuid 0f475fc0-4e21-44c8-9f02-75bf36a19d79 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:01:38.307900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4376fd9ace4887af0b56483b90a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b213fd60a44c2481f49b4ed4711a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:38.327351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7aacfd2e-ed43-4a7d-866e-1c757990ad43 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 200 len: 1315 microversion: 2.1 time: 0.447930 Mar 26 21:01:38.343595 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1821/3429] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:37 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:38.708782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa3389ac-3b15-4cd8-bfed-878418c0e1e3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5882d160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:38.758872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:38.759489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:38.785387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:38.786871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:38.789838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:38.791227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:38.813343 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa3389ac-3b15-4cd8-bfed-878418c0e1e3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.109009 Mar 26 21:01:38.824041 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1609/3430] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:38 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:38.885582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:38.889530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:38.892563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lazy-loading 'fault' on Instance uuid 38ea9cc2-b2ff-448b-9f6f-99098523c8d1 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:01:39.170948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:39.179609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:39.200519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:39.205716 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c27f8db-1f0d-4286-b050-7afbbf5cbc24 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 200 len: 1367 microversion: 2.47 time: 0.451047 Mar 26 21:01:39.210707 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1822/3431] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:38 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:39.351115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:39.352316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] [instance: 0f475fc0-4e21-44c8-9f02-75bf36a19d79] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:39.366723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:39.367442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:39.376342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:39.380071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:39.409042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] HTTP exception thrown: Instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 could not be found. Mar 26 21:01:39.410040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Returning 404 to user: Instance 0f475fc0-4e21-44c8-9f02-75bf36a19d79 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:01:39.411198 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bb724fd5-5f9b-444b-9d38-3f64de046792 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79" status: 404 len: 111 microversion: 2.1 time: 0.063961 Mar 26 21:01:39.420884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d0563c2-23a5-4527-8015-609d0e943b51 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] Calling method '.version_select at 0x7f6e5816e5e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:39.425552 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1610/3432] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:39 2022] GET /compute/v2.1/servers/0f475fc0-4e21-44c8-9f02-75bf36a19d79 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:01:39.479777 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d0563c2-23a5-4527-8015-609d0e943b51 tempest-ServersTestFqdnHostnames-2117300767 tempest-ServersTestFqdnHostnames-2117300767-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696706182" status: 202 len: 0 microversion: 2.1 time: 0.062762 Mar 26 21:01:39.484927 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1823/3433] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:01:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696706182 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:01:39.828245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1164fca8-9c35-404c-9ee9-9ac9fa5d90bc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e580c7790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:39.936658 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1164fca8-9c35-404c-9ee9-9ac9fa5d90bc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.110257 Mar 26 21:01:39.946155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1824/3434] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:39 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:40.139888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:40.142303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:40.168359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.193609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.195681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.201053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.252028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:40.253104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: 38ea9cc2-b2ff-448b-9f6f-99098523c8d1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:40.332240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.338584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.339792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.343665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.400000 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] HTTP exception thrown: Instance 38ea9cc2-b2ff-448b-9f6f-99098523c8d1 could not be found. Mar 26 21:01:40.409608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Returning 404 to user: Instance 38ea9cc2-b2ff-448b-9f6f-99098523c8d1 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:01:40.417001 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-febc0e12-2832-40b5-968f-5e8e16deaa9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1" status: 404 len: 111 microversion: 2.47 time: 0.194225 Mar 26 21:01:40.420342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1825/3435] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:40 2022] GET /compute/v2.1/servers/38ea9cc2-b2ff-448b-9f6f-99098523c8d1 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:01:40.437703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:40.438723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:40.448947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.458800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.460236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.472223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.527779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:01:40.832490 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea445b9d-bb9d-49ff-9b1f-8889d8fdef9e tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8" status: 204 len: 0 microversion: 2.47 time: 0.405622 Mar 26 21:01:40.836463 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1826/3436] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:01:40 2022] DELETE /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:01:40.842189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:40.853406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:40.871207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.876242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:40.887761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:40.888794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:41.268776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:41.280419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a608cf90-86e7-4bb9-bd60-c7be76bbb961 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.627416 Mar 26 21:01:41.302099 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1611/3437] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:39 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:41.315744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc1bde75-4efa-43dd-b77e-1ed4e0d9e9ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e588c0f70>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:41.356078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:41.365751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:41.383838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:41.391667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df17e8ba-5571-4137-a532-72c10e7961fd tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8" status: 200 len: 1363 microversion: 2.47 time: 0.548069 Mar 26 21:01:41.394447 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1827/3438] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:40 2022] GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8 => generated 1363 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:41.417559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e48e8708-3dc7-49eb-9dcd-55c3d095591c req-c566fc62-74c6-4d4f-944a-e7e2d2632625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:41.435501 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc1bde75-4efa-43dd-b77e-1ed4e0d9e9ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1412 microversion: 2.1 time: 0.130457 Mar 26 21:01:41.436287 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1612/3439] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:41 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:41.444586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e48e8708-3dc7-49eb-9dcd-55c3d095591c req-c566fc62-74c6-4d4f-944a-e7e2d2632625 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:41.447087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:41.447652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e48e8708-3dc7-49eb-9dcd-55c3d095591c req-c566fc62-74c6-4d4f-944a-e7e2d2632625 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:41.448405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:41.463551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:41.464993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:41.467136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:41.468837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:41.489608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e48e8708-3dc7-49eb-9dcd-55c3d095591c req-c566fc62-74c6-4d4f-944a-e7e2d2632625 service nova] Creating event network-changed:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:01:41.509219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e48e8708-3dc7-49eb-9dcd-55c3d095591c req-c566fc62-74c6-4d4f-944a-e7e2d2632625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112024 Mar 26 21:01:41.510037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1828/3440] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:42.263358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:42.275612 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e43e0e3e-7617-4f26-9413-a64cec6866d0 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.834380 Mar 26 21:01:42.276286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1613/3441] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:41 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:42.294000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:42.295412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:42.303238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:42.304102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:42.305126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:42.305831 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:42.411449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:42.413548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:42.434060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:42.434983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:42.436053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:42.436768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:42.555445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:42.573692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:42.576529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7eac57fcd76942d28f51d0f6ee6eeb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436249e4501a43dd95fd98fc53d74b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:42.577743 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9a7cbc10-081f-4f45-998a-3f3a6788b081 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8" status: 200 len: 1363 microversion: 2.47 time: 0.170870 Mar 26 21:01:42.580071 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1614/3442] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:42 2022] GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:42.585057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e013db26-173a-4442-863a-5a222d945bad tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587d23a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:42.670797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e013db26-173a-4442-863a-5a222d945bad tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1421 microversion: 2.1 time: 0.089648 Mar 26 21:01:42.671733 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1615/3443] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:42 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:42.683908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-21e7862b-8206-4d10-b9ab-1c4b962498e7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5889cee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:42.757043 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-21e7862b-8206-4d10-b9ab-1c4b962498e7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 200 len: 1421 microversion: 2.1 time: 0.076787 Mar 26 21:01:42.764182 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1616/3444] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:42 2022] GET /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:42.769710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f235a5b3-1ac1-41f3-83d7-a630ba44858c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587d2040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:43.290983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:43.313182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58a92927-bc77-4906-9d6b-6d5ca0a93266 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.024339 Mar 26 21:01:43.316124 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1829/3445] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:42 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:43.334242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:43.335187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:43.348837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.349427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.350660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.352512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.780611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f235a5b3-1ac1-41f3-83d7-a630ba44858c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 204 len: 0 microversion: 2.1 time: 1.014963 Mar 26 21:01:43.781602 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1617/3446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:42 2022] DELETE /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:01:43.788846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f7e0e534-655f-48b4-8911-ad8d096aacde req-f8ef9050-60bd-49be-9a39-c535de78c81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:43.804821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7e0e534-655f-48b4-8911-ad8d096aacde req-f8ef9050-60bd-49be-9a39-c535de78c81b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.805756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7e0e534-655f-48b4-8911-ad8d096aacde req-f8ef9050-60bd-49be-9a39-c535de78c81b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.824849 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f7e0e534-655f-48b4-8911-ad8d096aacde req-f8ef9050-60bd-49be-9a39-c535de78c81b service nova] Creating event network-changed:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:01:43.832367 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f7e0e534-655f-48b4-8911-ad8d096aacde req-f8ef9050-60bd-49be-9a39-c535de78c81b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049098 Mar 26 21:01:43.833927 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1618/3447] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:43.854528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:43.856847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] [instance: d0bcdf31-e56c-4e77-9e7f-506812268fd8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:43.866891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.867686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.868860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.869461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.893771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] HTTP exception thrown: Instance d0bcdf31-e56c-4e77-9e7f-506812268fd8 could not be found. Mar 26 21:01:43.895455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] Returning 404 to user: Instance d0bcdf31-e56c-4e77-9e7f-506812268fd8 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:01:43.896962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b7b186f4-5419-4762-b452-275b4780d400 tempest-ServerShowV247Test-1374421449 tempest-ServerShowV247Test-1374421449-project] 10.222.0.16 "GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8" status: 404 len: 111 microversion: 2.47 time: 0.061375 Mar 26 21:01:43.897910 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1619/3448] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:43 2022] GET /compute/v2.1/servers/d0bcdf31-e56c-4e77-9e7f-506812268fd8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:01:43.906000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:43.907020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:43.915369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.915838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.917178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:43.917607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:43.951436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:01:44.061920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61ab3ea5-5371-4da8-b1d3-5ff52f689f7c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 204 len: 0 microversion: 2.1 time: 0.161525 Mar 26 21:01:44.062889 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1620/3449] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:01:43 2022] DELETE /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:01:44.238341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-230109171", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "bed7c102-81ae-4d0f-9222-79cbabeb217f"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:44.336213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] validate_networks() for [('bed7c102-81ae-4d0f-9222-79cbabeb217f', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:01:44.823708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:44.862770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-332d661d-db21-4ee1-a32a-fb8e986c8f3f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.533583 Mar 26 21:01:44.865658 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1830/3450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:43 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:45.056614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-936539954", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:45.119454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] validate_networks() for [('30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:01:46.120137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:01:46.121147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:01:46.121806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:01:46.122386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:01:46.122983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:01:46.134250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:46.134879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:46.136277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:46.137254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:46.161285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:46.167550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for user fdd16c1bdb3d416d8421202397566d1c and project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:46.192219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:01:46.196673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:01:46.294701 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8412b87f-615d-440b-98e2-22cf3290d261 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062832 Mar 26 21:01:46.300615 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1621/3451] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:01:46.310225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4592406e-3ebb-4c48-9a17-91cd9a14730e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:46.311129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4592406e-3ebb-4c48-9a17-91cd9a14730e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:46.520640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4592406e-3ebb-4c48-9a17-91cd9a14730e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:46.528813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4592406e-3ebb-4c48-9a17-91cd9a14730e tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1207 microversion: 2.1 time: 0.222688 Mar 26 21:01:46.542947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1622/3452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:46 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1207 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:47.525382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:01:47.526022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:01:47.526617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:01:47.527135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:01:47.528026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:01:47.551054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:47.552591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:47.574975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:47.576195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:47.577646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:47.578429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:47.584783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:47.586357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:47.586527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:47.587398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:47.643912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:47.656129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:47.679827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:01:47.683246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:01:47.763381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de9d5a0a-b052-40af-b509-058faecb6f80 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710508 Mar 26 21:01:47.765312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1831/3453] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 21:01:47.770787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0e082aa5-0b97-4755-abe4-8cec880c343f req-e63bdc41-7838-41da-8b17-4277417fc48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384155c0-abdb-4448-ab0e-797be0db4df6", "name": "network-vif-unplugged", "status": "completed", "tag": "607e9bc9-d63e-4f18-b20e-8c045ee4124b"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:47.866207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0e082aa5-0b97-4755-abe4-8cec880c343f req-e63bdc41-7838-41da-8b17-4277417fc48d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:47.871420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0e082aa5-0b97-4755-abe4-8cec880c343f req-e63bdc41-7838-41da-8b17-4277417fc48d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:47.880461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:47.896608 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47129494-d0df-429c-af51-cb254e9bd211 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1259 microversion: 2.1 time: 0.348540 Mar 26 21:01:47.921241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1623/3454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:47 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1259 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:47.926921 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0e082aa5-0b97-4755-abe4-8cec880c343f req-e63bdc41-7838-41da-8b17-4277417fc48d service nova] Creating event network-vif-unplugged:607e9bc9-d63e-4f18-b20e-8c045ee4124b for instance 384155c0-abdb-4448-ab0e-797be0db4df6 on nch1-master-1 Mar 26 21:01:47.939282 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0e082aa5-0b97-4755-abe4-8cec880c343f req-e63bdc41-7838-41da-8b17-4277417fc48d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171736 Mar 26 21:01:47.939934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bcfc541-52ce-4d46-825e-25e193a4add2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:47.941034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3bcfc541-52ce-4d46-825e-25e193a4add2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:47.948927 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1832/3455] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:48.206262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3bcfc541-52ce-4d46-825e-25e193a4add2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:48.217677 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bcfc541-52ce-4d46-825e-25e193a4add2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1214 microversion: 2.1 time: 0.291973 Mar 26 21:01:48.221064 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1624/3456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:47 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:48.767477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-285567d8-bfc7-4701-87e0-9b9a1babb331 req-8681bd95-7ea4-4e63-a5d6-6e91d19f033f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384155c0-abdb-4448-ab0e-797be0db4df6", "name": "network-vif-deleted", "tag": "607e9bc9-d63e-4f18-b20e-8c045ee4124b"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:48.803191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-285567d8-bfc7-4701-87e0-9b9a1babb331 req-8681bd95-7ea4-4e63-a5d6-6e91d19f033f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:48.803666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-285567d8-bfc7-4701-87e0-9b9a1babb331 req-8681bd95-7ea4-4e63-a5d6-6e91d19f033f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:48.878858 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-285567d8-bfc7-4701-87e0-9b9a1babb331 req-8681bd95-7ea4-4e63-a5d6-6e91d19f033f service nova] Creating event network-vif-deleted:607e9bc9-d63e-4f18-b20e-8c045ee4124b for instance 384155c0-abdb-4448-ab0e-797be0db4df6 on nch1-master-1 Mar 26 21:01:48.898504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-285567d8-bfc7-4701-87e0-9b9a1babb331 req-8681bd95-7ea4-4e63-a5d6-6e91d19f033f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134733 Mar 26 21:01:48.903965 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1625/3457] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:48.935685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:48.946828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:48.967409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:48.969192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:48.971160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:48.973406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:49.048248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-113679716", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:49.146109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:49.151445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:01:49.152073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:01:49.152837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:01:49.153487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:01:49.154129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:01:49.171182 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52ae3877-ce40-4aff-b3de-664d3f357bf6 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1265 microversion: 2.1 time: 0.253500 Mar 26 21:01:49.173879 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1626/3458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:48 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:49.184492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:49.195515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:49.202375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:49.204186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:49.236357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:49.236988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:49.252322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:49.253887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:49.257321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:49.258327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:49.276271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for project 092a9ada15ab4bd1960204f158625a42. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:49.296517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for user 16965e41493449858ada0e70c052e3e8 and project 092a9ada15ab4bd1960204f158625a42. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:49.342020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:01:49.344493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:01:49.462951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbde7d18-82df-44a4-8bee-df158a6c9255 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.844462 Mar 26 21:01:49.468631 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1833/3459] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:01:49.473827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:49.474462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:49.505793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:49.516464 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ebb2a0f-0bc8-498e-a053-78a0bc66217b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1210 microversion: 2.1 time: 0.283568 Mar 26 21:01:49.535273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1627/3460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:49 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1210 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:49.654455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:49.664957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:49.666496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:49.667671 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9950639-8528-4b7d-84e9-869d0a1774c0 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1277 microversion: 2.54 time: 0.198017 Mar 26 21:01:49.668682 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1834/3461] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:49 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:50.191726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:50.200588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:50.218906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.219151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.226929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.228192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.419730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:50.435700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-697dec42-d386-4331-bc5f-be5f92939713 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1265 microversion: 2.1 time: 0.247878 Mar 26 21:01:50.436512 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1628/3462] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:50 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:50.535402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:50.536713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:50.545755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.552262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.553404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.554009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.691371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:50.694456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:50.708771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.711608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.716284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:50.717439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:50.821735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:50.837483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:50.841607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:50.846046 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d1c26f3-abe7-4031-9d5a-b301ac683aea tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1281 microversion: 2.54 time: 0.159815 Mar 26 21:01:50.846975 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1629/3463] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:50 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:50.865767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Action: 'create', calling method: .version_select at 0x7f6e588cbaf0>, body: {"keypair": {"name": "tempest-keypair-268504012"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:50.866788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:50.880771 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a1ab78c6-a350-4f3d-978c-09934829ad1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1272 microversion: 2.1 time: 0.348256 Mar 26 21:01:50.903542 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1835/3464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:50 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:50.906916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for project 9643f439b26e41cda482b9533143d636. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:50.941634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for user 87a1de01e7de440d86084c1b5b5aede4 and project 9643f439b26e41cda482b9533143d636. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:51.455293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:51.456368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:51.477988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.480526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:51.481399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.481845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:51.559827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for project 9643f439b26e41cda482b9533143d636. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:51.575609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for user 87a1de01e7de440d86084c1b5b5aede4 and project 9643f439b26e41cda482b9533143d636. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:51.618345 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a12b4fea-f1cb-44ab-8e36-2e60a57cd97c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.32 time: 0.757177 Mar 26 21:01:51.618950 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1630/3465] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 21:01:50 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 771 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:01:51.865406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:51.866260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:51.878347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.878874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:51.879908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.880550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:51.914646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:51.926192 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9c79b0c-a6c5-4550-af21-ec50d64505ef tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1265 microversion: 2.1 time: 0.475737 Mar 26 21:01:51.927308 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1836/3466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:51 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:51.939504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:51.941727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:51.959185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.960552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:51.964358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:51.965094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:52.017197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:52.036275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:52.038599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:52.044050 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c54d4e58-a230-4f6a-8ce5-f4f753bb6e06 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1335 microversion: 2.54 time: 0.182781 Mar 26 21:01:52.045595 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1631/3467] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:51 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1335 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:52.572749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:52.580789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-badd4cc7-af1e-42b1-b2a2-19f7e2a9ac7a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1272 microversion: 2.1 time: 0.652230 Mar 26 21:01:52.587197 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1837/3468] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:51 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1272 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:52.943197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:52.944525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:52.955605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:52.960774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:52.962610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:52.963483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:53.063861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:53.065081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:53.076372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:53.077014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:53.080535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:53.081177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:53.272254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:53.284869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:53.286764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:53.288158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b191e2a5-7bbe-4e84-bef5-5ac5609615f2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1335 microversion: 2.54 time: 0.228245 Mar 26 21:01:53.293004 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1838/3469] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:53 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:53.603064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:53.604131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:53.618017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:53.618733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:53.619763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:53.620527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:53.645622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:53.659193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd83b352-23e6-45b5-bb97-2f758138b7f2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.719710 Mar 26 21:01:53.660097 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1632/3470] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:52 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:53.804360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:53.815601 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6427e0f7-f9a5-432e-a1b1-d41d35b8195d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1272 microversion: 2.1 time: 0.216232 Mar 26 21:01:53.816694 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1839/3471] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:53 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:01:54.320305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:54.321738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:54.336488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.338320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.342141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.344376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.460993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:54.475427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:54.488068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:54.489559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3f19bb6-2039-4b61-a1f2-88200bf09376 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1356 microversion: 2.54 time: 0.182175 Mar 26 21:01:54.490975 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1633/3472] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:54 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:54.507656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Action: 'create', calling method: .version_select at 0x7f6e5812f3a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1779592200"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:54.525316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for project 092a9ada15ab4bd1960204f158625a42. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:54.542970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for user 16965e41493449858ada0e70c052e3e8 and project 092a9ada15ab4bd1960204f158625a42. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:54.677153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:54.677771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:54.695710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.696078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.697122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.697681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.722174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for project 092a9ada15ab4bd1960204f158625a42. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:01:54.729429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Getting quotas for user 16965e41493449858ada0e70c052e3e8 and project 092a9ada15ab4bd1960204f158625a42. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:01:54.755205 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3d6d9c9-5a27-4801-b66d-98e7bdc5e1dd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.251247 Mar 26 21:01:54.756478 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1840/3473] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 21:01:54 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 253 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:01:54.766096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1779592200", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:54.768140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:54.775308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.775956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.776940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.777606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:54.884106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:01:54.885233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:01:54.885878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:01:54.886670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:01:54.887243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:01:54.990789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:54.998498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:54.999771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:55.000834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:55.001485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:55.061230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03c4a14a-eb2c-4251-aa2a-d7d13627acb7 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "POST /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef/action" status: 202 len: 1139 microversion: 2.54 time: 0.299124 Mar 26 21:01:55.062279 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1841/3474] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Mar 26 21:01:54 2022] POST /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef/action => generated 1139 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 26 21:01:55.068070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:55.069009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:55.077637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:55.079689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:55.080863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:55.081511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:55.861740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:55.895652 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3e23c18-6b39-4de2-aa2b-c7fe4b17c651 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 1.223003 Mar 26 21:01:55.899362 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1634/3475] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:54 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:55.906298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:55.907983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:55.921601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:55.922328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:55.923958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:55.924397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:56.032662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:56.044173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:56.047356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:56.052481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-417ddf86-e783-4a52-a407-1499d727eb37 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.151005 Mar 26 21:01:56.053580 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1635/3476] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:55 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:56.579766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:56.588379 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-360c7dac-ab34-48eb-b7ba-13cd9e01aa3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 1.524826 Mar 26 21:01:56.596924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1842/3477] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:55 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:56.929529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:56.934285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:56.951646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:56.951646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:56.957788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:56.958382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:57.030220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f81ed24a-004c-4fb8-b683-90e0c43a8af7 req-d9460a07-9c7f-433a-a3d1-d403843a3f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9427df83-e863-41a3-9ba3-1fe2de2f72ce", "tag": "08f22eaa-d9e9-4268-adec-e550bc108da0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:57.042605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f81ed24a-004c-4fb8-b683-90e0c43a8af7 req-d9460a07-9c7f-433a-a3d1-d403843a3f72 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:57.048873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f81ed24a-004c-4fb8-b683-90e0c43a8af7 req-d9460a07-9c7f-433a-a3d1-d403843a3f72 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:57.073039 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f81ed24a-004c-4fb8-b683-90e0c43a8af7 req-d9460a07-9c7f-433a-a3d1-d403843a3f72 service nova] Creating event network-changed:08f22eaa-d9e9-4268-adec-e550bc108da0 for instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce on nch1-master-1 Mar 26 21:01:57.083018 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f81ed24a-004c-4fb8-b683-90e0c43a8af7 req-d9460a07-9c7f-433a-a3d1-d403843a3f72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056532 Mar 26 21:01:57.086090 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1843/3478] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:01:57.091398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:57.098298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:57.114556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:57.116043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:57.117044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:57.117497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:57.280146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:57.288573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:57.302058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:57.303214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c45e1d26-16b0-4acc-b52e-2b27bf3ae9b3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.215932 Mar 26 21:01:57.304189 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1844/3479] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:57 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:01:57.537486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:57.558832 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-72532383-5a4a-4d66-b3b6-9a861aaf343a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.643686 Mar 26 21:01:57.559672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1636/3480] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:56 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:57.618400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:57.619060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:57.640208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:57.641849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:57.643770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:57.644419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:58.322966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:58.323769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:58.344004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:58.345610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:58.348014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:58.348650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:58.584441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:58.595804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:58.599254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6bb09c8-fb4c-4457-8a44-547b72b85ad8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.988789 Mar 26 21:01:58.607621 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1845/3481] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:57 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:58.613698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:58.614313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:58.627552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:58.632653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:58.636581 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5d0ffe6f-9c0b-4c72-9863-fe62a9f9c4b9 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.317672 Mar 26 21:01:58.637639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:58.639088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:58.647557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1637/3482] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:58 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:58.651891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:58.652658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.278536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a8303554-f9e2-4d9b-a4a1-adf92bf9cd2a req-44fdc0bb-0fa0-4d65-a4b8-4ab7f71a43d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d592c622-2697-4d42-9596-2206cecec6fc", "tag": "470cb57e-9e38-439d-8123-521c30a5d964"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:01:59.300751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a8303554-f9e2-4d9b-a4a1-adf92bf9cd2a req-44fdc0bb-0fa0-4d65-a4b8-4ab7f71a43d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:59.301342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a8303554-f9e2-4d9b-a4a1-adf92bf9cd2a req-44fdc0bb-0fa0-4d65-a4b8-4ab7f71a43d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.322128 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a8303554-f9e2-4d9b-a4a1-adf92bf9cd2a req-44fdc0bb-0fa0-4d65-a4b8-4ab7f71a43d9 service nova] Creating event network-changed:470cb57e-9e38-439d-8123-521c30a5d964 for instance d592c622-2697-4d42-9596-2206cecec6fc on nch2-master-1 Mar 26 21:01:59.330827 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a8303554-f9e2-4d9b-a4a1-adf92bf9cd2a req-44fdc0bb-0fa0-4d65-a4b8-4ab7f71a43d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058497 Mar 26 21:01:59.333040 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1638/3483] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:01:59.533862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:59.548717 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-708ef4ce-b6ed-4128-9716-281df129630a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.939840 Mar 26 21:01:59.549322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1846/3484] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:58 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:01:59.621361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:59.621361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:59.634923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:59.635395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.638829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:59.639338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.659669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:01:59.661060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:01:59.669346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:59.676068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.685445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:01:59.686108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:01:59.872393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:59.882304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:59.884362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:01:59.885978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0aa0e548-092d-4320-9315-51e1d979f440 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.230723 Mar 26 21:01:59.920478 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1847/3485] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:01:59 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:01:59.925948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-705737993", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fb669b80-3494-4e3d-8fe7-1563ab9c14ff"}, {"port": "44253e4b-0e65-47a7-9d9a-61ce95e7f45c", "tag": "port-1"}, {"port": "b5ab341d-bc21-496a-8125-8e90f4b08572", "tag": "port-2"}, {"uuid": "27a130c6-ee72-48d5-98e0-95c25e1183f2", "tag": "net-1"}, {"uuid": "27a130c6-ee72-48d5-98e0-95c25e1183f2"}, {"uuid": "3520df3b-6ed1-4672-b47f-8044261e5766", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3520df3b-6ed1-4672-b47f-8044261e5766", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d40ca192-1678-4361-83fa-186b54864c59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "65bed174-5bd9-4361-8a87-20e4a95b8976", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--766139470"}], "key_name": "tempest-keypair-268504012", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:00.111371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] validate_networks() for [('fb669b80-3494-4e3d-8fe7-1563ab9c14ff', None, None, None, None, None), (None, None, '44253e4b-0e65-47a7-9d9a-61ce95e7f45c', None, None, None), (None, None, 'b5ab341d-bc21-496a-8125-8e90f4b08572', None, None, None), ('27a130c6-ee72-48d5-98e0-95c25e1183f2', None, None, None, None, None), ('27a130c6-ee72-48d5-98e0-95c25e1183f2', None, None, None, None, None), ('3520df3b-6ed1-4672-b47f-8044261e5766', '10.2.2.100', None, None, None, None), ('3520df3b-6ed1-4672-b47f-8044261e5766', '10.2.2.200', None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:02:00.566438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:00.589199 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d73eeea9-cf1c-4419-a07a-1a710a755de9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.971156 Mar 26 21:02:00.593378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1639/3486] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:01:59 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:00.613426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:00.614072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:00.628374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:00.628754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:00.629548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:00.629989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:01.129150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:01.139702 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dda197fb-ee37-4d57-87e7-c6112dbb250c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.543569 Mar 26 21:02:01.140318 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1640/3487] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:00 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:01.152854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:01.154403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:01.168852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:01.170438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:01.171666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:01.172397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:01.762400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:01.773963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:01.780485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:01.781718 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-95887ab7-3b9d-4a92-b118-85a24fcfaf47 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.640453 Mar 26 21:02:01.783425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1641/3488] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:01 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:01.799656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:01.800340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:01.815482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:01.819255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:01.820159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:01.820626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:02.251635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:02.260126 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e826b757-1dc5-4671-bc4d-7f5fe36a32e3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.474893 Mar 26 21:02:02.272706 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1642/3489] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:01 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:02.278116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:02.278931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:02.285516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:02.286237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:02.287212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:02.287824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:02.773942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:02.784958 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0da154ce-11c3-49f9-9dd1-7442fba95eff tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.507973 Mar 26 21:02:02.788724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1643/3490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:02 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:02.804999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:02.805845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:02.816932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:02.818048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:02.821667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:02.822823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:03.077065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:03.103841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:03.109755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:03.114395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf9c0b74-e213-49f6-bc06-744a320fdfdd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.313112 Mar 26 21:02:03.117120 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1644/3491] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:02 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:03.279310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:03.280753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:03.294343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:03.295709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:03.299039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:03.299757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:03.760992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:03.770880 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a772796-afc7-428e-bd24-137232816d8e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.495925 Mar 26 21:02:03.775113 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1645/3492] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:03 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:03.806337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:03.807325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:03.822324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:03.825082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:03.828881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:03.831193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.178316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:04.188498 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9aa587ca-4bac-4907-a98c-ce3d1d214e2f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.385859 Mar 26 21:02:04.199946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1646/3493] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:03 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:04.206350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:04.207203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:04.214545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.215330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.216964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.217906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.271650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:02:04.272162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:02:04.272610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:02:04.273163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:02:04.273587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:02:04.284569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.284947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.285825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.286278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.305574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for project 9643f439b26e41cda482b9533143d636. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:02:04.311156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Getting quotas for user 87a1de01e7de440d86084c1b5b5aede4 and project 9643f439b26e41cda482b9533143d636. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:02:04.331885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'services' on Instance uuid 400d840e-75b6-4886-9f10-30b56c2c4886 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:02:04.484905 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3e9763a-c21d-4b33-8d59-6525e34e2ff5 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments/7e8c875b-50fe-4f77-bc0e-a4f6256e714d" status: 202 len: 0 microversion: 2.1 time: 0.280174 Mar 26 21:02:04.503657 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1647/3494] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:02:04 2022] DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments/7e8c875b-50fe-4f77-bc0e-a4f6256e714d => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:02:04.512990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:04.513739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:04.553138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.560196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.561761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.562433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.609362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:02:04.612142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d40ca192-1678-4361-83fa-186b54864c59',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f8d2bbe6-8c74-47b3-974c-b9fe9778f7f6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65bed174-5bd9-4361-8a87-20e4a95b8976',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:02:04.786065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:04.811806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:04.817396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:04.822467 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2986f243-7f8c-4eb9-9e52-23ab252b0474 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.311826 Mar 26 21:02:04.836525 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1648/3495] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:04 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:04.852640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:04.856054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:04.867829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.869369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.870406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.871046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.913101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fceb30f0-c951-4825-a0e8-3b2014c72cdf tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074982 Mar 26 21:02:04.913730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1649/3496] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:02:04 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:04.919749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:04.920472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:04.934183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.935318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:04.942765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:04.943587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.139469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45c0498e-042e-49d6-b1c1-7075755de9ef tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.217654 Mar 26 21:02:05.146376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1848/3497] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Mar 26 21:01:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 5225 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:02:05.151751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-99217535-b27f-43ae-8b62-bfd91347980d req-7827aea9-a102-4be5-a47a-2654dd489f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9427df83-e863-41a3-9ba3-1fe2de2f72ce", "name": "network-vif-plugged", "status": "completed", "tag": "08f22eaa-d9e9-4268-adec-e550bc108da0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:05.161718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-99217535-b27f-43ae-8b62-bfd91347980d req-7827aea9-a102-4be5-a47a-2654dd489f6a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.162176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-99217535-b27f-43ae-8b62-bfd91347980d req-7827aea9-a102-4be5-a47a-2654dd489f6a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.178275 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-99217535-b27f-43ae-8b62-bfd91347980d req-7827aea9-a102-4be5-a47a-2654dd489f6a service nova] Creating event network-vif-plugged:08f22eaa-d9e9-4268-adec-e550bc108da0 for instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce on nch1-master-1 Mar 26 21:02:05.183946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-99217535-b27f-43ae-8b62-bfd91347980d req-7827aea9-a102-4be5-a47a-2654dd489f6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036243 Mar 26 21:02:05.189657 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1849/3498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:05.197117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:05.198052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:05.392436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:05.400985 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a219249-2b84-4a89-8657-8fb4084b787f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.486051 Mar 26 21:02:05.415228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:05.416294 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1650/3499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:04 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:05.424915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:05.425544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:05.426827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:05.437319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:05.442564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1482cbfe-f81c-436d-8a15-0550b0a32226 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1284 microversion: 2.32 time: 0.251680 Mar 26 21:02:05.443158 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1850/3500] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:05 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:05.445803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.446531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.447341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.447784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.851276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:05.852570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:05.855411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:05.868234 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f69e19e6-9380-4bea-bd97-85faf79799d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1307 microversion: 2.1 time: 0.450480 Mar 26 21:02:05.884366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1651/3501] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:05 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:05.911176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.922058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.925878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:05.927078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:05.928624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.929133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.943331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.947493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:05.952739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:05.953230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.117019 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f262876a-da77-4d06-bb3d-784db10c4bf2 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196402 Mar 26 21:02:06.118414 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1652/3502] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:02:05 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886/os-volume_attachments => generated 25 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 26 21:02:06.215688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.233786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.253754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.255622 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9dacba29-6df9-4a0f-a9b7-717ccf7db0e2 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.415039 Mar 26 21:02:06.259874 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1851/3503] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:05 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:02:06.289713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:06.290889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:06.302534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.303000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.303796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.304265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.399073 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Cannot 'reboot' instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 while it is in vm_state rescued Mar 26 21:02:06.400062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 409 to user: Cannot 'reboot' instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 while it is in vm_state rescued {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:06.401973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a5b3058c-a467-46e9-94b0-a67f378b8a80 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action" status: 409 len: 145 microversion: 2.1 time: 0.116620 Mar 26 21:02:06.404890 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1653/3504] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:06 2022] POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:02:06.416884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:06.423677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:06.424699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:06.428955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:06.442374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.446062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.447464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.449470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.454593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.470526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.473113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.484475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.575449 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Cannot 'rebuild' instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 while it is in vm_state rescued Mar 26 21:02:06.576557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 409 to user: Cannot 'rebuild' instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 while it is in vm_state rescued {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:06.577808 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3518a48-5c84-451a-84eb-8eb6c396359c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action" status: 409 len: 146 microversion: 2.1 time: 0.165720 Mar 26 21:02:06.579564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1852/3505] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:06 2022] POST /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5/action => generated 146 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:02:06.585606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:06.590807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:06.631319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.634089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.637667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.638348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.904178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.923303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.924989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:06.929420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fad66d0b-6a3f-4f6c-8289-16495d334e75 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1526 microversion: 2.32 time: 0.348315 Mar 26 21:02:06.930001 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1853/3506] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:06 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:06.936756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:06.937509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:06.966249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.967070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:06.968449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:06.969326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.010093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:02:07.132033 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4882b140-77e5-4451-af8b-07558e37814e tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 204 len: 0 microversion: 2.1 time: 0.199868 Mar 26 21:02:07.132989 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1854/3507] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:02:06 2022] DELETE /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:02:07.139479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:07.140546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:07.149326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.150173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.151332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.152795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.326794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:07.345413 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96e17a15-f540-4e9e-9a01-667cf9451c89 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.927025 Mar 26 21:02:07.347096 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1654/3508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:06 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:07.355727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:07.356510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:07.364324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.365049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.366075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.366758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.638629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:07.646272 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3bc17fed-e8cb-4f25-b1ab-6406d284be2d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1486 microversion: 2.1 time: 0.511785 Mar 26 21:02:07.646860 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1855/3509] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:07 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1486 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:07.661043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-54dbcc91-f7e1-4aab-b650-0bf23143d653 req-d056e78f-7a55-47e8-a1a0-aa2557562f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d592c622-2697-4d42-9596-2206cecec6fc", "name": "network-vif-plugged", "status": "completed", "tag": "470cb57e-9e38-439d-8123-521c30a5d964"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:07.680014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-54dbcc91-f7e1-4aab-b650-0bf23143d653 req-d056e78f-7a55-47e8-a1a0-aa2557562f86 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.680467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-54dbcc91-f7e1-4aab-b650-0bf23143d653 req-d056e78f-7a55-47e8-a1a0-aa2557562f86 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.692522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:07.704550 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-54dbcc91-f7e1-4aab-b650-0bf23143d653 req-d056e78f-7a55-47e8-a1a0-aa2557562f86 service nova] Creating event network-vif-plugged:470cb57e-9e38-439d-8123-521c30a5d964 for instance d592c622-2697-4d42-9596-2206cecec6fc on nch2-master-1 Mar 26 21:02:07.707035 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9c4dea1-b5c7-41d0-9733-f366924bfe1c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1688 microversion: 2.1 time: 0.358471 Mar 26 21:02:07.714736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-54dbcc91-f7e1-4aab-b650-0bf23143d653 req-d056e78f-7a55-47e8-a1a0-aa2557562f86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057177 Mar 26 21:02:07.721093 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1856/3510] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:07.727675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:07.728974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:07.735400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1655/3511] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:07 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1688 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:07.750211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:07.755783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.756374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.757102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:07.757240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.758854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.774339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.776963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.779328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.781596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.837875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lazy-loading 'flavor' on Instance uuid 9427df83-e863-41a3-9ba3-1fe2de2f72ce {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:02:07.941580 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-170014fc-dd34-412c-8b0e-c182d4a0f5ac tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce/action" status: 202 len: 0 microversion: 2.1 time: 0.194486 Mar 26 21:02:07.941805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1656/3512] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:07 2022] POST /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:02:07.953420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:07.954408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:07.967445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.971584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.976472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:07.978933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:07.981698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:07.996077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.000599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.006064 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fad5b935-2a2b-4c93-be46-b72dda54e332 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.280655 Mar 26 21:02:08.007567 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1857/3513] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:07 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:08.018809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:08.020107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:08.036602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.038646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.040290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.042277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.195468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.212519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.214341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.216490 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-211f3cb4-fb9a-4300-88a4-dbd61d7898ea tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1592 microversion: 2.32 time: 0.268655 Mar 26 21:02:08.217671 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1657/3514] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:07 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1592 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:08.363201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:08.364124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:08.379083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.379647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.380559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.381747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.620522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.637181 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06ee1677-033e-4257-bec4-dc56ea221023 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1494 microversion: 2.1 time: 0.627919 Mar 26 21:02:08.648264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1858/3515] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:08 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1494 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:08.752540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:08.753415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:08.765954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.766803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.767811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:08.768488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:08.928305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:08.940240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa89a166-2a6e-47aa-b51b-0a6717976645 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1314 microversion: 2.1 time: 0.581186 Mar 26 21:02:08.941557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1658/3516] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:08 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:09.027245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:09.029315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:09.045040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.046046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.048953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.050428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.279289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.307444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.311653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.319409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4683de5-33d5-4c7c-a323-3c828ee71189 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.298562 Mar 26 21:02:09.333894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1659/3517] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:09 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:09.338794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:09.339488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:09.359870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.360398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.361207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.361663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.536553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.548526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.568743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.572291 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a34bed6b-c6d4-4a94-8e02-436e6c5035d9 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1592 microversion: 2.32 time: 0.248045 Mar 26 21:02:09.574557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1660/3518] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:09 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1592 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:09.628724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:09.641075 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e826704d-47bf-44ef-9dcf-4fa3b072d56b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1688 microversion: 2.1 time: 0.892212 Mar 26 21:02:09.642701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1859/3519] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:08 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1688 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:09.656850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:09.657796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:09.665218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.665809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.667042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.667709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.958083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:09.958861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:09.971974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.972604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:09.973475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:09.974027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:10.024322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:10.041456 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0cd6fe2c-0a36-4558-acbf-7b80a6d53116 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 200 len: 1477 microversion: 2.1 time: 0.388581 Mar 26 21:02:10.043809 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1661/3520] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:09 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:10.059016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-554907581"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:10.060164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:10.079782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:10.080281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:10.081085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:10.083542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:10.671682 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a8a257b-5c85-4e80-a224-4bda6b70c632 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce/action" status: 202 len: 0 microversion: 2.1 time: 0.617194 Mar 26 21:02:10.673979 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1662/3521] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:10 2022] POST /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:02:10.682736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:10.687479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:10.700356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:10.707632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:10.708712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:10.709316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:10.968952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:10.982309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:10.987333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:10.988853 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-817cf9fa-4c12-484a-9c25-ed941ec28d8d tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.313437 Mar 26 21:02:10.993631 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1663/3522] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:10 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:10.998700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:11.005076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:11.017738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.021023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:11.022026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.022631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:11.291116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:11.294228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:11.304712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:11.306598 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b820509-ca57-456d-a323-5a87d30447e4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1501 microversion: 2.1 time: 1.352385 Mar 26 21:02:11.309017 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1860/3523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:09 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1501 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:11.311834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:11.317380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8632c9da-6d64-4528-a0ce-536e34a1e804 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1592 microversion: 2.32 time: 0.322387 Mar 26 21:02:11.318155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1664/3524] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:10 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1592 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:11.332588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:11.333216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:11.335508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38348925-bc1a-4ec8-9b3d-e2ea3bf5dc3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5890d430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:11.364123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.364623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:11.365464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.365914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:11.401661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38348925-bc1a-4ec8-9b3d-e2ea3bf5dc3f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.060570 Mar 26 21:02:11.402825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1665/3525] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:11 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:11.413515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:11.414614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:11.439506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.440755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:11.442075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:11.442785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:12.484168 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.security_group_api [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Removing security group ef5c4565-3821-4dbc-b616-3d9f9b9c41a4 from port 470cb57e-9e38-439d-8123-521c30a5d964 Mar 26 21:02:12.763314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:12.782812 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e8452e0-0384-4a8d-971a-ee811fcad7e4 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1688 microversion: 2.1 time: 1.472704 Mar 26 21:02:12.783941 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1861/3526] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:11 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1688 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:12.796641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:12.798071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:12.808214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:12.811882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:12.814730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:12.815991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:12.962066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:12.977607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:12.979772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:12.983187 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f4edeb9-60bd-4432-91e5-ab8386a2b4aa tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.197348 Mar 26 21:02:13.000009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1862/3527] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:12 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:13.010036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:13.011055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:13.026224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.027636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.030215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.030971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.744560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9ee52fd-4004-4d66-ba99-b9a6a43d7cd3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc/action" status: 202 len: 0 microversion: 2.1 time: 2.340154 Mar 26 21:02:13.746157 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1666/3528] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:11 2022] POST /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc/action => generated 0 bytes in 2342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:02:13.752501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-49010e19-d28e-43fc-af6a-1e4555731477 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e593b85e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:13.791271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:13.807672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:13.817984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:13.819567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f83e1151-0fff-49bc-83fb-5b7fafaf2359 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1659 microversion: 2.32 time: 0.816159 Mar 26 21:02:13.831722 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1863/3529] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:13 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1659 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:13.836776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:13.848946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:13.873317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-49010e19-d28e-43fc-af6a-1e4555731477 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.125762 Mar 26 21:02:13.877564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.878745 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1667/3530] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:13 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:13.887779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.889995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5a1cdbae-f512-4871-9723-8ae74515cca6 req-28cfe455-243a-4872-ae74-f5deb11c8e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d592c622-2697-4d42-9596-2206cecec6fc", "tag": "470cb57e-9e38-439d-8123-521c30a5d964"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:13.891610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.898998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.916700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5a1cdbae-f512-4871-9723-8ae74515cca6 req-28cfe455-243a-4872-ae74-f5deb11c8e84 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.923614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5a1cdbae-f512-4871-9723-8ae74515cca6 req-28cfe455-243a-4872-ae74-f5deb11c8e84 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.947958 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5a1cdbae-f512-4871-9723-8ae74515cca6 req-28cfe455-243a-4872-ae74-f5deb11c8e84 service nova] Creating event network-changed:470cb57e-9e38-439d-8123-521c30a5d964 for instance d592c622-2697-4d42-9596-2206cecec6fc on nch2-master-1 Mar 26 21:02:13.963762 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5a1cdbae-f512-4871-9723-8ae74515cca6 req-28cfe455-243a-4872-ae74-f5deb11c8e84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081821 Mar 26 21:02:13.965051 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1668/3531] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:13.973113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:13.974089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:13.988347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.989375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:13.991190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:13.992014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:14.165489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:14.173191 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a573a27c-5f78-474c-a4a5-e0ed820b6e74 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1621 microversion: 2.1 time: 0.206774 Mar 26 21:02:14.173779 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1669/3532] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:13 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1621 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:14.196911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:14.199590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:14.249099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:14.249680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:14.254339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:14.258165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:14.381465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:14.392933 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9f29583-54ab-4e49-ba89-ccc5b67ab39c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1459 microversion: 2.1 time: 0.559887 Mar 26 21:02:14.399448 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1864/3533] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:13 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1459 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:14.417282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:14.418019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:14.427962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:14.428415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:14.439772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:14.440418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:14.949847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:14.959471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:14.961275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:14.962708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7baef66c-10e4-44c0-9fe8-e9a67204b1f3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.788010 Mar 26 21:02:14.982583 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1670/3534] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:14 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:14.992105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:14.993426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:15.000863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.003031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.005630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.006435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.437548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:15.446345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76aec756-cabc-49a7-8fef-5fd187637cf7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.033087 Mar 26 21:02:15.451370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1865/3535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:14 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:15.467079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de56dbb7-1db7-4f9f-89d2-4d86158e10b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581da4c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:15.539274 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de56dbb7-1db7-4f9f-89d2-4d86158e10b4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.086464 Mar 26 21:02:15.539858 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1866/3536] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:15 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:15.544672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:15.553002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:15.569968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.570702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.571950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.572556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.773647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:15.783728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:15.792299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:15.793773 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b136c491-6d0a-4d6f-b3fe-cf9ba6fca331 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1647 microversion: 2.32 time: 0.809739 Mar 26 21:02:15.795733 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1671/3537] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:14 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1647 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:15.807354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:15.808777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:15.826294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.827321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.829822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:15.830687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:15.862871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:15.877625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d2d1e03-5277-4f34-a953-44c69606c00b tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 200 len: 1621 microversion: 2.1 time: 0.333254 Mar 26 21:02:15.888743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1867/3538] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:15 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 1621 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:15.982170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:15.982795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:15.997482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:16.000129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:16.001617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:16.005481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:16.219853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:16.228506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:16.250024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:16.260698 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c610b31e-9aef-4ff7-96e2-bc665014d9cd tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.282370 Mar 26 21:02:16.263041 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1868/3539] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:15 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:02:16.276140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1dc973b2-5d5e-48b2-8b16-709d5062895b req-8d38dc53-1c4a-4212-a276-f3e08f372275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400d840e-75b6-4886-9f10-30b56c2c4886", "name": "network-vif-deleted", "tag": "42f9adcc-72b3-44f2-856b-f9a65a2f4091"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:16.313535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1dc973b2-5d5e-48b2-8b16-709d5062895b req-8d38dc53-1c4a-4212-a276-f3e08f372275 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:16.314417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1dc973b2-5d5e-48b2-8b16-709d5062895b req-8d38dc53-1c4a-4212-a276-f3e08f372275 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:16.346566 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1dc973b2-5d5e-48b2-8b16-709d5062895b req-8d38dc53-1c4a-4212-a276-f3e08f372275 service nova] Creating event network-vif-deleted:42f9adcc-72b3-44f2-856b-f9a65a2f4091 for instance 400d840e-75b6-4886-9f10-30b56c2c4886 on nch2-master-1 Mar 26 21:02:16.373361 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1dc973b2-5d5e-48b2-8b16-709d5062895b req-8d38dc53-1c4a-4212-a276-f3e08f372275 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108737 Mar 26 21:02:16.374512 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1869/3540] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:16.553497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70851423-385e-4551-8b33-ccaa651ac503 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5803d670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:16.644579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70851423-385e-4551-8b33-ccaa651ac503 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.094771 Mar 26 21:02:16.645246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1870/3541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:16 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:16.828159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:16.829335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:16.841202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:16.841418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:16.861706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:16.861706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.035421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:17.047053 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9e88c3ec-b5dd-47f1-ae11-dca60d02dd9e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.249961 Mar 26 21:02:17.047692 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1672/3542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:15 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:17.057111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:17.057738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 400d840e-75b6-4886-9f10-30b56c2c4886] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:17.080415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.080885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.081687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.082136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.120120 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Instance 400d840e-75b6-4886-9f10-30b56c2c4886 could not be found. Mar 26 21:02:17.120920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 404 to user: Instance 400d840e-75b6-4886-9f10-30b56c2c4886 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:17.121808 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-518d3f65-93e3-4362-b9cf-40335f5c2ee6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886" status: 404 len: 111 microversion: 2.1 time: 0.073137 Mar 26 21:02:17.122715 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1673/3543] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:17 2022] GET /compute/v2.1/servers/400d840e-75b6-4886-9f10-30b56c2c4886 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:02:17.129313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:17.129944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:17.149692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.150159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.150964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.151417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.604787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:17.613777 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de3ef96f-c1fb-44c5-bbcb-3e59c22bc227 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.489905 Mar 26 21:02:17.617549 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1674/3544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:17 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:17.631001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b0f9c5ee-5b03-454f-90ba-6f531ff38d28 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '.version_select at 0x7f6e5ec9bdc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:17.679439 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b0f9c5ee-5b03-454f-90ba-6f531ff38d28 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70019513" status: 202 len: 0 microversion: 2.1 time: 0.058773 Mar 26 21:02:17.680078 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1675/3545] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 21:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70019513 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:02:17.684849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:17.685484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:17.717659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.718131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.719470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:17.719996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:17.979658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:17.994797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:18.002267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:18.005062 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d58a897-a714-4fb6-80e2-73c387f23511 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.323118 Mar 26 21:02:18.020000 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1676/3546] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:17 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:18.036237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:18.039038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:18.056532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:18.059028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:18.066328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:18.067030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:19.195493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.211275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.216968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.218628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9ff152b-71b9-4819-aea0-38adab446673 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1693 microversion: 2.32 time: 2.401576 Mar 26 21:02:19.224236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1871/3547] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:16 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1693 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:02:19.232188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec0b536c-dcf3-4534-a86c-319dd850463b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bfdea60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:19.308022 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec0b536c-dcf3-4534-a86c-319dd850463b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.081731 Mar 26 21:02:19.308911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1872/3548] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:19 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:19.316978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:19.322108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:19.335764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:19.338161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:19.339166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:19.341974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:19.351841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.393000 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9120c36b-66a3-41f4-9fbd-1c0f7703d3d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.369950 Mar 26 21:02:19.407689 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1677/3549] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:18 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:19.697061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1273828737", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:19.860888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.881847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.883648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:19.900030 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-821ffc76-86a1-445a-a05c-634e4ccdf581 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.589797 Mar 26 21:02:19.902901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1873/3550] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:19 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:19.918372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] validate_networks() for [('30b2ec68-cb92-4b6d-ba96-fa6f177b1cd6', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:02:20.239201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:20.241018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:20.254710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:20.255174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:20.256033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:20.256486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:20.986290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.013551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.023789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.029186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-814a3dfe-1f7d-4bce-9e58-fa3b95d86944 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1739 microversion: 2.32 time: 0.794376 Mar 26 21:02:21.032825 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1874/3551] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:20 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1739 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:02:21.041489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3895ae61-039d-4f6f-b5f3-39c19e4fa8a0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5803dee0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:21.131437 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3895ae61-039d-4f6f-b5f3-39c19e4fa8a0 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.097213 Mar 26 21:02:21.132832 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1875/3552] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:21 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:21.139019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:21.140016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:21.158393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:21.159154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:21.160164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:21.160863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:21.434416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.452628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.460477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:21.468180 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c604f63-d298-4502-8441-abc7ac720e0b tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.330594 Mar 26 21:02:21.470821 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1876/3553] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:21 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:21.481680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-dca09265-ea92-4901-871a-aeaaa5aa7c07 req-4ab602d3-57b8-48fe-9c44-4a7579c35344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9427df83-e863-41a3-9ba3-1fe2de2f72ce", "name": "network-vif-plugged", "status": "completed", "tag": "08f22eaa-d9e9-4268-adec-e550bc108da0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:21.495030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-dca09265-ea92-4901-871a-aeaaa5aa7c07 req-4ab602d3-57b8-48fe-9c44-4a7579c35344 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:21.496899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-dca09265-ea92-4901-871a-aeaaa5aa7c07 req-4ab602d3-57b8-48fe-9c44-4a7579c35344 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:21.515606 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-dca09265-ea92-4901-871a-aeaaa5aa7c07 req-4ab602d3-57b8-48fe-9c44-4a7579c35344 service nova] Creating event network-vif-plugged:08f22eaa-d9e9-4268-adec-e550bc108da0 for instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce on nch1-master-1 Mar 26 21:02:21.528017 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-dca09265-ea92-4901-871a-aeaaa5aa7c07 req-4ab602d3-57b8-48fe-9c44-4a7579c35344 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053898 Mar 26 21:02:21.529562 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1877/3554] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:22.052932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:22.054130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:22.069496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:22.075180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:22.076402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:22.079771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:23.764059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:23.786246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:23.788630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:23.790590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4dc8f2be-67cc-4fc7-9c94-0db2d751953e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1739 microversion: 2.32 time: 1.743326 Mar 26 21:02:23.793227 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1878/3555] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:22 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1739 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:23.833714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-97c30624-3e67-48c8-abd8-5d766bf51c80 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bffe430>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:23.856893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:02:23.857414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:02:23.857798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:02:23.858361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:02:23.858654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:02:23.897241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:23.898377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:23.908590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:23.912996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:23.969288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:02:23.977763 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-97c30624-3e67-48c8-abd8-5d766bf51c80 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.183151 Mar 26 21:02:23.983939 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1879/3556] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:23 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:23.987543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Getting quotas for user 70fab8e4c45d48ea8223a3acc60a5442 and project 71d58c339cd84f6891e4545c28bb7927. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:02:24.006842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:24.007464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:24.033004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:24.033650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:02:24.033786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:24.034485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:24.034931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:24.042556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:02:24.269165 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41f18cf2-6968-4c04-a65b-9869a77d9d3a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.577104 Mar 26 21:02:24.291320 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1678/3557] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:02:24.311542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-476c179e-63ea-44f2-89fe-61a372f60292 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:24.316168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-476c179e-63ea-44f2-89fe-61a372f60292 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:24.361390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:24.370564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:24.401971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:24.403371 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43e0139f-2cd0-4b46-9748-228fe08b77b8 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.412591 Mar 26 21:02:24.419999 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1880/3558] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:23 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:24.492340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-476c179e-63ea-44f2-89fe-61a372f60292 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:24.536814 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-476c179e-63ea-44f2-89fe-61a372f60292 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1215 microversion: 2.1 time: 0.230957 Mar 26 21:02:24.539642 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1679/3559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:24 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:24.810474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:24.811126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:24.819985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:24.827734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:24.831275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:24.834725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:24.997217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc1dcc6d-1011-4877-ab3d-685197ae15d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5890dee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:25.090817 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc1dcc6d-1011-4877-ab3d-685197ae15d2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.097320 Mar 26 21:02:25.091407 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1680/3560] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:24 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:25.423246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:25.424164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:25.435083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:25.435723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:25.444723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:25.446300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:25.899571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:25.910549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:25.917726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:25.919323 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-865a8055-dcc0-464e-bf99-0e6988f7af11 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1408 microversion: 2.54 time: 0.500802 Mar 26 21:02:25.932347 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1681/3561] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:25 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:25.938336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:25.945822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:25.959471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:25.960340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:25.961385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:25.961941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:26.179502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:26.195442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23ef11fb-0bb5-41eb-81ca-fe45c344b3b1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1267 microversion: 2.1 time: 0.256414 Mar 26 21:02:26.198807 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1682/3562] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:25 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:26.206750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-57bced95-f668-4720-ac06-d48dc4dbec14 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5942cdc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:26.309791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-57bced95-f668-4720-ac06-d48dc4dbec14 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.108922 Mar 26 21:02:26.310710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1683/3563] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:26 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:26.621137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:26.621955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:26.632872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:26.640476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:26.644755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:26.647572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:26.723485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:02:26.916443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae399dc3-b36c-43f3-a98d-3d500730a935 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 204 len: 0 microversion: 2.1 time: 0.298519 Mar 26 21:02:26.918207 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1684/3564] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:02:26 2022] DELETE /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:02:26.930161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-30690480", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "bfe02eff-c7ed-4380-8caa-d18372fcf8b2"}, {"uuid": "9fc45269-fc51-45e8-8c1e-974c212d212b"}, {"uuid": "bfe02eff-c7ed-4380-8caa-d18372fcf8b2"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:27.050681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] validate_networks() for [('bfe02eff-c7ed-4380-8caa-d18372fcf8b2', None, None, None, None, None), ('9fc45269-fc51-45e8-8c1e-974c212d212b', None, None, None, None, None), ('bfe02eff-c7ed-4380-8caa-d18372fcf8b2', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:02:27.113325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.123875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.133952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.136529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a59a84f-f5f2-4511-ad45-8636726ce73e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1785 microversion: 2.32 time: 2.330009 Mar 26 21:02:27.137476 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1881/3565] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:24 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1785 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:27.148506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:27.150447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:27.169788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.170526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:27.171362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.171860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:27.655779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.671262 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4cd4d2a8-0de2-4bd9-bc00-43ff44ebf184 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1509 microversion: 2.1 time: 0.530803 Mar 26 21:02:27.673276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1882/3566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:27 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:27.678197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:27.682161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:27.712506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.714663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:27.715665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.716362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:27.913497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.925235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.926873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:27.929093 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32c6a964-0f1c-42ee-9686-1ef9de68d431 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1414 microversion: 2.54 time: 0.254661 Mar 26 21:02:27.943410 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1883/3567] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:27 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1414 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:27.949960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:27.950732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:27.957753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.958501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:27.959520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:27.960220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:28.124832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:28.138214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc22d9dc-29f4-4f03-8611-5389bb42ada2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1273 microversion: 2.1 time: 0.191586 Mar 26 21:02:28.139466 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1884/3568] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:27 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:28.145439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70843afa-29a6-4d02-8a74-f4f0c8673c19 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bf8aaf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:28.239625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70843afa-29a6-4d02-8a74-f4f0c8673c19 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.098173 Mar 26 21:02:28.240564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1885/3569] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:28 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:28.247420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:28.249792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:28.274355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:28.275133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:28.276368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:28.278986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:29.250779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:29.268100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:29.269870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:29.274481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6dff341e-6472-4325-a2eb-e721e8b4f5f3 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 1.032604 Mar 26 21:02:29.280167 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1886/3570] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:28 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:29.289475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:29.290241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:29.306833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:29.307649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:29.308963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:29.311791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.648797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:30.665415 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-454cbd09-053e-4c01-9af4-f692d6132413 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1509 microversion: 2.1 time: 1.379817 Mar 26 21:02:30.666330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1887/3571] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:29 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1509 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:30.671311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:30.680983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:30.691332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.692469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.699853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.700701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.758978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:02:30.759363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:02:30.760317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:02:30.761289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:02:30.761785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:02:30.785009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.785480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.791098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.791705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.859137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Getting quotas for project c7ef32a79723421e847963a749a03313. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:02:30.870608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Getting quotas for user b52006e4eed04870964f3b282818c82c and project c7ef32a79723421e847963a749a03313. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:02:30.884771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:30.894820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:30.896836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:30.898522 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-872104d4-30bf-485e-ad4b-3bff4d748e2f tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1399 microversion: 2.54 time: 0.231014 Mar 26 21:02:30.902303 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1888/3572] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:30 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1399 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:30.916494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:30.917517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:30.927292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:02:30.929469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.932835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.935607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:30.936455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:30.940680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:02:31.126114 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae6fb411-e45c-46c4-9ca5-c8312f879e85 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.202651 Mar 26 21:02:31.131536 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1685/3573] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:02:31.165999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-957c7562-2310-4c70-b957-a58bc946f979 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e588e6670>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:31.248221 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-957c7562-2310-4c70-b957-a58bc946f979 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.115064 Mar 26 21:02:31.250275 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1686/3574] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:31 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:31.258911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:31.270294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:31.286742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:31.298385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:31.302006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:31.302480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:31.721888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:31.744630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:31.747137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:31.748629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a749172a-79b7-498c-9a65-beee1fb7cccf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 0.496710 Mar 26 21:02:31.764326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1687/3575] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:31 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:31.776259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38495edb-1604-428d-8ae3-00cbbb4536d1 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '.version_select at 0x7f6e588cbb80>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:31.810892 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38495edb-1604-428d-8ae3-00cbbb4536d1 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1779592200" status: 204 len: 0 microversion: 2.54 time: 0.041935 Mar 26 21:02:31.816062 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1688/3576] 10.222.0.16 () {60 vars in 1318 bytes} [Sat Mar 26 21:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1779592200 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:02:31.826828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7457fac-be0d-4af3-ab05-d1970f13a482 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:31.827464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7457fac-be0d-4af3-ab05-d1970f13a482 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:31.954295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d7457fac-be0d-4af3-ab05-d1970f13a482 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:31.962879 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7457fac-be0d-4af3-ab05-d1970f13a482 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1211 microversion: 2.1 time: 0.145166 Mar 26 21:02:31.963530 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1689/3577] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:31 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:31.981509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:31.982841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:32.011655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.012175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.015252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.015819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.121656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:32.151331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-42ecd296-1f8e-47e9-9446-20872bab2295 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1467 microversion: 2.1 time: 0.176764 Mar 26 21:02:32.154109 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1690/3578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:31 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1467 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:32.174037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:32.174836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:32.182918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.183616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.184591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.185186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.225073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:02:32.483998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-461749df-b01b-4e9d-b980-fdbcb50b93ce tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "DELETE /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 204 len: 0 microversion: 2.54 time: 0.313876 Mar 26 21:02:32.493088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1691/3579] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:02:32 2022] DELETE /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:02:32.500226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-034fc318-69e2-4f28-9352-dfbf8a636f5d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5924bca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:32.557369 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-034fc318-69e2-4f28-9352-dfbf8a636f5d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.062447 Mar 26 21:02:32.558803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1692/3580] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:32 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:32.565236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:32.566767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:32.574674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.575678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.576782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.577498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.711294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:32.725747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:32.735851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:32.741137 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03ddd254-4115-45f9-9d31-888cf5006419 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1405 microversion: 2.54 time: 0.179669 Mar 26 21:02:32.755716 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1693/3581] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:32 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:32.772782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:32.776478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:32.793251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.794122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.798729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.801276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.894356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:32.911954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90624881-8095-4355-9bc0-74576fad7222 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 2.002696 Mar 26 21:02:32.914790 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1889/3582] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:30 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:32.933902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2590b4d8-ec03-434d-8923-ff4e11aac32e req-d6e961f9-36b5-4813-8910-d93615522974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2f2f0d-e901-48d2-ba21-81b0a8d151c5", "name": "network-vif-deleted", "tag": "425a8d13-34da-40a1-93e0-b77741c63f6c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:32.965349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2590b4d8-ec03-434d-8923-ff4e11aac32e req-d6e961f9-36b5-4813-8910-d93615522974 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:32.968927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2590b4d8-ec03-434d-8923-ff4e11aac32e req-d6e961f9-36b5-4813-8910-d93615522974 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:32.992182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2590b4d8-ec03-434d-8923-ff4e11aac32e req-d6e961f9-36b5-4813-8910-d93615522974 service nova] Creating event network-vif-deleted:425a8d13-34da-40a1-93e0-b77741c63f6c for instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 on nch2-master-1 Mar 26 21:02:33.030761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2590b4d8-ec03-434d-8923-ff4e11aac32e req-d6e961f9-36b5-4813-8910-d93615522974 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112744 Mar 26 21:02:33.039625 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1890/3583] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:33.045773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:33.048124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:33.056930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.058419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.059477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.060214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.398930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.409496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.416585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.422071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-354b85fd-e06b-4b22-ab23-0b165097c82f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 0.653082 Mar 26 21:02:33.422925 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1694/3584] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:32 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:33.435088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:33.436379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:33.451521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.452506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.454194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.454856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.523185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.523996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.524904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lazy-loading 'fault' on Instance uuid 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:02:33.589117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.598128 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df1adcc3-327a-4996-a806-1b365433af9f tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 200 len: 1312 microversion: 2.1 time: 0.173786 Mar 26 21:02:33.599660 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1695/3585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:33 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:33.606001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81b31539-267f-4542-ae08-2fc87355052f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5924b3a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:33.681385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81b31539-267f-4542-ae08-2fc87355052f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.079699 Mar 26 21:02:33.682299 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1696/3586] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:33 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:33.763644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:33.764791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:33.773940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.776492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.777846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.778901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.816321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.825651 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-29b3d262-00da-4dab-a4c6-6d7cca6ed3d2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1263 microversion: 2.1 time: 0.783353 Mar 26 21:02:33.829977 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1891/3587] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:33 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1263 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:33.887305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.899979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.901924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:33.903423 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-798965a3-73ad-41f4-a848-28e5b376e0f4 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1405 microversion: 2.54 time: 0.146536 Mar 26 21:02:33.925141 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1697/3588] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:33 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:33.930630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:33.931879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:33.939731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.941913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:33.943244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:33.944028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:34.458288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:34.462188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:34.486759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:34.488840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:34.489689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:34.494433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:34.975591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:34.993267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.002770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85db2649-5079-4da8-a530-347a75e04f83 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.076007 Mar 26 21:02:35.005558 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1892/3589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:33 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:35.016404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.020737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:35.036644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.040410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.045075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.045705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.045907 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a74df3ce-2402-4ce4-8191-72d2d65d6701 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 0.601955 Mar 26 21:02:35.046489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.047357 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1698/3590] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:34 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:35.048282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.057010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-759c952d-f3fc-4990-a9f0-a5abf1c339d7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5885d940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.083017 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 could not be found. Mar 26 21:02:35.084898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 404 to user: Instance 5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:35.087033 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0986f34-50cd-4ec9-babb-df810643bbd6 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5" status: 404 len: 111 microversion: 2.1 time: 0.079033 Mar 26 21:02:35.094191 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1893/3591] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:35 2022] GET /compute/v2.1/servers/5b2f2f0d-e901-48d2-ba21-81b0a8d151c5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:02:35.104654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.105652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:35.123063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.123794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.124906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.125625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.140793 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-759c952d-f3fc-4990-a9f0-a5abf1c339d7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.091485 Mar 26 21:02:35.141384 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1699/3592] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:35 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:35.153359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.153941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:35.185536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.186246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.190883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.191700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.249802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.250507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.251705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lazy-loading 'fault' on Instance uuid 429e71e2-dd98-47e5-a9f5-e89c5394a0ef {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:02:35.319421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.329789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.331473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16965e41493449858ada0e70c052e3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092a9ada15ab4bd1960204f158625a42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.332940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-762c7ec2-264d-44f1-abe2-8ff5e7c4ee35 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 200 len: 1410 microversion: 2.54 time: 0.184947 Mar 26 21:02:35.336916 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1700/3593] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:35 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:35.352608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.353679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:35.376661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.377386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.379369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.382153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.459609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:02:35.470175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:35.480390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aaf305bc-009d-4b3e-96dd-e426da6b0aa3 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1269 microversion: 2.1 time: 0.384799 Mar 26 21:02:35.512248 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1894/3594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:35 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1269 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:35.522436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0537c0f0-d8ac-49f5-994e-908a5415a23f req-eb927ff9-112a-4b32-9712-0bd65498b361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "52c8eed7-3c91-43b3-9001-30b914ea4cd7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:35.559264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0537c0f0-d8ac-49f5-994e-908a5415a23f req-eb927ff9-112a-4b32-9712-0bd65498b361 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.559662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0537c0f0-d8ac-49f5-994e-908a5415a23f req-eb927ff9-112a-4b32-9712-0bd65498b361 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.610868 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0537c0f0-d8ac-49f5-994e-908a5415a23f req-eb927ff9-112a-4b32-9712-0bd65498b361 service nova] Creating event network-changed:52c8eed7-3c91-43b3-9001-30b914ea4cd7 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:02:35.630555 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0537c0f0-d8ac-49f5-994e-908a5415a23f req-eb927ff9-112a-4b32-9712-0bd65498b361 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116286 Mar 26 21:02:35.631782 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1895/3595] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:35.726605 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-691caac1-1ff2-4f84-a479-2eaeee4be219 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 204 len: 0 microversion: 2.1 time: 0.387925 Mar 26 21:02:35.727284 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1701/3596] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:02:35 2022] DELETE /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:02:35.739145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:35.741110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:35.750655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.751370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:35.754198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:35.755210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:36.029872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:36.032530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:36.042097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:36.042954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:36.044019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:36.044865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:36.921842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:36.933635 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11e863f9-a581-4fac-a28f-54fca1e74542 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 0.915877 Mar 26 21:02:36.943530 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1702/3597] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:36 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:36.951501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:36.952503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:36.984561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:36.985138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:36.986006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:36.986517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.301900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:37.321560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:37.323182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:37.324440 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de57c185-28f6-44d9-840f-ef46220c9eba tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 0.379558 Mar 26 21:02:37.325021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1703/3598] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:36 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:37.338774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2db537f5-4745-4152-81f8-89519ff92f59 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5ec9be50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:37.388502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2db537f5-4745-4152-81f8-89519ff92f59 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.053472 Mar 26 21:02:37.395226 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1704/3599] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:37 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:37.401176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:37.402085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] [instance: 429e71e2-dd98-47e5-a9f5-e89c5394a0ef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:37.409132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.410044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.420060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.420889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.442197 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] HTTP exception thrown: Instance 429e71e2-dd98-47e5-a9f5-e89c5394a0ef could not be found. Mar 26 21:02:37.443210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] Returning 404 to user: Instance 429e71e2-dd98-47e5-a9f5-e89c5394a0ef could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:37.444403 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5736604e-a4cc-45fa-9963-d33b695ffce3 tempest-ServerShowV254Test-1186067882 tempest-ServerShowV254Test-1186067882-project] 10.222.0.16 "GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef" status: 404 len: 111 microversion: 2.54 time: 0.047747 Mar 26 21:02:37.449130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1705/3600] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:37 2022] GET /compute/v2.1/servers/429e71e2-dd98-47e5-a9f5-e89c5394a0ef => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:02:37.463604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:37.464465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:37.478696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.480746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.482283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.485716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.630990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:37.647129 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59fa9f39-00ae-4d8c-86fb-32d9610785ba tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1269 microversion: 2.1 time: 0.189956 Mar 26 21:02:37.648572 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1706/3601] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:37 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:37.768247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6e559934-1b3f-4c8e-8d14-94dd8622f57e req-ce8d69df-619a-47e7-8371-54b26d0384bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8", "tag": "dcaf364f-32ed-4913-b91e-3c3ff9f85e80"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:37.784642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6e559934-1b3f-4c8e-8d14-94dd8622f57e req-ce8d69df-619a-47e7-8371-54b26d0384bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.785342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6e559934-1b3f-4c8e-8d14-94dd8622f57e req-ce8d69df-619a-47e7-8371-54b26d0384bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.792939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:37.801488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-596433b9-62bc-4214-b443-7e986c956592 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 2.069233 Mar 26 21:02:37.802069 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1896/3602] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:35 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:37.817222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6e559934-1b3f-4c8e-8d14-94dd8622f57e req-ce8d69df-619a-47e7-8371-54b26d0384bf service nova] Creating event network-changed:dcaf364f-32ed-4913-b91e-3c3ff9f85e80 for instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 on nch1-master-1 Mar 26 21:02:37.829214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6e559934-1b3f-4c8e-8d14-94dd8622f57e req-ce8d69df-619a-47e7-8371-54b26d0384bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065241 Mar 26 21:02:37.832252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1707/3603] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:02:37.950869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:37.951475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:37.958657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.959362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:37.960522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:37.961131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:38.345113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:38.348192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:38.358148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:38.358836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:38.360386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:38.361004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:38.627122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:38.641958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:38.643788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:38.645531 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ec277c9-1940-4b81-9e2a-6930bf31cd94 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1831 microversion: 2.32 time: 0.305607 Mar 26 21:02:38.662043 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1708/3604] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:38 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1831 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:02:38.669889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-30f764c9-0dd4-49a0-be82-3e2cc89f6906 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e587d21f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:38.749032 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-30f764c9-0dd4-49a0-be82-3e2cc89f6906 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.084079 Mar 26 21:02:38.750174 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1709/3605] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:38 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:38.761211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:38.766119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:38.782092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:38.785319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:38.787018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:38.791048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:38.998751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:39.011497 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0eece4bc-89cd-45c1-8a70-3069385587f8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.064353 Mar 26 21:02:39.012302 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1897/3606] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:37 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:39.031484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:39.042703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:39.059657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:39.060164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:39.063462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:39.063948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:39.913582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:39.916072 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5eb0bca-a007-4fe3-9204-d26163a3d39d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1311 microversion: 2.1 time: 1.164072 Mar 26 21:02:39.926188 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1710/3607] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:38 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1311 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:39.931164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:39.931848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:39.942014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:39.942481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:39.943278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:39.943733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:40.158422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:40.178191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-711717f8-4cc1-42bc-aaad-b208692b7007 tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 1.161768 Mar 26 21:02:40.189294 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1898/3608] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:39 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:40.196647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ee813c8-580a-41ad-a513-2f636e6d5e78 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bfad1f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.255064 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ee813c8-580a-41ad-a513-2f636e6d5e78 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1437 microversion: 2.1 time: 0.064301 Mar 26 21:02:40.256185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1899/3609] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:40.257272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ee813c8-580a-41ad-a513-2f636e6d5e78 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.258531 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ee813c8-580a-41ad-a513-2f636e6d5e78 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001412 Mar 26 21:02:40.264416 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1900/3610] 10.222.0.16 () {56 vars in 885 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 26 21:02:40.271321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.273314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:40.280110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:40.280954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:40.282138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:40.282916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:40.459604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:40.472768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:40.474898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:40.477780 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1852 microversion: 2.32 time: 0.549623 Mar 26 21:02:40.479546 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1711/3611] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:39 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1852 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:40.481476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.483634 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002781 Mar 26 21:02:40.489702 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1712/3612] 10.222.0.16 () {54 vars in 1034 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Mar 26 21:02:40.491647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.494119 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002079 Mar 26 21:02:40.502643 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1713/3613] 10.222.0.16 () {54 vars in 1040 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:40.521900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.528120 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85970418-d8e1-4d91-8a9a-2c0c76c30882 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006421 Mar 26 21:02:40.550007 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1714/3614] 10.222.0.16 () {56 vars in 885 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/ => generated 377 bytes in 46 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 26 21:02:40.577527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f94ee49a-ed6f-4d4b-8fb7-ae429ac3ba6d req-4fd4dfcb-59c8-4e1c-8fae-f6ab134dbfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "44253e4b-0e65-47a7-9d9a-61ce95e7f45c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:40.597896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f94ee49a-ed6f-4d4b-8fb7-ae429ac3ba6d req-4fd4dfcb-59c8-4e1c-8fae-f6ab134dbfb9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:40.598350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f94ee49a-ed6f-4d4b-8fb7-ae429ac3ba6d req-4fd4dfcb-59c8-4e1c-8fae-f6ab134dbfb9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:40.620726 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f94ee49a-ed6f-4d4b-8fb7-ae429ac3ba6d req-4fd4dfcb-59c8-4e1c-8fae-f6ab134dbfb9 service nova] Creating event network-changed:44253e4b-0e65-47a7-9d9a-61ce95e7f45c for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:02:40.633777 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f94ee49a-ed6f-4d4b-8fb7-ae429ac3ba6d req-4fd4dfcb-59c8-4e1c-8fae-f6ab134dbfb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059802 Mar 26 21:02:40.634695 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1715/3615] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:40.938789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:40.939509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:40.958811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:40.959273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:40.963534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:40.964403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:41.355814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:41.371576 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e2cbec6-7dbd-48cc-8a58-f53f0533e86e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.104122 Mar 26 21:02:41.373281 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1901/3616] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:41.388209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:41.389356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:41.398521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:41.399774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:41.401353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:41.402014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:41.857711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:41.866582 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-79640a57-cc20-4fb5-8283-d589b80e8372 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1311 microversion: 2.1 time: 0.933197 Mar 26 21:02:41.876815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1716/3617] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:40 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1311 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:41.876815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e57027e-40ed-4a28-8648-3dcb0fa3f227 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5893d5e0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:41.925626 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1e57027e-40ed-4a28-8648-3dcb0fa3f227 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1446 microversion: 2.1 time: 0.055377 Mar 26 21:02:41.926754 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1717/3618] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:41 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1446 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:41.931755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:41.932624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:41.939909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:41.941090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:41.943019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:41.943483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:42.305395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:42.315771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:42.317825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:42.319323 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-acb3784d-94dc-47b7-8549-b1eba7bd262a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1852 microversion: 2.32 time: 0.391435 Mar 26 21:02:42.320125 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1718/3619] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:41 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1852 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:42.325354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-27bbcfee-cea2-4f4e-b14c-426bb27e1caf req-8dc5a1dc-830b-4230-979d-3c643bbc046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181cdcdc-74c2-4b78-b19a-090890ca8a8b", "name": "network-vif-deleted", "tag": "f222d2e5-bec9-47c9-9eb3-321c6788db77"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:42.338247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-27bbcfee-cea2-4f4e-b14c-426bb27e1caf req-8dc5a1dc-830b-4230-979d-3c643bbc046e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:42.338710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-27bbcfee-cea2-4f4e-b14c-426bb27e1caf req-8dc5a1dc-830b-4230-979d-3c643bbc046e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:42.360971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-27bbcfee-cea2-4f4e-b14c-426bb27e1caf req-8dc5a1dc-830b-4230-979d-3c643bbc046e service nova] Creating event network-vif-deleted:f222d2e5-bec9-47c9-9eb3-321c6788db77 for instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b on nch1-master-1 Mar 26 21:02:42.371824 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-27bbcfee-cea2-4f4e-b14c-426bb27e1caf req-8dc5a1dc-830b-4230-979d-3c643bbc046e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049701 Mar 26 21:02:42.372312 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1719/3620] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:42.379373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e833041-8070-48d6-9e57-097e61c7324b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e593f0430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:42.429700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e833041-8070-48d6-9e57-097e61c7324b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 200 len: 1446 microversion: 2.1 time: 0.055946 Mar 26 21:02:42.430544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1720/3621] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:42 2022] GET /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 1446 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:42.441569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:42.443154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:42.451733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:42.452534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:42.453698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:42.455207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:42.503687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb495ec547743d38a7502110a166b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff0b12b0e8843e99f5aac63876e13fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:42.511431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b30bbdd-be97-4181-99f1-1d367e8be34c tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 200 len: 1522 microversion: 2.1 time: 1.132367 Mar 26 21:02:42.521126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1902/3622] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:41 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 1522 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:42.521126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-610fe46a-2985-4a6a-9149-39a78b6f55be tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58088820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:42.755055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:42.762990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c685feee-8fb4-46fa-b11f-11e297d426b3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 0.331188 Mar 26 21:02:42.766782 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1721/3623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:42 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:42.897101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:42.898159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:42.914993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:42.915738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:42.917075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:42.917933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.341943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:43.351694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8a44130-8106-45f9-8f7b-cd97445458a2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1332 microversion: 2.1 time: 0.470449 Mar 26 21:02:43.354346 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1722/3624] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:42 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1332 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:43.359507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:43.360305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:43.379130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.382837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.384436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.387422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.496560 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-610fe46a-2985-4a6a-9149-39a78b6f55be tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 204 len: 0 microversion: 2.1 time: 0.982353 Mar 26 21:02:43.502509 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1903/3625] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:42 2022] DELETE /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:02:43.511061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:43.512367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:43.522192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.522976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.524082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.524712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.573117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:02:43.709390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8c4b2efa-7ae1-4374-9bb8-67d4354b17dd tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 204 len: 0 microversion: 2.1 time: 0.204812 Mar 26 21:02:43.710920 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1904/3626] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:02:43 2022] DELETE /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:02:43.717056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:43.720984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] [instance: 181cdcdc-74c2-4b78-b19a-090890ca8a8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:43.724595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.725214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.726010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.726538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.747382 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] HTTP exception thrown: Instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b could not be found. Mar 26 21:02:43.748391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] Returning 404 to user: Instance 181cdcdc-74c2-4b78-b19a-090890ca8a8b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:02:43.750026 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae9cdc6b-5e34-424e-aa5f-c9352a4c33cb tempest-ServerRescueNegativeTestJSON-1836208909 tempest-ServerRescueNegativeTestJSON-1836208909-project] 10.222.0.16 "GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b" status: 404 len: 111 microversion: 2.1 time: 0.037075 Mar 26 21:02:43.750816 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1905/3627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:43 2022] GET /compute/v2.1/servers/181cdcdc-74c2-4b78-b19a-090890ca8a8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:02:43.785176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:43.787191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:43.795501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.797143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:43.798375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:43.799708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:44.110700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:44.119987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:44.121612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:44.123698 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-50c82044-58ac-43d0-9be7-982e50fa49fe tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.768197 Mar 26 21:02:44.134686 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1723/3628] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:43 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:44.134686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1946141442", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "bed7c102-81ae-4d0f-9222-79cbabeb217f"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:44.199638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] validate_networks() for [('bed7c102-81ae-4d0f-9222-79cbabeb217f', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:02:44.842635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:44.852645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-318f7535-0700-416b-9079-6ecd22f11964 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.075488 Mar 26 21:02:44.870738 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1906/3629] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:43 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:44.885385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:44.885964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:44.903752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:44.905305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:44.907136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:44.907638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:44.933084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:02:44.933562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:02:44.934199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:02:44.934623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:02:44.935138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:02:44.950680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:44.951543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:44.953739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:44.957312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:44.993506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:02:45.001640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Getting quotas for user fdd16c1bdb3d416d8421202397566d1c and project 496f2be9357e414ca8db7bf1f5ed0234. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:02:45.041820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:02:45.049513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:02:45.146298 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cbb9350-2450-43d6-8adf-c99dc0732684 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016376 Mar 26 21:02:45.147578 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1724/3630] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:02:45.174849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-cfc4abd1-68bc-4d14-a9e9-083fa00d1a91 req-0f29b29d-123f-4083-be95-07cc59684cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "b5ab341d-bc21-496a-8125-8e90f4b08572"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:45.199864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cfc4abd1-68bc-4d14-a9e9-083fa00d1a91 req-0f29b29d-123f-4083-be95-07cc59684cc3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.200308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cfc4abd1-68bc-4d14-a9e9-083fa00d1a91 req-0f29b29d-123f-4083-be95-07cc59684cc3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:45.234153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-cfc4abd1-68bc-4d14-a9e9-083fa00d1a91 req-0f29b29d-123f-4083-be95-07cc59684cc3 service nova] Creating event network-changed:b5ab341d-bc21-496a-8125-8e90f4b08572 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:02:45.253666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-cfc4abd1-68bc-4d14-a9e9-083fa00d1a91 req-0f29b29d-123f-4083-be95-07cc59684cc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099548 Mar 26 21:02:45.258004 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1725/3631] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:45.280301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:45.281634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:45.314214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.317172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:45.318186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.318598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:45.801399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:45.817163 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-566282c0-aedf-44a2-9f52-17b33d22350f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1332 microversion: 2.1 time: 0.943322 Mar 26 21:02:45.817820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1907/3632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:44 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1332 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:45.832258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:45.833191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:45.847574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.848902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:45.849927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.850600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:45.920438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:45.953539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:45.955131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:45.956380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b922ae16-8479-4456-8c6c-b5b4e2df70cf tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.696835 Mar 26 21:02:45.956957 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1726/3633] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:45 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:45.975152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9361b1f5-a117-468c-b721-d86ecac760d3 req-5070c8f2-1d83-4925-87c5-ac74c36eebe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8", "name": "network-vif-plugged", "status": "completed", "tag": "dcaf364f-32ed-4913-b91e-3c3ff9f85e80"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:45.991396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9361b1f5-a117-468c-b721-d86ecac760d3 req-5070c8f2-1d83-4925-87c5-ac74c36eebe9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:45.994978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9361b1f5-a117-468c-b721-d86ecac760d3 req-5070c8f2-1d83-4925-87c5-ac74c36eebe9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:46.025980 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9361b1f5-a117-468c-b721-d86ecac760d3 req-5070c8f2-1d83-4925-87c5-ac74c36eebe9 service nova] Creating event network-vif-plugged:dcaf364f-32ed-4913-b91e-3c3ff9f85e80 for instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 on nch1-master-1 Mar 26 21:02:46.032043 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9361b1f5-a117-468c-b721-d86ecac760d3 req-5070c8f2-1d83-4925-87c5-ac74c36eebe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073606 Mar 26 21:02:46.032887 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1727/3634] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:46.039128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:46.040761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:46.048292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:46.049007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:46.050023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:46.050688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:46.228540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:46.237588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37d7052f-5829-41ce-8b03-7ea463913c3b tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1212 microversion: 2.1 time: 0.418447 Mar 26 21:02:46.248078 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1908/3635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:45 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1212 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:46.840519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:46.842659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:46.854677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:46.859415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:46.860677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:46.861362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:47.116919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.127950 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-498a8c45-996d-4f8e-aaa4-8632aa1bd02c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.093254 Mar 26 21:02:47.128676 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1728/3636] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:46 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:47.133368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:47.134242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:47.141382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:47.142094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:47.143110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:47.143750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:47.673180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.689782 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-154378e6-9b6b-4c88-a0a0-8f098c416f9d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.856971 Mar 26 21:02:47.691820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1909/3637] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:46 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:47.699141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:47.700253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:47.717154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:47.717835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:47.719440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:47.720082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:47.863767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.881158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.882998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.884209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d7a1caa-1958-4264-9284-235be3254b33 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.754543 Mar 26 21:02:47.884777 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1729/3638] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:47 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:47.888872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:47.897016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08ebde32-425d-47dd-8619-7251856eb9ec tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1266 microversion: 2.1 time: 0.202705 Mar 26 21:02:47.898721 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1910/3639] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:47 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:48.057030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8aa4b2f6-c34a-47d9-a5eb-8be6b12f6312 req-fa350669-c3ca-4c7a-ab7f-bc6b5d9de5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9427df83-e863-41a3-9ba3-1fe2de2f72ce", "name": "network-vif-unplugged", "status": "completed", "tag": "08f22eaa-d9e9-4268-adec-e550bc108da0"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:48.065955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8aa4b2f6-c34a-47d9-a5eb-8be6b12f6312 req-fa350669-c3ca-4c7a-ab7f-bc6b5d9de5d0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:48.067045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8aa4b2f6-c34a-47d9-a5eb-8be6b12f6312 req-fa350669-c3ca-4c7a-ab7f-bc6b5d9de5d0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:48.079626 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8aa4b2f6-c34a-47d9-a5eb-8be6b12f6312 req-fa350669-c3ca-4c7a-ab7f-bc6b5d9de5d0 service nova] Creating event network-vif-unplugged:08f22eaa-d9e9-4268-adec-e550bc108da0 for instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce on nch1-master-1 Mar 26 21:02:48.085731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8aa4b2f6-c34a-47d9-a5eb-8be6b12f6312 req-fa350669-c3ca-4c7a-ab7f-bc6b5d9de5d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031573 Mar 26 21:02:48.085731 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1730/3640] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:48.145498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:48.146198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:48.152471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:48.153023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:48.153869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:48.154714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:48.710448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:48.711140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:48.728733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:48.729198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:48.729990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:48.730433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:49.179017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:49.198398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e0b1795-0a92-4540-8460-609b118375ae tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.491987 Mar 26 21:02:49.208628 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1731/3641] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:48 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:49.213823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:49.214662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:49.228890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:49.229598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:49.230396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:49.230851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:49.369070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:49.378291 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-640c28a3-0442-44d6-abe5-3202e862595f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1315 microversion: 2.1 time: 1.237004 Mar 26 21:02:49.381650 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1911/3642] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:48 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:49.394894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:49.398085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:49.413972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:49.414360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:49.415324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:49.428266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:50.183995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:50.194417 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9afedc93-5f78-4936-a366-c5f48da3aabf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 0.811484 Mar 26 21:02:50.195860 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1912/3643] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:49 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:50.205975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-144cdb02-5f06-4b36-9571-5482d78c1636 req-ee972b81-9244-45de-a5c2-76f7c18498f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9427df83-e863-41a3-9ba3-1fe2de2f72ce", "name": "network-vif-deleted", "tag": "08f22eaa-d9e9-4268-adec-e550bc108da0"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:50.226438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-144cdb02-5f06-4b36-9571-5482d78c1636 req-ee972b81-9244-45de-a5c2-76f7c18498f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:50.228042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-144cdb02-5f06-4b36-9571-5482d78c1636 req-ee972b81-9244-45de-a5c2-76f7c18498f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:50.245143 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-144cdb02-5f06-4b36-9571-5482d78c1636 req-ee972b81-9244-45de-a5c2-76f7c18498f1 service nova] Creating event network-vif-deleted:08f22eaa-d9e9-4268-adec-e550bc108da0 for instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce on nch1-master-1 Mar 26 21:02:50.251896 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-144cdb02-5f06-4b36-9571-5482d78c1636 req-ee972b81-9244-45de-a5c2-76f7c18498f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050987 Mar 26 21:02:50.253012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1913/3644] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:50.260527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:50.261382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:50.269918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:50.270681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:50.272966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:50.284681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:50.284900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:50.285734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:50.293274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:50.294731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5761719f-56ad-4273-849e-18cea1d77137 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 1.084846 Mar 26 21:02:50.300675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1732/3645] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:49 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:50.395233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:50.396159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:50.408396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:50.409009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:50.410074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:50.410629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.083798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:51.085758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:51.099740 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-038d85d2-0e14-4013-91d9-4d5f229c5076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1502 microversion: 2.1 time: 0.708352 Mar 26 21:02:51.111570 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1733/3646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:50 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1502 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:51.111779 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08a4f823-618e-4d63-9f6b-cb3dad045f21 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.853710 Mar 26 21:02:51.111779 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1914/3647] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:50 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:51.123174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:51.126947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:51.160960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.161720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.162733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.163391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.212119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:51.212986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:51.227246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.228832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.230094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.231636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.297829 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-efed7faf-3e13-4e81-ae5e-fffd49297255 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8/action" status: 202 len: 0 microversion: 2.1 time: 0.183790 Mar 26 21:02:51.303162 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1734/3648] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:51 2022] POST /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:02:51.310476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:51.312502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:51.321421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.322370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.323742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.325511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.865721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:51.896330 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8395eb08-75db-41ec-b1b4-4fa3f87dc84d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1507 microversion: 2.1 time: 0.590034 Mar 26 21:02:51.907383 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1735/3649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:51 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:51.909204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:51.911145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:51.935629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.935965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:51.936792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:51.937236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.571614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:52.574246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:52.584658 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-602e7be3-33b9-41db-bf61-b5ede8f8b928 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 1.376435 Mar 26 21:02:52.585824 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1915/3650] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:51 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:02:52.586405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:52.588181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:52.590141 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44e5a7cd-efb8-4a58-b70e-0a060768dc5f tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.689368 Mar 26 21:02:52.591048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1736/3651] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:51 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:52.592770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:52.594632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:52.602944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "df90cff0-cb5b-4aad-bb76-1204dc22e346"}, {"name": "network-changed", "server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "tag": "93931704-6fea-4515-a6df-884b6c68ddcb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:52.606819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.607371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.611210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.612126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.621371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.622173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.639354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] Creating event network-changed:df90cff0-cb5b-4aad-bb76-1204dc22e346 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:02:52.640299 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] Creating event network-changed:93931704-6fea-4515-a6df-884b6c68ddcb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:02:52.646454 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-dec4f3e7-b7a7-402c-b2b1-549dcdcb80d0 req-ae72ea7a-1149-460f-afac-e95ef56468c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053633 Mar 26 21:02:52.647092 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1737/3652] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:52.653415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ce5c9b57-4fd4-4405-ad58-c57ec36346f5 req-943f2291-5fe1-4278-9514-c39b4697ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7c3417-181f-4cd3-9bd9-9cff4faeafab", "tag": "d6021828-9e93-4aec-99b6-e95282b2f43d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:52.662397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ce5c9b57-4fd4-4405-ad58-c57ec36346f5 req-943f2291-5fe1-4278-9514-c39b4697ff2b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.663076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ce5c9b57-4fd4-4405-ad58-c57ec36346f5 req-943f2291-5fe1-4278-9514-c39b4697ff2b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.675096 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ce5c9b57-4fd4-4405-ad58-c57ec36346f5 req-943f2291-5fe1-4278-9514-c39b4697ff2b service nova] Creating event network-changed:d6021828-9e93-4aec-99b6-e95282b2f43d for instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab on nch1-master-1 Mar 26 21:02:52.680091 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ce5c9b57-4fd4-4405-ad58-c57ec36346f5 req-943f2291-5fe1-4278-9514-c39b4697ff2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Mar 26 21:02:52.680848 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1738/3653] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:52.916851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:52.917583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:52.926596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.927582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:52.928745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:52.929231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:53.627280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:53.642264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa8ee4c3-4992-4737-8755-3f1ca4d48ee4 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1487 microversion: 2.1 time: 0.728429 Mar 26 21:02:53.655940 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1739/3654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:52 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1487 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:53.655940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:53.655940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:53.658047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:53.658767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:53.659721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:53.662114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:53.760592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:53.787547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f5493f2-0b6c-4fdb-b80d-23cd75059e94 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.200543 Mar 26 21:02:53.789744 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1916/3655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:52 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:53.796999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:53.797917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:53.825161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:53.826209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:53.830883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:53.831871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.502897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:54.514911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0586fbfe-701c-437a-962b-2442dcf2c66a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 0.869390 Mar 26 21:02:54.518623 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1740/3656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:53 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:54.528183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:54.529875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:54.540055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.540833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.542325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.542941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.582958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lazy-loading 'flavor' on Instance uuid dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:02:54.738366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:54.758110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:54.763969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:54.767612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0a99728-9d70-4865-8ae3-f6e59c79c7fb tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.976422 Mar 26 21:02:54.768246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1917/3657] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:53 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:54.781151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-33425b22-7c92-4f89-a642-680e8797ef6c req-5268e570-2893-4216-b138-0ed0b2fb9d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "6ce9015d-d518-4977-9578-35a0aacefd54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:54.802809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33425b22-7c92-4f89-a642-680e8797ef6c req-5268e570-2893-4216-b138-0ed0b2fb9d5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.803518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33425b22-7c92-4f89-a642-680e8797ef6c req-5268e570-2893-4216-b138-0ed0b2fb9d5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.829579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-33425b22-7c92-4f89-a642-680e8797ef6c req-5268e570-2893-4216-b138-0ed0b2fb9d5d service nova] Creating event network-changed:6ce9015d-d518-4977-9578-35a0aacefd54 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:02:54.843341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-33425b22-7c92-4f89-a642-680e8797ef6c req-5268e570-2893-4216-b138-0ed0b2fb9d5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069622 Mar 26 21:02:54.847061 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1918/3658] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:54.872754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:54.873718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:54.887353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.888053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.889008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.889615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.907746 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7a84218-8eea-4f07-9c76-62dbc2581658 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8/action" status: 202 len: 0 microversion: 2.1 time: 0.386070 Mar 26 21:02:54.913287 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1741/3659] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:02:54 2022] POST /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:02:54.929749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:54.930791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:54.939990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.940827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:54.941840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:54.942463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:55.901622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:55.915523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a03d393a-efe0-48d5-a41a-d07456db5e14 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1493 microversion: 2.1 time: 1.000437 Mar 26 21:02:55.929249 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1742/3660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:54 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1493 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:55.948508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:55.951016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:55.975450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:55.979701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:55.982310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:55.984156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:56.228883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:56.256959 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aed4ea18-1136-445d-aee0-e5eb424a5a5e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.408531 Mar 26 21:02:56.265339 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1919/3661] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:54 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:56.283000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:56.283628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:56.301773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:56.302483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:56.303680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:56.306104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:57.300726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:57.317708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc61b3db-47cf-4641-b3e3-9a200f4e828a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 1.384110 Mar 26 21:02:57.319061 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1743/3662] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:55 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:57.327951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0657ca2d-5b86-409c-9a35-bda115b1622d req-fa4dd0ee-b327-4b42-a8a0-96daafed112e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "tag": "5ff04cb7-828b-45fe-9bec-656625bf9adb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:02:57.373845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0657ca2d-5b86-409c-9a35-bda115b1622d req-fa4dd0ee-b327-4b42-a8a0-96daafed112e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:57.375323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0657ca2d-5b86-409c-9a35-bda115b1622d req-fa4dd0ee-b327-4b42-a8a0-96daafed112e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:57.410395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0657ca2d-5b86-409c-9a35-bda115b1622d req-fa4dd0ee-b327-4b42-a8a0-96daafed112e service nova] Creating event network-changed:5ff04cb7-828b-45fe-9bec-656625bf9adb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:02:57.420336 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0657ca2d-5b86-409c-9a35-bda115b1622d req-fa4dd0ee-b327-4b42-a8a0-96daafed112e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093983 Mar 26 21:02:57.439214 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1744/3663] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:02:57.458478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:57.461056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:57.477783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:57.478321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:57.479129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:57.479758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:57.586862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:57.617168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:57.625449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:57.654639 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a3a2272-2352-404f-bf34-678484d7cb11 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 1.370773 Mar 26 21:02:57.656969 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1920/3664] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:56 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:02:57.697773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:57.699216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:57.707336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:57.708076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:57.709037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:57.709672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:59.263669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:59.272240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c059b5ec-3840-4dfd-aa4c-bbc77c4c84bc tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.584188 Mar 26 21:02:59.277077 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1921/3665] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:57 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:59.304097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:59.321067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:59.326420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:02:59.338604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7bd45fdd-a041-4162-9141-85a131363e2d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1514 microversion: 2.1 time: 1.896657 Mar 26 21:02:59.340661 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1745/3666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:57 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1514 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:02:59.355508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:02:59.356413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:02:59.360441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:59.361061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:59.361912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:59.362364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:59.369383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:59.373790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:02:59.375188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:02:59.376512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:00.644906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:00.655506 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8589289e-d0ae-40d6-930b-834cfcdb5eb7 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 1.376430 Mar 26 21:03:00.660202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1922/3667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:02:59 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:00.675739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75"}, {"name": "network-changed", "server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "tag": "9c3e2f7e-9048-4ff3-afdd-38b6b8876db3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:00.694523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:00.713696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:00.742151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] Creating event network-changed:27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:00.742691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] Creating event network-changed:9c3e2f7e-9048-4ff3-afdd-38b6b8876db3 for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:00.761369 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-717c417e-e932-421c-98c8-b2cd5f090c95 req-96eefe27-fc09-4483-b5b1-fe9b045111f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096262 Mar 26 21:03:00.764977 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1923/3668] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:00.774623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:00.775342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:00.799108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:00.799760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:00.806013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:00.806525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:00.823128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:00.844002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:00.846099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:00.848563 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac935bb6-d7aa-45f4-a2c1-316031cfea82 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 1.506111 Mar 26 21:03:00.883017 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1746/3669] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:02:59 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:00.888321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:00.890448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:00.902293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:00.903460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:00.904583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:00.905981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:01.795189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:01.806771 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9be47b39-10da-41f0-83a8-b13a7a9476e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.040229 Mar 26 21:03:01.813255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1924/3670] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:00 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:01.824619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:01.826186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:01.846298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:01.847568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:01.850317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:01.850941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:01.990934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:01.998402 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63b3cad5-4ac2-4931-a06e-a27120a9f867 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 1.113854 Mar 26 21:03:02.016470 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1747/3671] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:00 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:02.024656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:02.026446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:02.045223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.046925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:02.049158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.050283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:02.306593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:02.331090 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3a865538-c53d-462d-9c7c-929cca1ee74a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1308 microversion: 2.1 time: 0.515490 Mar 26 21:03:02.332992 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1925/3672] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:01 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:02.337925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ab74a6b2-3a9c-442b-bc7c-8498e7214b38 req-7b9c072d-7198-4028-a67d-c15ec8fce28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7c3417-181f-4cd3-9bd9-9cff4faeafab", "name": "network-vif-plugged", "status": "completed", "tag": "d6021828-9e93-4aec-99b6-e95282b2f43d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:02.349957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ab74a6b2-3a9c-442b-bc7c-8498e7214b38 req-7b9c072d-7198-4028-a67d-c15ec8fce28c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.351474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ab74a6b2-3a9c-442b-bc7c-8498e7214b38 req-7b9c072d-7198-4028-a67d-c15ec8fce28c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:02.403169 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ab74a6b2-3a9c-442b-bc7c-8498e7214b38 req-7b9c072d-7198-4028-a67d-c15ec8fce28c service nova] Creating event network-vif-plugged:d6021828-9e93-4aec-99b6-e95282b2f43d for instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab on nch1-master-1 Mar 26 21:03:02.415708 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ab74a6b2-3a9c-442b-bc7c-8498e7214b38 req-7b9c072d-7198-4028-a67d-c15ec8fce28c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080620 Mar 26 21:03:02.418827 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1926/3673] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:02.805797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cd9ba250-b46d-4acf-9fee-4116796e7e46 req-dce634fd-20a3-49ee-829c-4ff271069655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "5a5ac11b-6501-4f2a-b826-a2beff85eb24"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:02.850044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cd9ba250-b46d-4acf-9fee-4116796e7e46 req-dce634fd-20a3-49ee-829c-4ff271069655 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.856185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cd9ba250-b46d-4acf-9fee-4116796e7e46 req-dce634fd-20a3-49ee-829c-4ff271069655 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:02.885018 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cd9ba250-b46d-4acf-9fee-4116796e7e46 req-dce634fd-20a3-49ee-829c-4ff271069655 service nova] Creating event network-changed:5a5ac11b-6501-4f2a-b826-a2beff85eb24 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:02.897561 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cd9ba250-b46d-4acf-9fee-4116796e7e46 req-dce634fd-20a3-49ee-829c-4ff271069655 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097345 Mar 26 21:03:02.902295 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1927/3674] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:02.909892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:02.916473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:02.937907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.938471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:02.939295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:02.939738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:03.436653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:03.444239 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d8f89e7-8683-4962-bdf7-f0552d0987d7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.540308 Mar 26 21:03:03.447554 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1928/3675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:02 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:03.452278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:03.452887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:03.471481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:03.475821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:03.476913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:03.477638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.000970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:04.031719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1168714-dcf4-467d-a7d1-27e59a0aa6b7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.582996 Mar 26 21:03:04.034857 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1929/3676] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:03 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:04.047774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:04.051197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:04.066700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.069712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.071216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.071837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.128835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:04.138655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:04.148681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:04.149926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a577c3a-80e2-4285-9c3b-ca1c88ed8d1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 2.132138 Mar 26 21:03:04.162322 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1748/3677] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:02 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:04.418095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:04.427455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c5aab9c-061d-42c8-812c-3b88e5319658 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1487 microversion: 2.1 time: 0.390569 Mar 26 21:03:04.446624 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1930/3678] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:04 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1487 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:04.450900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8cb828f9-f9c5-4d7f-893c-ad72e2449128 req-50eb1e9e-9054-4c60-98a7-0c977351a959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8", "name": "network-vif-plugged", "status": "completed", "tag": "dcaf364f-32ed-4913-b91e-3c3ff9f85e80"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:04.452223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2066657838"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:04.453507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:04.460615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.461391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.462378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.463012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.473256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8cb828f9-f9c5-4d7f-893c-ad72e2449128 req-50eb1e9e-9054-4c60-98a7-0c977351a959 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.476431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8cb828f9-f9c5-4d7f-893c-ad72e2449128 req-50eb1e9e-9054-4c60-98a7-0c977351a959 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.503409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8cb828f9-f9c5-4d7f-893c-ad72e2449128 req-50eb1e9e-9054-4c60-98a7-0c977351a959 service nova] Creating event network-vif-plugged:dcaf364f-32ed-4913-b91e-3c3ff9f85e80 for instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 on nch1-master-1 Mar 26 21:03:04.511486 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8cb828f9-f9c5-4d7f-893c-ad72e2449128 req-50eb1e9e-9054-4c60-98a7-0c977351a959 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066539 Mar 26 21:03:04.516342 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1749/3679] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:03:04.522024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:04.523098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:04.531697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.532641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.534205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:04.534873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:04.897029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55f35c2d-42b4-4848-9933-d5b207ea7e11 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "POST /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab/action" status: 202 len: 0 microversion: 2.1 time: 0.448777 Mar 26 21:03:04.910569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1931/3680] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:04 2022] POST /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:03:04.925407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b20fbc5-d6f8-46be-b3c8-6978c6e132d1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e5816ef70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:05.014949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b20fbc5-d6f8-46be-b3c8-6978c6e132d1 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19" status: 200 len: 1412 microversion: 2.1 time: 0.098355 Mar 26 21:03:05.016830 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1932/3681] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:04 2022] GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:05.039572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d82823c7-5f1a-4b70-9747-4757b81745f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bf4d0d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:05.165924 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d82823c7-5f1a-4b70-9747-4757b81745f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19" status: 200 len: 1412 microversion: 2.1 time: 0.138171 Mar 26 21:03:05.166713 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1933/3682] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:05 2022] GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:05.176030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:05.178310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:05.194036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:05.194319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:05.195703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:05.199372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:05.483112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:05.493235 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c21f44d6-f31d-44a5-ad0b-787c527f73b2 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.975350 Mar 26 21:03:05.507385 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1750/3683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:04 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:05.524649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:05.525552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:05.535739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:05.539545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:05.542251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:05.542888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:05.857485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:05.867306 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb223857-271a-4b82-8170-a437d7ab7206 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.699176 Mar 26 21:03:05.871820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1934/3684] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:05 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:05.883731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-939a16ae-2276-416b-8788-97b28c8030f3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bfb5790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:06.222007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-939a16ae-2276-416b-8788-97b28c8030f3 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19" status: 204 len: 0 microversion: 2.1 time: 0.348709 Mar 26 21:03:06.223263 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1935/3685] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:05 2022] DELETE /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:06.231347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-89cfa148-9a59-4da8-8377-03507a0b4a45 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e4bf4df70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:06.260661 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-89cfa148-9a59-4da8-8377-03507a0b4a45 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Image not found. Mar 26 21:03:06.261492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-89cfa148-9a59-4da8-8377-03507a0b4a45 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:06.262549 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-89cfa148-9a59-4da8-8377-03507a0b4a45 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19" status: 404 len: 62 microversion: 2.1 time: 0.035157 Mar 26 21:03:06.266740 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1936/3686] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:06 2022] GET /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:06.277388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:06.278246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:06.291037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:06.291897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:06.293021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:06.293732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:06.614142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:06.622707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-161af354-00c3-4dd5-ad2f-2b62d54b29cf tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1505 microversion: 2.1 time: 0.351474 Mar 26 21:03:06.635091 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1937/3687] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:06 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:06.641740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:06.649880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:06.662356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:06.664549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:06.667953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:06.670953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:07.445885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:07.455059 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd0b29a5-f900-46f0-bf79-260db265e593 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.817702 Mar 26 21:03:07.455644 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1938/3688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:06 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:07.480825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:07.488610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:07.509383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:07.515467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:07.516566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:07.517230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:07.853020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:07.864431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:07.866210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:07.867667 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-470c0cae-7d19-44ed-a1ac-e9d0cecd5ed1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 2.358676 Mar 26 21:03:07.879868 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1751/3689] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:05 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:07.887604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:07.888644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:07.898226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:07.899881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:07.901096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:07.904051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:08.007681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:08.017125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4856f87-a1c9-423c-bcfd-928e3480dea7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.555761 Mar 26 21:03:08.021523 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1939/3690] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:07 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:08.474463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:08.475116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:08.490238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:08.491159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:08.493693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:08.494048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:09.314753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:09.324471 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f640dcc3-dc02-4c47-aca2-39a89ba2e26d tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1505 microversion: 2.1 time: 1.441318 Mar 26 21:03:09.327572 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1752/3691] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:07 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1505 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:09.334359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:09.337786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:09.338425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:09.350794 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a04fb961-331c-47e1-a5f8-1f4acb582a34 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.881531 Mar 26 21:03:09.352752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:09.355010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:09.356050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:09.358705 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1940/3692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:08 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:09.359489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:09.383224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:09.384900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:09.400485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:09.400965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:09.401784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:09.402236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:09.766004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:09.783707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4fb6ca4f-d5e0-4019-8f82-b33a815dbcef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.423847 Mar 26 21:03:09.788901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1941/3693] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:09 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:10.178348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5d710bda-8de0-470c-a4a7-3b7150c7a70f req-dca68203-7256-4fb0-a440-8b2ce237ee68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7c3417-181f-4cd3-9bd9-9cff4faeafab", "name": "network-vif-plugged", "status": "completed", "tag": "d6021828-9e93-4aec-99b6-e95282b2f43d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:10.198452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5d710bda-8de0-470c-a4a7-3b7150c7a70f req-dca68203-7256-4fb0-a440-8b2ce237ee68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:10.200374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5d710bda-8de0-470c-a4a7-3b7150c7a70f req-dca68203-7256-4fb0-a440-8b2ce237ee68 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:10.220900 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5d710bda-8de0-470c-a4a7-3b7150c7a70f req-dca68203-7256-4fb0-a440-8b2ce237ee68 service nova] Creating event network-vif-plugged:d6021828-9e93-4aec-99b6-e95282b2f43d for instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab on nch1-master-1 Mar 26 21:03:10.231122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5d710bda-8de0-470c-a4a7-3b7150c7a70f req-dca68203-7256-4fb0-a440-8b2ce237ee68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056830 Mar 26 21:03:10.232532 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1942/3694] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:03:10.348589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:10.350342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:10.365263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:10.367192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:10.368943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:10.369728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:10.755642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:10.770094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d202a380-63b0-48e9-b868-7c3f40d45a04 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1487 microversion: 2.1 time: 0.424810 Mar 26 21:03:10.785337 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1943/3695] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:10 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1487 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:10.799531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:10.800699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:10.814885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:10.818043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:10.819119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:10.824590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:11.284310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:11.309900 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d7db62f-4524-44c4-9699-49813a203c03 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.523133 Mar 26 21:03:11.310756 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1944/3696] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:10 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:11.335257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:11.336207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:11.353616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:11.354342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:11.355466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:11.357750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:11.418533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:03:11.564183 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0907387-238c-47de-b9bd-15338fcc07d5 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 204 len: 0 microversion: 2.1 time: 0.239045 Mar 26 21:03:11.569719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1945/3697] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:11 2022] DELETE /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:11.580559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:11.585731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:11.596848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:11.597325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:11.598325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:11.601355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:11.628376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:11.646100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:11.650713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:11.657447 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56e639ef-782b-4c29-8fca-7b8aa43d35c4 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 2.328060 Mar 26 21:03:11.673786 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1753/3698] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:09 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:12.063453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: .version_select at 0x7f6e59499040>, body: {"keypair": {"name": "tempest-keypair-1081840065"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:12.110482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:12.189222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:12.341586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:12.355131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-77012734-bfa7-4dde-85c2-f65bb618c8c2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.783523 Mar 26 21:03:12.358740 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1946/3699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:11 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:12.370943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d37b57bc-e59e-4fdb-9521-174cc56ba39a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e581b6820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:12.421967 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d37b57bc-e59e-4fdb-9521-174cc56ba39a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Image not found. Mar 26 21:03:12.424073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d37b57bc-e59e-4fdb-9521-174cc56ba39a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:12.426508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:12.426892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d37b57bc-e59e-4fdb-9521-174cc56ba39a tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19" status: 404 len: 62 microversion: 2.1 time: 0.065468 Mar 26 21:03:12.427611 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1947/3700] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:12 2022] DELETE /compute/v2.1/images/b6a79880-8c48-4bf9-b146-bb5f48128e19 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:12.437653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:12.438835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:12.448675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.449151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:12.450880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:12.452787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.454472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:12.490769 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53d494c0-1773-4fe1-be21-8148482c0f3d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.815575 Mar 26 21:03:12.496718 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1754/3701] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 21:03:11 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 822 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:03:12.505445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:12.510095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:12.525221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.526192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:12.530302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.530955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:12.601524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:03:12.712400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Instance is already in deleting state, ignoring this request Mar 26 21:03:12.713972 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9e9c1fb-046e-4c7b-990a-416b13ae768f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 204 len: 0 microversion: 2.1 time: 0.216002 Mar 26 21:03:12.715111 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1755/3702] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:12 2022] DELETE /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:12.720471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:12.724830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:12.736312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.741288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:12.742479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:12.743338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:13.111632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:13.126037 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78c9ffc1-5ef2-42ec-a7ea-b107435c0d84 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.696917 Mar 26 21:03:13.127314 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1948/3703] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:12 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:13.138822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:13.141657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:13.159319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:13.160666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:13.179319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:13.182307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:13.721295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:13.734491 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad776f62-8eb6-45c6-804c-d628eeb1da52 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1493 microversion: 2.1 time: 0.605579 Mar 26 21:03:13.735148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1949/3704] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:13 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1493 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:13.755086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:13.755811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:13.769333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:13.769741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:13.771249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:13.773383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:14.507551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:14.522255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:14.524075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:14.529493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7966467-13fd-4d99-8ed0-59e636dc6815 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 1.812864 Mar 26 21:03:14.532713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1756/3705] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:12 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:14.546535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4eb68930-ab91-4a96-b3ff-3eb25bb614fd req-b1b65b7c-369f-4ac7-adf7-65a3ac993a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7c3417-181f-4cd3-9bd9-9cff4faeafab", "name": "network-vif-unplugged", "status": "completed", "tag": "d6021828-9e93-4aec-99b6-e95282b2f43d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:14.565763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4eb68930-ab91-4a96-b3ff-3eb25bb614fd req-b1b65b7c-369f-4ac7-adf7-65a3ac993a9c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:14.566466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4eb68930-ab91-4a96-b3ff-3eb25bb614fd req-b1b65b7c-369f-4ac7-adf7-65a3ac993a9c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:14.608319 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4eb68930-ab91-4a96-b3ff-3eb25bb614fd req-b1b65b7c-369f-4ac7-adf7-65a3ac993a9c service nova] Creating event network-vif-unplugged:d6021828-9e93-4aec-99b6-e95282b2f43d for instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab on nch1-master-1 Mar 26 21:03:14.618212 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4eb68930-ab91-4a96-b3ff-3eb25bb614fd req-b1b65b7c-369f-4ac7-adf7-65a3ac993a9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084026 Mar 26 21:03:14.619071 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1757/3706] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:14.633603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:14.634754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:14.657170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:14.658126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:14.659221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:14.662083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:14.783615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:14.796053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c14b2fdd-ba0c-499a-807f-4afbffb8c20a tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 1.054791 Mar 26 21:03:14.813382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1950/3707] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:13 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:14.819571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:14.820792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:14.830613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:14.831733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:14.838923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:14.839791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:15.720480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:15.729901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4cbc715-de1a-42bd-a3f2-1696278afdb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1493 microversion: 2.1 time: 0.915319 Mar 26 21:03:15.733006 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1951/3708] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:14 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1493 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:15.745360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:15.746235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:15.761067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:15.762970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:15.765385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:15.767908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.172701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.180441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6a04ebc-ac78-4243-9681-6043f581ca26 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.559938 Mar 26 21:03:16.185330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1758/3709] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:14 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:16.190100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:16.190712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:16.207667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.212198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.214163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.222043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.447065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.466916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.474816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.493249 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e27c314-470c-4066-82ed-f5dabaf480f7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.754877 Mar 26 21:03:16.494732 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1952/3710] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:15 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:16.515949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-02b051c2-2f80-446f-806f-4c33aa68bee2 req-1a0affd0-eea8-4b47-9344-170e052f8d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7c3417-181f-4cd3-9bd9-9cff4faeafab", "name": "network-vif-deleted", "tag": "d6021828-9e93-4aec-99b6-e95282b2f43d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:16.526810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-02b051c2-2f80-446f-806f-4c33aa68bee2 req-1a0affd0-eea8-4b47-9344-170e052f8d4c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.527793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-02b051c2-2f80-446f-806f-4c33aa68bee2 req-1a0affd0-eea8-4b47-9344-170e052f8d4c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.575558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-02b051c2-2f80-446f-806f-4c33aa68bee2 req-1a0affd0-eea8-4b47-9344-170e052f8d4c service nova] Creating event network-vif-deleted:d6021828-9e93-4aec-99b6-e95282b2f43d for instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab on nch1-master-1 Mar 26 21:03:16.600746 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-02b051c2-2f80-446f-806f-4c33aa68bee2 req-1a0affd0-eea8-4b47-9344-170e052f8d4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088905 Mar 26 21:03:16.601423 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1953/3711] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:16.752615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:16.753827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:16.763053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.771542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.772524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.776040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.814594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.823283 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-063981e3-1424-4268-997e-e7fef459a407 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.636768 Mar 26 21:03:16.842614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:16.843333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:16.844030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lazy-loading 'fault' on Instance uuid 3d7c3417-181f-4cd3-9bd9-9cff4faeafab {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:03:16.845452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1759/3712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:16 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:16.954756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdd16c1bdb3d416d8421202397566d1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496f2be9357e414ca8db7bf1f5ed0234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:16.978273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8f1e13b-eb77-4e1c-878e-d5e3a2fef3f4 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 200 len: 1298 microversion: 2.1 time: 0.231474 Mar 26 21:03:16.980325 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1954/3713] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:16 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 1298 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:17.197268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:17.197899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:17.210086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.218417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:17.220849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.222029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:17.513310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:17.514595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:17.529324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.530480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:17.532901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.539594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:17.898132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:17.915463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:17.917106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:17.918303 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9ffe22d-a6db-47e4-a2dc-57561a6e1762 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.409534 Mar 26 21:03:17.919034 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1955/3714] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:17 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:17.923479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:17.924108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:17.942867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.943619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:17.945788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:17.950045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.577969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:18.592902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e591a21-9ae8-4012-af4c-63f7ec1bba18 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.672783 Mar 26 21:03:18.593699 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1956/3715] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:17 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:18.612671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:18.613298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 3d7c3417-181f-4cd3-9bd9-9cff4faeafab] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:18.633363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.633838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.634868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.635305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.669220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab could not be found. Mar 26 21:03:18.669726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 3d7c3417-181f-4cd3-9bd9-9cff4faeafab could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:18.670619 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1f3cc98-ca24-4cd2-98fc-2d1b62fe1cbb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab" status: 404 len: 111 microversion: 2.1 time: 0.062099 Mar 26 21:03:18.674424 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1957/3716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:18 2022] GET /compute/v2.1/servers/3d7c3417-181f-4cd3-9bd9-9cff4faeafab => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:18.684172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1110322651", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb6c52d1-d568-4f84-9ff8-81cc9efd0e84"}], "security_groups": [{"name": "tempest-securitygroup--832020560"}], "key_name": "tempest-keypair-1081840065", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:18.735965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:18.751317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d554bf8-1938-4b55-8b17-4dae5fe4a61e tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 1.558452 Mar 26 21:03:18.757805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1760/3717] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:17 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:18.762948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c092cd2a-33b1-40d8-bb8e-3286e78d10cc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e594459d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:18.801743 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c092cd2a-33b1-40d8-bb8e-3286e78d10cc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Image not found. Mar 26 21:03:18.802351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c092cd2a-33b1-40d8-bb8e-3286e78d10cc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:18.803194 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c092cd2a-33b1-40d8-bb8e-3286e78d10cc tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2" status: 404 len: 62 microversion: 2.1 time: 0.044185 Mar 26 21:03:18.806791 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1761/3718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:18 2022] DELETE /compute/v2.1/images/0cf742bc-febe-4507-b2aa-8d14e4be3cf2 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:18.813113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:18.813625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:18.830359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.830842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.831649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.837026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.869302 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce could not be found. Mar 26 21:03:18.884189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:18.885371 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e232e126-1754-4f6f-8e01-c5a2c464e6e2 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 404 len: 111 microversion: 2.1 time: 0.077617 Mar 26 21:03:18.886117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1762/3719] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:18 2022] DELETE /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:18.894558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:18.895801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 9427df83-e863-41a3-9ba3-1fe2de2f72ce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:18.911785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] validate_networks() for [('bb6c52d1-d568-4f84-9ff8-81cc9efd0e84', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:03:18.912537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.913340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.914303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.914904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.938059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce could not be found. Mar 26 21:03:18.938662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 9427df83-e863-41a3-9ba3-1fe2de2f72ce could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:18.939839 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3458e45a-85fa-4bc1-b810-6c8c185022fb tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce" status: 404 len: 111 microversion: 2.1 time: 0.049238 Mar 26 21:03:18.945057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1763/3720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:18 2022] GET /compute/v2.1/servers/9427df83-e863-41a3-9ba3-1fe2de2f72ce => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:03:18.951326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:18.952665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:18.959651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.960405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:18.961428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:18.962079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:19.834243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:19.853359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:19.855594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:19.858326 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a79fecf9-1301-46de-8bda-ec29f5555abd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.910483 Mar 26 21:03:19.897819 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1764/3721] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:18 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:19.903786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5fbfa6ef-2b15-4605-a2e6-bbbb8dcfd88f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e59374040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:19.965552 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5fbfa6ef-2b15-4605-a2e6-bbbb8dcfd88f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Image not found. Mar 26 21:03:19.966670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5fbfa6ef-2b15-4605-a2e6-bbbb8dcfd88f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:19.978259 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5fbfa6ef-2b15-4605-a2e6-bbbb8dcfd88f tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e" status: 404 len: 62 microversion: 2.1 time: 0.078701 Mar 26 21:03:19.989713 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1765/3722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:19 2022] DELETE /compute/v2.1/images/c45a2df5-0484-4bf8-ba7a-03b203aaba6e => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:20.003995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.005158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.054184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.054818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.055726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.056314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.066216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:03:20.066744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:03:20.067140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:03:20.067711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:03:20.068216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:03:20.086886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.087350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.088192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.088667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.128332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:20.135343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:20.151736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:03:20.155564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:03:20.238139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-18ee1a82-943e-4cd6-981a-95bbadf429cc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.562567 Mar 26 21:03:20.238919 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1958/3723] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:03:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:03:20.248658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.249351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.256475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.257004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.258034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.258732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.624932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:20.627076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:20.636159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c10595d-7f50-411f-8d47-bab487ece5c0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.396139 Mar 26 21:03:20.642982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-352fd5e6-0f20-44c3-96e2-3daccc0da8dd tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.649299 Mar 26 21:03:20.652257 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1959/3724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:20 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:20.656155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1766/3725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:19 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:20.661211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.662000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.668238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.668963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.669791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.670262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.670479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.671108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.695608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 384155c0-abdb-4448-ab0e-797be0db4df6 could not be found. Mar 26 21:03:20.696741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 384155c0-abdb-4448-ab0e-797be0db4df6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:20.697856 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b537ff5-6b5a-4f7f-9609-a835b45eabb8 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 404 len: 111 microversion: 2.1 time: 0.044508 Mar 26 21:03:20.699020 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1960/3726] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:20 2022] DELETE /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:20.708982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.710036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 384155c0-abdb-4448-ab0e-797be0db4df6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.722855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.723618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.724693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.725415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.742520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 384155c0-abdb-4448-ab0e-797be0db4df6 could not be found. Mar 26 21:03:20.743889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 384155c0-abdb-4448-ab0e-797be0db4df6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:20.745090 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3fc1a91-400a-4694-a4bd-d845ebaa8375 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6" status: 404 len: 111 microversion: 2.1 time: 0.040385 Mar 26 21:03:20.746311 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1961/3727] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:20 2022] GET /compute/v2.1/servers/384155c0-abdb-4448-ab0e-797be0db4df6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:20.760077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-148cf0a2-a7f3-4953-b6d9-1713c6d6867c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '.version_select at 0x7f6e58088dc0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.803341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-148cf0a2-a7f3-4953-b6d9-1713c6d6867c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Image not found. Mar 26 21:03:20.804702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-148cf0a2-a7f3-4953-b6d9-1713c6d6867c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:20.806167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-148cf0a2-a7f3-4953-b6d9-1713c6d6867c tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df" status: 404 len: 62 microversion: 2.1 time: 0.050000 Mar 26 21:03:20.806943 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1962/3728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:20 2022] DELETE /compute/v2.1/images/09d95d56-0874-4e62-a839-007c006eb7df => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:20.828480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.829076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.846534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.850084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.851015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.851474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.878434 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 could not be found. Mar 26 21:03:20.879107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:20.879990 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a454b65-9a97-4af4-8d3d-45c3a57706ce tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "DELETE /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 404 len: 111 microversion: 2.1 time: 0.068900 Mar 26 21:03:20.883358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1963/3729] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:20 2022] DELETE /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:20.889997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.890584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] [instance: 724266e8-a6b9-48ad-8ae7-cebb995e13c2] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.898695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.899257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.900165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.900696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.915588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] HTTP exception thrown: Instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 could not be found. Mar 26 21:03:20.916332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] Returning 404 to user: Instance 724266e8-a6b9-48ad-8ae7-cebb995e13c2 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:20.917398 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27f42c02-fa20-4318-9e8d-ab563cd5d776 tempest-ImagesTestJSON-816117015 tempest-ImagesTestJSON-816117015-project] 10.222.0.16 "GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2" status: 404 len: 111 microversion: 2.1 time: 0.032727 Mar 26 21:03:20.918376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1964/3730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:20 2022] GET /compute/v2.1/servers/724266e8-a6b9-48ad-8ae7-cebb995e13c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:03:20.923897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:20.924726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:20.932696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.933801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.934689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:20.935377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:20.993311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.004760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.013676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.021232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51383b6d-8147-4d9f-8468-0eb7384c67a1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1282 microversion: 2.20 time: 0.363988 Mar 26 21:03:21.026848 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1767/3731] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:20 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1282 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:21.479157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.499566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.504403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:21.507300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d59409a-ff49-45dc-9be9-cd5c77756696 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.586180 Mar 26 21:03:21.508701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1965/3732] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:20 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:21.660894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:21.661516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:21.662264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:21.663308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:21.673679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:21.674128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:21.674949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:21.675380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:21.675828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:21.676530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:21.677579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:21.679590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:22.173622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:22.181113 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8a6ff72-e9a0-4cb4-8a24-f5c0634aa7bc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.524205 Mar 26 21:03:22.188293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:22.193289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1966/3733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:21 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:22.199542 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38adeca3-31c0-4f75-b47f-e2f16a306336 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.543095 Mar 26 21:03:22.201385 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1768/3734] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:21 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:22.210881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:22.211740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:22.225975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:22.226557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:22.227406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:22.227795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:22.349928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:22.359987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:22.361854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:22.363700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd052845-b19b-42b0-8b59-60ad7a2c7bf6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1352 microversion: 2.20 time: 0.168931 Mar 26 21:03:22.364557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1967/3735] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:22 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:22.423451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5b58a1a8-636c-494f-941f-6a52a439c950 req-37997882-5f2e-42c6-ab42-817a544826f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-plugged", "status": "completed", "tag": "5ff04cb7-828b-45fe-9bec-656625bf9adb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:22.434822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5b58a1a8-636c-494f-941f-6a52a439c950 req-37997882-5f2e-42c6-ab42-817a544826f2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:22.435539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5b58a1a8-636c-494f-941f-6a52a439c950 req-37997882-5f2e-42c6-ab42-817a544826f2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:22.459460 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5b58a1a8-636c-494f-941f-6a52a439c950 req-37997882-5f2e-42c6-ab42-817a544826f2 service nova] Creating event network-vif-plugged:5ff04cb7-828b-45fe-9bec-656625bf9adb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:22.475409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5b58a1a8-636c-494f-941f-6a52a439c950 req-37997882-5f2e-42c6-ab42-817a544826f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063321 Mar 26 21:03:22.477356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1769/3736] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:22.527004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:22.528397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:22.535979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:22.536694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:22.537704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:22.538335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.203561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:23.206041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:23.232445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.236155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.237329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.238179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.266307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:23.282735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:23.284382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:23.285618 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-89d16d31-21e5-44ce-b09a-58dfc5d30fcd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.763922 Mar 26 21:03:23.286187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1968/3737] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:22 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:23.302912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:23.303757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:23.314721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.315283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.316283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.326202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.868183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:23.874468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:23.879791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd4f1838-18db-4101-8c1b-8c2672f5793d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1506 microversion: 2.1 time: 0.682039 Mar 26 21:03:23.881827 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1770/3738] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:23 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:23.887592 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9eadfcf3-45fa-4c7f-9db7-442d54dfc5e7 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.598441 Mar 26 21:03:23.890555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:23.890982 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1969/3739] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:23 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:23.895513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:23.907012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.907772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:23.908813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:23.909444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.162135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.174040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.176736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.178373 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c215470-c4bb-4d15-b817-44eb9b324b8d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1340 microversion: 2.20 time: 0.295381 Mar 26 21:03:24.190453 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1771/3740] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:23 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1340 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:24.305470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:24.306399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:24.313563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.314207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.315291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.316036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.513041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-plugged", "status": "completed", "tag": "93931704-6fea-4515-a6df-884b6c68ddcb"}, {"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-plugged", "status": "completed", "tag": "9c3e2f7e-9048-4ff3-afdd-38b6b8876db3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:24.525857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.526506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.542015 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] Creating event network-vif-plugged:93931704-6fea-4515-a6df-884b6c68ddcb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:24.542776 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] Creating event network-vif-plugged:9c3e2f7e-9048-4ff3-afdd-38b6b8876db3 for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:24.548771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9d6d0105-4604-40f9-b8ff-6fb776b32e66 req-dcb3756d-0af7-4e4d-9887-8553c85b0ee7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046255 Mar 26 21:03:24.549861 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1772/3741] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:24.716016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.728560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.734045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:24.735284 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec516cec-f96f-4278-b021-4a0f43043c59 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.434024 Mar 26 21:03:24.736213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1970/3742] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:24 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:24.901726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:24.902496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:24.913083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:24.913704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:24.924660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.925110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.925902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.926751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.927026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.927466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:24.928772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:24.929246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:25.464883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:25.473877 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-658e39b4-0fb0-4b90-b72e-5e2b5ed83c82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.564974 Mar 26 21:03:25.474500 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1971/3743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:24 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:25.491577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:25.492689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:25.501725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:25.502384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:25.503689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:25.504821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:25.814743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:25.823895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82b53fc6-e932-4c4a-8322-1e0f76b20e1d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1506 microversion: 2.1 time: 0.928171 Mar 26 21:03:25.827175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1773/3744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:24 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1506 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:25.839153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:25.840075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:25.856005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:25.856474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:25.857264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:25.857747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:25.912739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:25.929027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:25.935361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:25.941011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44d54493-8388-4a6f-b863-1054f61fb2e9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.455341 Mar 26 21:03:25.943840 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1972/3745] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:25 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:26.290855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: .version_select at 0x7f6e4bf10940>, body: {"keypair": {"name": "tempest-keypair-1680823649"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:26.313844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:26.322132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:26.443638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:26.460054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:26.465598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:26.467056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e71f565c-f25f-42b4-ae62-ef92e1eee484 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.638895 Mar 26 21:03:26.470343 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1774/3746] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:25 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:26.490864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:26.491946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:26.494800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:26.502097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:26.502972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:26.504508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:26.505245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:26.507107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:26.532288 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6562628c-3f00-45d4-9f2e-d46d5ff26fc9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.433779 Mar 26 21:03:26.540009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1973/3747] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:03:26 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:26.569484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-29130d04-4179-405f-b8b2-8ce15d0d67ee req-fe3797e5-81c7-43eb-8e99-587fd0ce6b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8", "name": "network-vif-unplugged", "status": "completed", "tag": "dcaf364f-32ed-4913-b91e-3c3ff9f85e80"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:26.585800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-29130d04-4179-405f-b8b2-8ce15d0d67ee req-fe3797e5-81c7-43eb-8e99-587fd0ce6b99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:26.586572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-29130d04-4179-405f-b8b2-8ce15d0d67ee req-fe3797e5-81c7-43eb-8e99-587fd0ce6b99 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:26.604614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-29130d04-4179-405f-b8b2-8ce15d0d67ee req-fe3797e5-81c7-43eb-8e99-587fd0ce6b99 service nova] Creating event network-vif-unplugged:dcaf364f-32ed-4913-b91e-3c3ff9f85e80 for instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 on nch1-master-1 Mar 26 21:03:26.615896 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-29130d04-4179-405f-b8b2-8ce15d0d67ee req-fe3797e5-81c7-43eb-8e99-587fd0ce6b99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051457 Mar 26 21:03:26.618081 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1974/3748] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:03:26.845295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:26.845295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:26.860527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:26.861192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:26.863877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:26.866379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.078461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.088872 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-760f8429-5bbf-44b2-9ec9-3e9368299c54 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1353 microversion: 2.1 time: 0.602168 Mar 26 21:03:27.089468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1775/3749] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:26 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1353 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:27.105147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:27.106005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:27.114078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.114981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.116002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.117210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.271630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.281330 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e725b03d-3984-4c12-8c15-9a7dcb853ac8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 200 len: 1509 microversion: 2.1 time: 0.442316 Mar 26 21:03:27.304348 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1975/3750] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:26 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:27.309449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:27.310329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:27.328471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.329358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.330373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.330974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.797095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.812679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.815319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.818596 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2828a79-ba43-454d-a75e-7cc5f8716bc8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.727913 Mar 26 21:03:27.825457 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1776/3751] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:27 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:27.830916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:27.841061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:27.847712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.848423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.852649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:27.853294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:27.968273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:27.981764 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3ee23a7-1827-40e2-8dbd-5b35cf647ef8 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.676183 Mar 26 21:03:27.989350 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1976/3752] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:27 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:28.012952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:28.013957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:28.023787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:28.024365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:28.025578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:28.025810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:28.395285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:28.421796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:28.425244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:28.446001 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85a55146-0a75-4d97-9c12-8f38329264c0 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.619157 Mar 26 21:03:28.451129 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1777/3753] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:27 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:28.464312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:28.465132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:28.480070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:28.480959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:28.483335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:28.485428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:28.827064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:28.840715 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa7cdc73-0fb6-4e5e-a8cf-48c2da45d26f tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.831878 Mar 26 21:03:28.844655 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1977/3754] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:28 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:28.856806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2a71fcce-f11a-44a9-8e9d-12b171973394 req-67dd96f7-7a4e-45f2-9fc5-d18715220b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:28.875466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2a71fcce-f11a-44a9-8e9d-12b171973394 req-67dd96f7-7a4e-45f2-9fc5-d18715220b46 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:28.876211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2a71fcce-f11a-44a9-8e9d-12b171973394 req-67dd96f7-7a4e-45f2-9fc5-d18715220b46 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:28.892094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2a71fcce-f11a-44a9-8e9d-12b171973394 req-67dd96f7-7a4e-45f2-9fc5-d18715220b46 service nova] Creating event network-changed:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:03:28.906475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2a71fcce-f11a-44a9-8e9d-12b171973394 req-67dd96f7-7a4e-45f2-9fc5-d18715220b46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060018 Mar 26 21:03:28.910698 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1978/3755] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:29.019468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-860380986", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "29a33636-1c6f-4164-b055-8f1a3b4ee463"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:29.037580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:29.046464 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96d61dcd-3740-4b57-8b29-75de186e3dcd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1804 microversion: 2.1 time: 0.593769 Mar 26 21:03:29.058273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1778/3756] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:28 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1804 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:29.063841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:29.064542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:29.072297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.072742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:29.073532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.073979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:29.130291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] validate_networks() for [('29a33636-1c6f-4164-b055-8f1a3b4ee463', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:03:29.682203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:29.693920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:29.698606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:29.700244 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5258d210-c544-4942-83e0-a1f061714b17 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.640792 Mar 26 21:03:29.701531 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1779/3757] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:29 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:29.721842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:29.723397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:29.736498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.738137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:29.739532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.744601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:29.946242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:03:29.948470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:03:29.949872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:03:29.950488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:03:29.951650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:03:29.988848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.989580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:29.991462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:29.992774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.018108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:30.024151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for user cbbebd48cec04499a06386f886c8f99c and project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:30.039422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:03:30.042522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:03:30.094389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e3fe3d10-8e67-4db8-a977-4de595c92193 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177604 Mar 26 21:03:30.100065 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1979/3758] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:03:30.105469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.106274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.120573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.121265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.122358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.123069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.149394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-466efd98-829e-4b64-8f4f-5b3401639b89 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0/ips" status: 200 len: 219 microversion: 2.1 time: 0.047883 Mar 26 21:03:30.156646 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1980/3759] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:03:30 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0/ips => generated 219 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:30.162967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.163764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.170733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.171474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.172587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.173192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.478788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:30.492534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:30.494686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:30.495906 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c655c3dc-95ec-42f2-b870-f47ef7f66b3b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.337713 Mar 26 21:03:30.508718 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1981/3760] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:30 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:30.515208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f86a7817-ca70-4a43-a2cf-be030aee3de6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.515728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f86a7817-ca70-4a43-a2cf-be030aee3de6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.583705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f86a7817-ca70-4a43-a2cf-be030aee3de6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:30.593014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f86a7817-ca70-4a43-a2cf-be030aee3de6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1224 microversion: 2.1 time: 0.082999 Mar 26 21:03:30.594299 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1982/3761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:30 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:30.599970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.600731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.607486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.607974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.608775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.609422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.647078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:03:30.813716 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d169229b-53a3-4808-bc1b-3660434a2a51 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 204 len: 0 microversion: 2.1 time: 0.217823 Mar 26 21:03:30.821117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1983/3762] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:30 2022] DELETE /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:30.828812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.834660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.847484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.848199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.849175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.849936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.904798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:30.915493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e377a57e-3d25-4fd5-b9a5-c03ee6ec1c72 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 1.212126 Mar 26 21:03:30.916121 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1780/3763] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:29 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:30.941878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:30.943491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:30.957993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.961595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:30.964781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:30.968895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.157653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:31.172734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:31.177230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:31.182723 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e313aa9c-dbae-4396-a5ca-b8bd7af2a887 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.357353 Mar 26 21:03:31.198468 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1984/3764] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:30 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:31.205927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:31.208067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:31.224692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:31.227338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.228350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:31.230615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.519100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:31.535837 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d5df9736-8491-42e8-89ef-d5eccf1758d2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.335980 Mar 26 21:03:31.536497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1985/3765] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:31 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:31.552536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:31.553393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:31.559431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:31.561183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.562247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:31.563029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.876464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:31.892804 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a775b8db-a2f1-4ef9-8ad6-e9457449f5f5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1810 microversion: 2.1 time: 0.964692 Mar 26 21:03:31.894275 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1781/3766] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:30 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1810 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:31.908725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f18fd9c6-9500-4b29-92e0-5f616ce799f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:31.916926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f18fd9c6-9500-4b29-92e0-5f616ce799f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:31.926561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f18fd9c6-9500-4b29-92e0-5f616ce799f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:31.959682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f18fd9c6-9500-4b29-92e0-5f616ce799f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Going to try to stop instance {{(pid=141580) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:03:32.002025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.030064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.032159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.033381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59585a42-3c7a-4b65-bd25-d3fda2f97b8b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.484960 Mar 26 21:03:32.047822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1986/3767] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:31 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:32.047822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:32.047822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:32.054444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f18fd9c6-9500-4b29-92e0-5f616ce799f2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.157630 Mar 26 21:03:32.055136 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1782/3768] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:31 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:03:32.065469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:32.067090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:32.068475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.068933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.071287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.071745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.083099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.083099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.083954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.087066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.210375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.225404 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6012f5e7-a022-4510-8a5e-38f6161b3cbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1282 microversion: 2.1 time: 0.186805 Mar 26 21:03:32.238925 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1987/3769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:32 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:32.246414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:32.247093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:32.260982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.261450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.262254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.262769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.624082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.635056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.637069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.641678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3bb41a87-768c-4400-9b2e-61fe2f84ebfb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.400883 Mar 26 21:03:32.642866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1988/3770] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:32 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:32.694712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:32.702183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-90b97642-8a5e-43fe-bf0d-b691cbd6b68d req-87dd03af-7221-4aca-b0dd-a2d1887020c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "52c8eed7-3c91-43b3-9001-30b914ea4cd7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:32.707274 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9a32d9ed-f859-42f1-9786-ab1d56dacc12 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.645413 Mar 26 21:03:32.709231 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1783/3771] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:32 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:32.715084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-90b97642-8a5e-43fe-bf0d-b691cbd6b68d req-87dd03af-7221-4aca-b0dd-a2d1887020c3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.716537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-90b97642-8a5e-43fe-bf0d-b691cbd6b68d req-87dd03af-7221-4aca-b0dd-a2d1887020c3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.738262 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-90b97642-8a5e-43fe-bf0d-b691cbd6b68d req-87dd03af-7221-4aca-b0dd-a2d1887020c3 service nova] Creating event network-vif-plugged:52c8eed7-3c91-43b3-9001-30b914ea4cd7 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:32.745925 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-90b97642-8a5e-43fe-bf0d-b691cbd6b68d req-87dd03af-7221-4aca-b0dd-a2d1887020c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049625 Mar 26 21:03:32.746854 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1989/3772] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:32.912265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:32.913727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:32.921347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.922143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:32.923281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:32.923896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.056482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:33.057477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:33.065026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.065524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.066625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.067069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.430691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:33.440521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:33.442287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:33.443648 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc2140de-93c7-4099-998a-15d1eaf5b19c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.391716 Mar 26 21:03:33.444785 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1990/3773] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:33 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:33.449988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:33.450839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:33.460898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.461606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.462559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.463153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.678968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:33.690346 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3b6153a-d507-49d1-8925-06d71681f90d tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1810 microversion: 2.1 time: 0.782489 Mar 26 21:03:33.691956 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1784/3774] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:32 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1810 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:33.697586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:33.698429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:33.706117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.706779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.707734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.710982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:33.728790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.736300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-287846f3-58c5-4cfb-b624-c4db8c0eb44b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 0.289782 Mar 26 21:03:33.744213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1991/3775] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:33 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:33.744213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:33.744547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:33.760330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.761106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:33.761932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:33.762633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:34.257376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:34.266784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:34.268365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:34.269523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88a13fce-f25e-4d96-b802-7bcec24034a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.576101 Mar 26 21:03:34.279968 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1785/3776] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:33 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:34.279968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-16305331", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1bac26e-253d-45b2-a5d6-7223981a082f"}], "security_groups": [{"name": "tempest-securitygroup--1373337636"}], "key_name": "tempest-keypair-1680823649", "user_data": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:34.341439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:34.351157 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8768272-7f9a-4a37-a081-c473ae3185c9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.610356 Mar 26 21:03:34.351956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1992/3777] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:33 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:34.473155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d0ba663a-87ff-4e27-885f-fb4dd5053a53 req-9da62a43-f338-4091-b41f-480c821aef23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e903a1-0361-4e29-ac79-3394b410f9da", "tag": "2e125957-f39c-4484-b64d-bc6303b2d621"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:34.517828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d0ba663a-87ff-4e27-885f-fb4dd5053a53 req-9da62a43-f338-4091-b41f-480c821aef23 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:34.518781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d0ba663a-87ff-4e27-885f-fb4dd5053a53 req-9da62a43-f338-4091-b41f-480c821aef23 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:34.540870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d0ba663a-87ff-4e27-885f-fb4dd5053a53 req-9da62a43-f338-4091-b41f-480c821aef23 service nova] Creating event network-changed:2e125957-f39c-4484-b64d-bc6303b2d621 for instance 41e903a1-0361-4e29-ac79-3394b410f9da on nch1-master-1 Mar 26 21:03:34.549901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d0ba663a-87ff-4e27-885f-fb4dd5053a53 req-9da62a43-f338-4091-b41f-480c821aef23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097092 Mar 26 21:03:34.551415 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1993/3778] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:34.560148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] validate_networks() for [('d1bac26e-253d-45b2-a5d6-7223981a082f', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:03:34.562395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:34.563700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:34.580726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:34.582473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:34.583942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:34.584809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.147123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:35.163352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:35.167851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:35.174796 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b09ca124-c04d-4b4a-8cea-5efb3f1a4eec tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.621396 Mar 26 21:03:35.176359 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1994/3779] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:34 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:35.184341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4a1a4dfa-4001-432f-850f-15341c31c427 req-d28c31f7-e6e0-499c-aa58-8d5bff8bada7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-deleted", "tag": "5ff04cb7-828b-45fe-9bec-656625bf9adb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:35.198046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4a1a4dfa-4001-432f-850f-15341c31c427 req-d28c31f7-e6e0-499c-aa58-8d5bff8bada7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.199319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4a1a4dfa-4001-432f-850f-15341c31c427 req-d28c31f7-e6e0-499c-aa58-8d5bff8bada7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.214706 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4a1a4dfa-4001-432f-850f-15341c31c427 req-d28c31f7-e6e0-499c-aa58-8d5bff8bada7 service nova] Creating event network-vif-deleted:5ff04cb7-828b-45fe-9bec-656625bf9adb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:35.220931 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4a1a4dfa-4001-432f-850f-15341c31c427 req-d28c31f7-e6e0-499c-aa58-8d5bff8bada7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042213 Mar 26 21:03:35.222328 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1995/3780] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:35.228838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:35.230418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:35.237218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.238658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.241120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.241916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.527718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:35.538689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b0a933c-8b8e-4a0f-833b-946f49cbd832 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1630 microversion: 2.1 time: 0.314603 Mar 26 21:03:35.552138 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1996/3781] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:35 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1630 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:35.563871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:35.564652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:35.571641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.572268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.573119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.573668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.821274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:35.839155 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-936007b0-7bd0-4f35-ae0a-78328db2b6a0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 0.285278 Mar 26 21:03:35.848352 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1997/3782] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:35 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:35.852916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e84fc511-7dc2-4d95-8c83-f8feb92f9f32 req-e5b07204-f459-4790-9f81-b1940f59c1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "44253e4b-0e65-47a7-9d9a-61ce95e7f45c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:35.865127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e84fc511-7dc2-4d95-8c83-f8feb92f9f32 req-e5b07204-f459-4790-9f81-b1940f59c1da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.866325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e84fc511-7dc2-4d95-8c83-f8feb92f9f32 req-e5b07204-f459-4790-9f81-b1940f59c1da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.881567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e84fc511-7dc2-4d95-8c83-f8feb92f9f32 req-e5b07204-f459-4790-9f81-b1940f59c1da service nova] Creating event network-vif-plugged:44253e4b-0e65-47a7-9d9a-61ce95e7f45c for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:35.887331 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e84fc511-7dc2-4d95-8c83-f8feb92f9f32 req-e5b07204-f459-4790-9f81-b1940f59c1da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039322 Mar 26 21:03:35.888426 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1998/3783] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:35.894633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:35.895984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:35.905616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.906235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.907038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.907630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.971771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:03:35.972331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:03:35.972832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:03:35.973324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:03:35.973811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:03:35.984461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.985359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:35.986311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:35.986983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.006412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:36.012139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:36.031480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:03:36.042718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:03:36.143818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-767fa925-74c2-436f-8380-71b4938cd8fa tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.871625 Mar 26 21:03:36.149714 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1786/3784] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:03:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:03:36.150523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:36.151957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:36.162395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.163666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.165460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.166042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.248567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.260010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.262148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.264397 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5cfc7c39-5527-4a61-a805-a8d6f52a9183 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.374691 Mar 26 21:03:36.276608 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 1999/3785] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:35 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:36.284962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93d0aae5-630a-49e1-afa1-5ad1b191015f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:36.285963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93d0aae5-630a-49e1-afa1-5ad1b191015f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:36.403347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-93d0aae5-630a-49e1-afa1-5ad1b191015f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.415511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93d0aae5-630a-49e1-afa1-5ad1b191015f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1236 microversion: 2.1 time: 0.137331 Mar 26 21:03:36.417039 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2000/3786] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:36 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1236 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:36.424712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:36.425805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:36.432286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.433066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.434085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.434755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.709376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.722136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.723944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.725334 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-498b5f7f-71dd-4478-b787-c69526ff5434 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.306638 Mar 26 21:03:36.726392 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2001/3787] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:36 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:36.732019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:36.733590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:36.740083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.740751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.741737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.742192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.755880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.774337 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4321e8f1-b3c3-4a8f-9142-f7c8beb28302 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.625606 Mar 26 21:03:36.777020 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1787/3788] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:36 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:36.857227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:36.858151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:36.868657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.869154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.869949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:36.870398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:36.942034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:36.955849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd23291b-475c-457c-8da0-9e0992928c6c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 200 len: 1609 microversion: 2.1 time: 0.227219 Mar 26 21:03:36.957234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2002/3789] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:36 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 1609 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:37.233381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:37.246452 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44e07f23-147b-4351-ae40-04e1c8968c87 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 0.392243 Mar 26 21:03:37.247147 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1788/3790] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:36 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:37.282757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:37.282891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7578addd-65e3-4431-a2d6-b624c11755ee req-ad15313c-c162-47e0-979b-fff69f524ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-deleted", "tag": "93931704-6fea-4515-a6df-884b6c68ddcb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:37.283377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:37.290972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7578addd-65e3-4431-a2d6-b624c11755ee req-ad15313c-c162-47e0-979b-fff69f524ce7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.291701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7578addd-65e3-4431-a2d6-b624c11755ee req-ad15313c-c162-47e0-979b-fff69f524ce7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.299534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.300153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.300955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.301407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.304943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7578addd-65e3-4431-a2d6-b624c11755ee req-ad15313c-c162-47e0-979b-fff69f524ce7 service nova] Creating event network-vif-deleted:93931704-6fea-4515-a6df-884b6c68ddcb for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:37.312232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7578addd-65e3-4431-a2d6-b624c11755ee req-ad15313c-c162-47e0-979b-fff69f524ce7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Mar 26 21:03:37.313415 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1789/3791] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:03:37.439968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:37.441435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:37.453187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.456106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.458664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.460136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.670223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:37.682560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c37defcb-95a2-4f25-ad3f-60ea8be8262d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1288 microversion: 2.1 time: 0.252363 Mar 26 21:03:37.699455 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1790/3792] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:37 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1288 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:37.745935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:37.746977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:37.768964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.770758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.773181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.774879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.813760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:37.825265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:37.833058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:37.834424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0686526-78c8-46c3-a711-7048daacb1ff tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.555694 Mar 26 21:03:37.836382 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2003/3793] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:37 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:37.850194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:37.851149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:37.861165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.866455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:37.867983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:37.869883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.168067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.176600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9138f88-334a-4b34-a515-e8eec141dbdf tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.338368 Mar 26 21:03:38.177442 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2004/3794] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:37 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:38.183820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "df90cff0-cb5b-4aad-bb76-1204dc22e346"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "b5ab341d-bc21-496a-8125-8e90f4b08572"}, {"server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "name": "network-vif-plugged", "status": "completed", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "5a5ac11b-6501-4f2a-b826-a2beff85eb24"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-plugged", "status": "completed", "tag": "6ce9015d-d518-4977-9578-35a0aacefd54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:38.196603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.197146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.212477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:df90cff0-cb5b-4aad-bb76-1204dc22e346 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:38.213354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:b5ab341d-bc21-496a-8125-8e90f4b08572 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:38.214098 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:03:38.214840 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:38.215415 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:5a5ac11b-6501-4f2a-b826-a2beff85eb24 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:38.216012 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] Creating event network-vif-plugged:6ce9015d-d518-4977-9578-35a0aacefd54 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:38.231469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-772a64e7-d960-47fb-a347-fd686a5a62ac req-d4e683ae-f5f4-4cf8-a7c6-6f528855c5f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.051749 Mar 26 21:03:38.233074 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2005/3795] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:38.240259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:38.241177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:38.251674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.253918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.255876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.257892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.288067 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. Mar 26 21:03:38.289681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:38.290890 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22fbfe42-84c6-4268-8329-07dfa556a348 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 404 len: 111 microversion: 2.1 time: 0.056501 Mar 26 21:03:38.292229 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2006/3796] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:38 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:03:38.297857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:38.298722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:38.305599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.306557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.307543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.308202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.555701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.567125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b01fcd9f-1775-4050-acc2-37e12219d756 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 0.273570 Mar 26 21:03:38.571810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.579200 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2007/3797] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:38 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:38.587062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.589402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.590939 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-742c770d-790f-43dd-9526-518ded1ea73a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.849556 Mar 26 21:03:38.592090 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1791/3798] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:37 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:38.707298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:38.707949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:38.715221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.715651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.716487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.718920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.854322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:38.854951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:38.861853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.862605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.864786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:38.865483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:38.977206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:38.985508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8da18316-5e3a-4f4d-9bb8-c836339d06e9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.282143 Mar 26 21:03:38.995142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2008/3799] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:38 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:39.194704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:39.195427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:39.213173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.213969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.214996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.215610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.216903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:39.240341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:39.241895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:39.255400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61443a76-bdf0-4049-a73b-15ca73306e07 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1407 microversion: 2.20 time: 0.392815 Mar 26 21:03:39.270624 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1792/3800] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:38 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:39.339741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ee9ab804-88d9-41f0-8b35-6814cb15d7c7 req-ae2747ee-351c-4d93-8e8a-2c315574ed9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52870f4d-c936-4967-a1c4-8db0e2de5de0", "name": "network-vif-deleted", "tag": "9c3e2f7e-9048-4ff3-afdd-38b6b8876db3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:39.350970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee9ab804-88d9-41f0-8b35-6814cb15d7c7 req-ae2747ee-351c-4d93-8e8a-2c315574ed9a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.353813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee9ab804-88d9-41f0-8b35-6814cb15d7c7 req-ae2747ee-351c-4d93-8e8a-2c315574ed9a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.371644 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ee9ab804-88d9-41f0-8b35-6814cb15d7c7 req-ae2747ee-351c-4d93-8e8a-2c315574ed9a service nova] Creating event network-vif-deleted:9c3e2f7e-9048-4ff3-afdd-38b6b8876db3 for instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 on nch2-master-1 Mar 26 21:03:39.378881 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ee9ab804-88d9-41f0-8b35-6814cb15d7c7 req-ae2747ee-351c-4d93-8e8a-2c315574ed9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049049 Mar 26 21:03:39.380525 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1793/3801] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:39.612955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:39.613787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:39.627527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.629545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.630649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.632502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.672317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:39.687396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e757217-f83b-4297-93ef-4093a71ba90d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.491232 Mar 26 21:03:39.688335 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2009/3802] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:39 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:39.695224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:39.695966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:39.713559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.714095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:39.718543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:39.718543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:40.038317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:40.075618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:40.078463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:40.086196 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-549a7cd3-8ce7-4b04-8ce4-8cc357b2ed5b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 1873 microversion: 2.32 time: 0.394749 Mar 26 21:03:40.086994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2010/3803] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:39 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 1873 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:40.105998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:40.106670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:40.137317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:40.139388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:40.143822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:40.146500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:40.535421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:40.546930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edc9bcb2-ff86-42f3-9b6b-2a741135a307 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.457546 Mar 26 21:03:40.551677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2011/3804] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:40 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:40.565513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-80b27ccb-4e26-40b3-b2d1-18a04405f578 req-d356a9dc-605c-4c6c-a047-22d6d493b725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e903a1-0361-4e29-ac79-3394b410f9da", "name": "network-vif-plugged", "status": "completed", "tag": "2e125957-f39c-4484-b64d-bc6303b2d621"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:40.587778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-80b27ccb-4e26-40b3-b2d1-18a04405f578 req-d356a9dc-605c-4c6c-a047-22d6d493b725 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:40.588299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-80b27ccb-4e26-40b3-b2d1-18a04405f578 req-d356a9dc-605c-4c6c-a047-22d6d493b725 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:40.609691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-80b27ccb-4e26-40b3-b2d1-18a04405f578 req-d356a9dc-605c-4c6c-a047-22d6d493b725 service nova] Creating event network-vif-plugged:2e125957-f39c-4484-b64d-bc6303b2d621 for instance 41e903a1-0361-4e29-ac79-3394b410f9da on nch1-master-1 Mar 26 21:03:40.636440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-80b27ccb-4e26-40b3-b2d1-18a04405f578 req-d356a9dc-605c-4c6c-a047-22d6d493b725 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080323 Mar 26 21:03:40.637151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2012/3805] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:40.648710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:40.649419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:40.673443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:40.674279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:40.675305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:40.675978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.002046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:41.014142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:41.015946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:41.022145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b20a95a-04a5-456e-82e7-eb5b28079829 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1599 microversion: 2.20 time: 0.381785 Mar 26 21:03:41.025910 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2013/3806] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:40 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1599 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:41.038595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:41.039215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:41.063997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.064674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.066854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.068876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.237977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:41.251332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47aa9aeb-4370-46d0-9a30-830aba0001ad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 1.653317 Mar 26 21:03:41.262871 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1794/3807] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:39 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:41.270934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-fc9a0d73-a1e9-4ff4-ab16-e7f22135f588 req-8cb31f33-c884-4f88-8fee-686a1374ad40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0441e-1bda-47d4-a6d1-9139adecc0b5", "tag": "e9dccde5-6613-4ef8-9812-952d9a6c882a"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:41.291104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fc9a0d73-a1e9-4ff4-ab16-e7f22135f588 req-8cb31f33-c884-4f88-8fee-686a1374ad40 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.294296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fc9a0d73-a1e9-4ff4-ab16-e7f22135f588 req-8cb31f33-c884-4f88-8fee-686a1374ad40 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.318427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-fc9a0d73-a1e9-4ff4-ab16-e7f22135f588 req-8cb31f33-c884-4f88-8fee-686a1374ad40 service nova] Creating event network-changed:e9dccde5-6613-4ef8-9812-952d9a6c882a for instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 on nch1-master-1 Mar 26 21:03:41.324146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-fc9a0d73-a1e9-4ff4-ab16-e7f22135f588 req-8cb31f33-c884-4f88-8fee-686a1374ad40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059697 Mar 26 21:03:41.325433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1795/3808] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:41.333462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:41.334376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:41.344339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.344914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.345834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.346634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.734946 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f0ecb126-5720-4ebb-b84b-6ab27b1aa316 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.407531 Mar 26 21:03:41.735818 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1796/3809] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:03:41 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-interface => generated 285 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:03:41.748916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:41.749578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:41.766645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.772480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.774375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:41.775835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:41.973811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:41.984285 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f090875-0f09-41a3-9a91-415196caa8dc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1680 microversion: 2.1 time: 0.954616 Mar 26 21:03:41.986746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2014/3810] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:41 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1680 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:41.999405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:42.000052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:42.018539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.020315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.021141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.021591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.309403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:42.330427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:42.336392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:42.339368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-37b70fa3-1eda-4eb0-baf7-df608e5c9372 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2824 microversion: 2.32 time: 0.602008 Mar 26 21:03:42.340753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1797/3811] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:03:41 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2824 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:42.370727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:42.371736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:42.394181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.395197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.397960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.398804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.561727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:42.574929 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6fe3f08-dac0-4ef5-9d23-1b495cbd941f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.586825 Mar 26 21:03:42.576289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2015/3812] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:41 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:42.582618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:42.586149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:42.598233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.598929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.601760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:42.602305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:42.991003 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9788242-f2a2-4dbb-8976-1cbc16f236ca tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.412043 Mar 26 21:03:42.991910 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2016/3813] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:03:42 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925/os-interface => generated 1829 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:03:43.007479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:43.008439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:43.029667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.038092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.039876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.040595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.568228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:43.581699 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8cddc2c-06e4-4403-a650-2a9186e1819d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1324 microversion: 2.1 time: 1.237319 Mar 26 21:03:43.591278 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1798/3814] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:42 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1324 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:43.592086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:43.596729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:43.611068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.611558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.612473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.612923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.746034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:43.759397 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bef6a3e5-2a1f-40d8-8763-7660f252ac0e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1657 microversion: 2.1 time: 0.752661 Mar 26 21:03:43.760622 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2017/3815] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:43 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1657 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:43.776011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ee14be9-57e1-4357-8401-c46df75146ef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:43.788145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ee14be9-57e1-4357-8401-c46df75146ef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.788145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ee14be9-57e1-4357-8401-c46df75146ef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.815331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ee14be9-57e1-4357-8401-c46df75146ef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:03:43.870882 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ee14be9-57e1-4357-8401-c46df75146ef tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.098487 Mar 26 21:03:43.873199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2018/3816] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:43 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:03:43.894064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:43.897814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:43.908556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.909355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:43.910454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:43.911258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:44.314077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:44.323911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:44.342229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25012c87-b914-4521-802f-710cf6212052 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.754248 Mar 26 21:03:44.347360 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1799/3817] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:43 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:44.347719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7436075-3004-48b3-8785-b1e73d84869c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1666 microversion: 2.1 time: 0.468392 Mar 26 21:03:44.357986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2019/3818] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:43 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1666 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:44.600559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:44.601991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:44.614340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:44.614951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:44.615759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:44.616246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.363780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:45.364568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:45.372480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.373543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.374584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.375238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.616499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:45.625421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-828fd375-75f0-4b77-a40d-8ea5c526af4d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 1.030426 Mar 26 21:03:45.626025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1800/3819] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:44 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:45.630742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:45.631459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:45.637925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.638750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.639778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.640485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.742247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:45.765721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69ba55c4-39d0-4d0c-95d6-8347b70c1dc2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.401899 Mar 26 21:03:45.774736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2020/3820] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:45 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:45.781928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:45.782671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:45.803644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.804141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:45.804926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:45.805628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.385088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:46.396920 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d841b67-0c8d-489d-9bc7-4068f72da37b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.628574 Mar 26 21:03:46.399657 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2021/3821] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:45 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:46.414973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-918340fe-f045-415a-8c9e-855e4b042cde tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1436439784", "metadata": {"": ""}}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:46.416647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-918340fe-f045-415a-8c9e-855e4b042cde tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:46.417728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-918340fe-f045-415a-8c9e-855e4b042cde tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action" status: 400 len: 170 microversion: 2.1 time: 0.007208 Mar 26 21:03:46.423221 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2022/3822] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Mar 26 21:03:46 2022] POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action => generated 170 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:03:46.428900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:46.429731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:46.437463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.438337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.439473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.440188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.481168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:46.497070 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c11de950-9e11-4d81-a179-a5adb7f8ebf6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1666 microversion: 2.1 time: 0.869709 Mar 26 21:03:46.501940 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1801/3823] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:45 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1666 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:46.648224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0c302471-ce59-46fc-8f89-7306f5e067ca req-28bb731f-cf63-4096-b9a3-0cdffc257f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:46.661872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0c302471-ce59-46fc-8f89-7306f5e067ca req-28bb731f-cf63-4096-b9a3-0cdffc257f40 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.662393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0c302471-ce59-46fc-8f89-7306f5e067ca req-28bb731f-cf63-4096-b9a3-0cdffc257f40 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.687629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0c302471-ce59-46fc-8f89-7306f5e067ca req-28bb731f-cf63-4096-b9a3-0cdffc257f40 service nova] Creating event network-changed:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:03:46.700023 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0c302471-ce59-46fc-8f89-7306f5e067ca req-28bb731f-cf63-4096-b9a3-0cdffc257f40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055579 Mar 26 21:03:46.708709 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1802/3824] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:46.784711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:46.785668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:46.802221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.802935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.804065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.804697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.814228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:46.828259 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d26d1ce3-eb6f-4166-a46a-625fb327d5a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.403564 Mar 26 21:03:46.845922 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2023/3825] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:46 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:46.851131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:46.861601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:46.886299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.889850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:46.895696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:46.896510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:47.330879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:47.346316 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96245935-ce88-43b7-82da-17a05534cbe6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.498857 Mar 26 21:03:47.351738 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2024/3826] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:46 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:47.371006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b13cbea4-c362-45a9-af44-ddcef51e105f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1398906834", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:47.373299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b13cbea4-c362-45a9-af44-ddcef51e105f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:47.374149 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b13cbea4-c362-45a9-af44-ddcef51e105f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action" status: 400 len: 938 microversion: 2.1 time: 0.007420 Mar 26 21:03:47.375148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2025/3827] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Mar 26 21:03:47 2022] POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action => generated 938 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:03:47.395529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:47.397032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:47.424648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:47.425412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:47.426388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:47.427136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:47.863206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:47.890107 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-241417a4-9fe5-48e7-bf0c-822a6e296286 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.505000 Mar 26 21:03:47.893223 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2026/3828] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:47 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:47.903488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:47.907628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:47.919660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:47.922089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:47.924809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:47.925444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.076976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:48.085426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81406c60-128d-4e1a-a9fe-573289bf27b1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 1.306527 Mar 26 21:03:48.098666 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1803/3829] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:46 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:48.099701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2010582765", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "58dca438-dba6-4190-9d3b-709df564590c"}, {"uuid": "badf551b-1c40-4815-a0fa-85fdf1998179"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:48.192646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] validate_networks() for [('58dca438-dba6-4190-9d3b-709df564590c', None, None, None, None, None), ('badf551b-1c40-4815-a0fa-85fdf1998179', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:03:48.264811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:48.276477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a444f509-e0b4-43ff-9e98-d3737df97a3d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.382089 Mar 26 21:03:48.279515 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2027/3830] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:47 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:48.293431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:48.294909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:48.313042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:48.314242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.315463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:48.318636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.650786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:48.667367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da7f247a-5e90-4aad-9c20-21a63fd6ee74 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.386289 Mar 26 21:03:48.681643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2028/3831] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:48 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:48.689051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:48.689893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:48.703872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:48.704878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.706402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:48.707025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.919143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:48.930179 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06344209-488e-4d16-b378-d1e3dc51b505 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.246165 Mar 26 21:03:48.942958 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2029/3832] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:48 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:48.942958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fa8190b1-ba03-4568-aec6-a308a43617b0 req-562ee076-496f-4ffc-8236-7f43ecb11d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c0441e-1bda-47d4-a6d1-9139adecc0b5", "name": "network-vif-plugged", "status": "completed", "tag": "e9dccde5-6613-4ef8-9812-952d9a6c882a"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:48.952327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fa8190b1-ba03-4568-aec6-a308a43617b0 req-562ee076-496f-4ffc-8236-7f43ecb11d16 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:48.952996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fa8190b1-ba03-4568-aec6-a308a43617b0 req-562ee076-496f-4ffc-8236-7f43ecb11d16 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:48.971435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fa8190b1-ba03-4568-aec6-a308a43617b0 req-562ee076-496f-4ffc-8236-7f43ecb11d16 service nova] Creating event network-vif-plugged:e9dccde5-6613-4ef8-9812-952d9a6c882a for instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 on nch1-master-1 Mar 26 21:03:48.977999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fa8190b1-ba03-4568-aec6-a308a43617b0 req-562ee076-496f-4ffc-8236-7f43ecb11d16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044415 Mar 26 21:03:48.979555 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2030/3833] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:48.988372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48bcf769-ac9d-47b5-b3be-6f0c9fc1000f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:48.990528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48bcf769-ac9d-47b5-b3be-6f0c9fc1000f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:48.991725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48bcf769-ac9d-47b5-b3be-6f0c9fc1000f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action" status: 400 len: 619 microversion: 2.1 time: 0.010900 Mar 26 21:03:48.992451 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2031/3834] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Mar 26 21:03:48 2022] POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:03:49.002660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f12b2a07-fcbd-421b-abff-f818befe16cf req-461096a1-c80f-4592-a130-aecd5b054f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "tag": "52c8eed7-3c91-43b3-9001-30b914ea4cd7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:49.014553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f12b2a07-fcbd-421b-abff-f818befe16cf req-461096a1-c80f-4592-a130-aecd5b054f74 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.014721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f12b2a07-fcbd-421b-abff-f818befe16cf req-461096a1-c80f-4592-a130-aecd5b054f74 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.030432 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f12b2a07-fcbd-421b-abff-f818befe16cf req-461096a1-c80f-4592-a130-aecd5b054f74 service nova] Creating event network-changed:52c8eed7-3c91-43b3-9001-30b914ea4cd7 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:03:49.039176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f12b2a07-fcbd-421b-abff-f818befe16cf req-461096a1-c80f-4592-a130-aecd5b054f74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040917 Mar 26 21:03:49.039176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2032/3835] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:49.046103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:49.046909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:49.054772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.055547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.056534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.057142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.280668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:49.312577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-12e5a88a-cb7e-463a-95a9-0d4eef029fa7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.264371 Mar 26 21:03:49.313155 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2033/3836] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:49 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:49.318804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:49.324646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:49.338731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.340228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.344757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.345356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.624711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:49.645081 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04827c6e-44af-41fe-90af-4634943d3f05 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.329773 Mar 26 21:03:49.672928 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2034/3837] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:49 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:49.678683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:49.681299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:49.689227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.690369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:49.692196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:49.692817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.020878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:50.030820 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6fd92042-3819-48f4-baa6-7ae9069aa293 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1362 microversion: 2.1 time: 0.355495 Mar 26 21:03:50.031753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2035/3838] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:49 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:50.044314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:50.046378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:50.072343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.073841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.076304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.085776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.386796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:50.396053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f66a3762-c3f4-4cd5-a224-ee5fd78eb524 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.362718 Mar 26 21:03:50.396330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2036/3839] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:50 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:50.415201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:50.415841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:50.434592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.435839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.436866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.437484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.624511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:50.633624 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ef3a3a7-131a-4d72-9174-76432ff067f1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.236093 Mar 26 21:03:50.634717 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2037/3840] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:50 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:50.640427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:50.642234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:50.650616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.651368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.652461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.653017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.830885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:50.844038 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b89093c6-1852-4615-858a-4d47935cff01 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.207603 Mar 26 21:03:50.844575 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2038/3841] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:50 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:50.854877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1973828702"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:50.857405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:50.863953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.864421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:50.865328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:50.865772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.151885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:03:51.152509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:03:51.153106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:03:51.154945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:03:51.155495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:03:51.167134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.167751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.168823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.170807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.227737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Getting quotas for project c7ef32a79723421e847963a749a03313. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:03:51.245037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Getting quotas for user b52006e4eed04870964f3b282818c82c and project c7ef32a79723421e847963a749a03313. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:03:51.257617 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59b22e21-9c99-4de7-9a95-8e0e1b1253d3 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action" status: 202 len: 0 microversion: 2.1 time: 0.411669 Mar 26 21:03:51.264404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:03:51.267179 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2039/3842] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:50 2022] POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:03:51.268832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:03:51.282012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:51.282812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:51.315326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.315795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.327089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.327696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.375441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73860421-d65d-4b11-90f6-8e5339221108 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.279494 Mar 26 21:03:51.381724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1804/3843] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:03:51.393155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lazy-loading 'flavor' on Instance uuid 70f4d369-22fa-469b-b4f9-dca38fa6eede {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:03:51.417226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:51.418133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:51.452580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.472029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.472953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.476396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.609946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a313eb5-198c-42ed-a25e-e268af07fdd6 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.338887 Mar 26 21:03:51.616881 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2040/3844] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:51 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:03:51.640332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-203377246"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:51.642708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:51.697815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.698296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.704157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:51.704890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:51.779692 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Cannot 'createImage' instance 41e903a1-0361-4e29-ac79-3394b410f9da while it is in task_state image_snapshot Mar 26 21:03:51.784608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 409 to user: Cannot 'createImage' instance 41e903a1-0361-4e29-ac79-3394b410f9da while it is in task_state image_snapshot {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:03:51.785530 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83effb96-6c3c-4851-b4e7-cb13ea4a80b7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action" status: 409 len: 159 microversion: 2.1 time: 0.167014 Mar 26 21:03:51.793833 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2041/3845] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:51 2022] POST /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da/action => generated 159 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:03:51.811092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49744de7-54c1-489d-9db0-da911ce2a6bf tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:51.813811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49744de7-54c1-489d-9db0-da911ce2a6bf tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:51.959968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-49744de7-54c1-489d-9db0-da911ce2a6bf tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:51.967138 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49744de7-54c1-489d-9db0-da911ce2a6bf tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1213 microversion: 2.1 time: 0.171432 Mar 26 21:03:51.975047 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2042/3846] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:51 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:51.979874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:51.980535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:52.013457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.013981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.014815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.015888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.294185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:52.304709 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-858a63b8-c752-40b7-889f-5b6410140b24 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1678 microversion: 2.1 time: 0.328475 Mar 26 21:03:52.326033 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2043/3847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:51 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1678 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:52.342836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e93eb031-110c-4e64-9472-22dadd616826 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e4bfb55e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:52.534312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:52.547419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff951c29-6a49-4fc1-860d-425ce9d0180c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1548 microversion: 2.1 time: 1.155841 Mar 26 21:03:52.548055 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1805/3848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:51 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1548 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:52.568343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:52.570256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:52.580608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.581239 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e93eb031-110c-4e64-9472-22dadd616826 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/images/f705586b-621c-4db4-b117-5e959b4a838d" status: 204 len: 0 microversion: 2.1 time: 0.252164 Mar 26 21:03:52.582028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.582251 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2044/3849] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:52 2022] DELETE /compute/v2.1/images/f705586b-621c-4db4-b117-5e959b4a838d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:52.583531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.584240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.592891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:52.593822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:52.606894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.607504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.608332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.608785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.816049 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-911c8cbc-3bf8-4dca-8fd2-6be095cdec80 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254535 Mar 26 21:03:52.817343 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1806/3850] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:03:52 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:52.985416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:52.986057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:52.995628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:52.996039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:52.996967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:53.003731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:53.167229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:53.177628 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ec799c18-1a1c-4dc7-bf03-fb23b0fe9411 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1283 microversion: 2.1 time: 0.197104 Mar 26 21:03:53.178246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1807/3851] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:52 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:53.342577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:53.343202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:53.355428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:53.357156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:53.359124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:53.360614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:53.404333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:53.415845 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d621ceb-9c2a-4433-967b-cbd03916a37e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1533 microversion: 2.1 time: 0.825324 Mar 26 21:03:53.419879 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2045/3852] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:52 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1533 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:53.835532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:53.859006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d131725c-7de7-4f5b-a9db-3948b297bd43 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1661 microversion: 2.1 time: 0.520815 Mar 26 21:03:53.859872 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1808/3853] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:53 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1661 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:53.889590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:53.890861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:53.903140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:53.904136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:53.905139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:53.905748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.021373 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c7260bc-12b2-42bc-8390-c94b90ebe648 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action" status: 202 len: 0 microversion: 2.1 time: 0.144159 Mar 26 21:03:54.032986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:54.033928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:54.045068 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2046/3854] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:03:53 2022] POST /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:03:54.053371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.053830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.058058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.058694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.198202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:54.199544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:54.210398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.211268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.212345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.213132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.360479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:54.369282 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d078ca1f-358b-464c-8cd1-522b5cce789c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1271 microversion: 2.1 time: 0.178236 Mar 26 21:03:54.371008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2047/3855] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:54 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:54.433965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:54.435147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:54.441520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.441992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.442788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:54.443230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:54.876068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:54.889418 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b26ddd43-1d9c-4af8-a1ca-d8f72a809533 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1539 microversion: 2.1 time: 0.459407 Mar 26 21:03:54.890825 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2048/3856] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:54 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1539 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:54.908429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:54.918760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7111da19-3417-4443-a091-9d385d6911a1 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1667 microversion: 2.1 time: 0.890922 Mar 26 21:03:54.925909 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1809/3857] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:54 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1667 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:55.388628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:55.389249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:55.402166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.402435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.408327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.409022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.592876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1ab14047-daf7-46a3-987d-0cb55c01ae1f req-a19500c4-766d-46c5-b70a-89218c8ea4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0441e-1bda-47d4-a6d1-9139adecc0b5", "tag": "e9dccde5-6613-4ef8-9812-952d9a6c882a"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:55.618631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1ab14047-daf7-46a3-987d-0cb55c01ae1f req-a19500c4-766d-46c5-b70a-89218c8ea4cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.619343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1ab14047-daf7-46a3-987d-0cb55c01ae1f req-a19500c4-766d-46c5-b70a-89218c8ea4cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.631400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1ab14047-daf7-46a3-987d-0cb55c01ae1f req-a19500c4-766d-46c5-b70a-89218c8ea4cf service nova] Creating event network-changed:e9dccde5-6613-4ef8-9812-952d9a6c882a for instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 on nch1-master-1 Mar 26 21:03:55.645494 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1ab14047-daf7-46a3-987d-0cb55c01ae1f req-a19500c4-766d-46c5-b70a-89218c8ea4cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056844 Mar 26 21:03:55.646452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1810/3858] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:55.722978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:55.732964 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6465edd9-452e-4f95-b4a0-02a249725a43 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1313 microversion: 2.1 time: 0.349972 Mar 26 21:03:55.734133 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2049/3859] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:55 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:55.748127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6ce4c7d0-b488-4606-b0a1-de15a306bf9e req-6cd1ee3c-4b92-44b5-b659-c78277b6c6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e903a1-0361-4e29-ac79-3394b410f9da", "name": "network-vif-plugged", "status": "completed", "tag": "2e125957-f39c-4484-b64d-bc6303b2d621"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:03:55.760512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ce4c7d0-b488-4606-b0a1-de15a306bf9e req-6cd1ee3c-4b92-44b5-b659-c78277b6c6a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.761200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ce4c7d0-b488-4606-b0a1-de15a306bf9e req-6cd1ee3c-4b92-44b5-b659-c78277b6c6a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.773886 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6ce4c7d0-b488-4606-b0a1-de15a306bf9e req-6cd1ee3c-4b92-44b5-b659-c78277b6c6a7 service nova] Creating event network-vif-plugged:2e125957-f39c-4484-b64d-bc6303b2d621 for instance 41e903a1-0361-4e29-ac79-3394b410f9da on nch1-master-1 Mar 26 21:03:55.784937 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6ce4c7d0-b488-4606-b0a1-de15a306bf9e req-6cd1ee3c-4b92-44b5-b659-c78277b6c6a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040921 Mar 26 21:03:55.785863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1811/3860] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:03:55.909485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:55.910111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:55.916422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.917094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.917889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.918339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.944900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:55.946530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:55.960390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.961563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:55.962668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:55.964240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.175447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:56.183285 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f6aef36-02ef-470b-b4d7-ef82a4422737 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1521 microversion: 2.1 time: 0.277622 Mar 26 21:03:56.184595 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2050/3861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:55 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:56.199814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:56.200963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:56.211646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.212430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.213548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.214272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.249389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:03:56.350335 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94f0ee58-584b-4ccb-8014-8f3066970d30 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 204 len: 0 microversion: 2.1 time: 0.153679 Mar 26 21:03:56.357245 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2051/3862] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:56 2022] DELETE /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:03:56.368301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:56.369279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:56.382140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.382913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.385191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.388119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.570888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:56.582526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e487188b-4859-41ef-a289-369b7468c5db tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1667 microversion: 2.1 time: 0.644406 Mar 26 21:03:56.585437 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1812/3863] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:55 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1667 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:56.751112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:56.751300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:56.753821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:56.759045 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58f296f5-dba9-4c92-ba5e-578bd9edfb8a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1527 microversion: 2.1 time: 0.398460 Mar 26 21:03:56.761026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.761731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:56.765924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2052/3864] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:56 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1527 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:56.770610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:56.771349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:57.515319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:57.524263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e37f147-f822-411d-a9fb-de2b7917bb68 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1313 microversion: 2.1 time: 0.777518 Mar 26 21:03:57.525778 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1813/3865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:56 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:57.607302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:57.609878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:57.624878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:57.628002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:57.630025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:57.631244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:57.785257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:57.786557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:57.813012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:57.813618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:57.815343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:57.816614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.050875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:58.061880 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-43beff60-43d1-4d7c-a805-1ac95cabe177 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.465070 Mar 26 21:03:58.063316 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2053/3866] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:57 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:58.082623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:58.089549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:58.096570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.097028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.097901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.098416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.286998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:58.296250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a1a2f361-24d9-4cfe-9fdc-d48f288450ca tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1527 microversion: 2.1 time: 0.518568 Mar 26 21:03:58.296843 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1814/3867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:57 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1527 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:03:58.330573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:58.338911 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08e4b183-8927-4831-a120-3eee05d9dfb5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1670 microversion: 2.1 time: 0.261619 Mar 26 21:03:58.339522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2054/3868] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:58 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1670 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:58.359014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:58.359552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:58.366478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.367185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.368361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.368996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.399139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:03:58.408775 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Working on deleting snapshot a85d4b81-20e6-444b-bd82-3ec93cdb8eed from shelved instance... Mar 26 21:03:58.543285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:58.544447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:58.553139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.553601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.554478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:58.554922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:58.935907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:58.944057 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10df3c60-3d6d-485c-8128-58ac398a004f tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.405122 Mar 26 21:03:58.944966 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2055/3869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:58 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:59.222224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Doing local delete in cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141580) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 26 21:03:59.223372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:59.224179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:59.225307 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 26 21:03:59.232625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] deallocate_for_instance() {{(pid=141580) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 26 21:03:59.321412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:03:59.322657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:03:59.340838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:59.343091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:59.344493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:03:59.346521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:03:59.917739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:03:59.947098 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93e0ebb0-b754-401a-8df6-d765284f55a7 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 200 len: 1527 microversion: 2.1 time: 0.634459 Mar 26 21:03:59.959302 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2056/3870] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:03:59 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 1527 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:03:59.985231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-feea95ce-41dd-4e75-9d59-f3e34b6d63e5 req-30ac43f6-2d2a-48e8-a858-3b3c158a66f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e903a1-0361-4e29-ac79-3394b410f9da", "name": "network-vif-deleted", "tag": "2e125957-f39c-4484-b64d-bc6303b2d621"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:00.040924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-feea95ce-41dd-4e75-9d59-f3e34b6d63e5 req-30ac43f6-2d2a-48e8-a858-3b3c158a66f8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:00.042801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-feea95ce-41dd-4e75-9d59-f3e34b6d63e5 req-30ac43f6-2d2a-48e8-a858-3b3c158a66f8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:00.079193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-feea95ce-41dd-4e75-9d59-f3e34b6d63e5 req-30ac43f6-2d2a-48e8-a858-3b3c158a66f8 service nova] Creating event network-vif-deleted:2e125957-f39c-4484-b64d-bc6303b2d621 for instance 41e903a1-0361-4e29-ac79-3394b410f9da on nch1-master-1 Mar 26 21:04:00.092315 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-feea95ce-41dd-4e75-9d59-f3e34b6d63e5 req-30ac43f6-2d2a-48e8-a858-3b3c158a66f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133601 Mar 26 21:04:00.095701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2057/3871] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:00.110883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:00.128759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:00.141095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:00.141629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:00.142789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:00.143368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:00.703805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:00.717436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88c79161-fbf6-4f4f-92d6-9135e8f3ab82 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.613935 Mar 26 21:04:00.719560 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2058/3872] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:00 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:00.872987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Updating instance_info_cache with network_info: [] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 21:04:00.967563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:00.968638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:00.979622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:00.982763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:00.983819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:00.985299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.017586 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. Mar 26 21:04:01.026580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:01.029216 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca698021-cd8f-426a-9733-95c780d52a96 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 404 len: 111 microversion: 2.1 time: 0.065960 Mar 26 21:04:01.031563 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2059/3873] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:00 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:01.041529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'create', calling method: .version_select at 0x7f6e4be9f4c0>, body: {"keypair": {"name": "tempest-keypair-337609790"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:01.084163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for project 3652534f0b48491f895462536365ef07. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:01.108295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for user cbbebd48cec04499a06386f886c8f99c and project 3652534f0b48491f895462536365ef07. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:01.338427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for project 3652534f0b48491f895462536365ef07. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:01.346483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for user cbbebd48cec04499a06386f886c8f99c and project 3652534f0b48491f895462536365ef07. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:01.366775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0d02ce30-c5c3-4b82-a54f-41f1f6c30882 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.328578 Mar 26 21:04:01.371606 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2060/3874] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:04:01 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:01.737376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:01.738271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:01.752051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.752515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.753214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cbd2d6f3-8840-4231-84da-69f5b721066e tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 204 len: 0 microversion: 2.1 time: 3.398358 Mar 26 21:04:01.753377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.753768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.753907 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1815/3875] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:03:58 2022] DELETE /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 0 bytes in 3400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:01.766939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:01.767667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:01.775081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.775554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.776801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.777470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.801419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 could not be found. Mar 26 21:04:01.804285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 404 to user: Instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:01.806029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-91f63aaa-0db6-462d-9bb0-e332103dc579 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8" status: 404 len: 111 microversion: 2.1 time: 0.044344 Mar 26 21:04:01.811222 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1816/3876] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:01 2022] GET /compute/v2.1/servers/dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:01.818689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:01.820313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:01.830775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.832193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.834255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:01.834983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:01.885778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:02.061040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b4e75cc-4a21-4a60-a9dd-6676065a1e3c tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 204 len: 0 microversion: 2.1 time: 0.247800 Mar 26 21:04:02.063626 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1817/3877] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:01 2022] DELETE /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:02.077678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:02.078414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:02.099884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:02.100377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:02.101190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:02.101640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:02.419662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:02.428389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fbbf4c3d-d2fd-464b-8150-7dc011d2b4b0 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.695723 Mar 26 21:04:02.438962 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2061/3878] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:01 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:02.444281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "tag": "23dc7706-4cb5-4b0b-a08e-4821dcac60fb"}, {"server_uuid": "dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8", "name": "network-vif-deleted", "tag": "dcaf364f-32ed-4913-b91e-3c3ff9f85e80"}, {"name": "network-changed", "server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "tag": "8f25af91-ddf8-43d9-bd4b-da9de00414d9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:02.450054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:02.454883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:02.455907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:02.457977 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-195d509f-06de-4ada-a260-ef01de3b3dd2 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1465 microversion: 2.1 time: 0.388350 Mar 26 21:04:02.458502 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1818/3879] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:02 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1465 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:02.480612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Creating event network-changed:23dc7706-4cb5-4b0b-a08e-4821dcac60fb for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:02.481164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_external_events [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Unable to find a host for instance dd0e9018-de3b-4fb7-98b3-2ca0cd10fdc8. Dropping event network-vif-deleted {{(pid=141581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 26 21:04:02.482623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] Creating event network-changed:8f25af91-ddf8-43d9-bd4b-da9de00414d9 for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:02.489332 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b04cfd33-1234-48d1-ae51-eb7e91ccbc93 req-3617a780-d0d5-4b4d-abd9-7f327fb1302a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 514 microversion: 2.1 time: 0.048220 Mar 26 21:04:02.490047 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2062/3880] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 514 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 26 21:04:03.455528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:03.457789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:03.477330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:03.478704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:03.486212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:03.489122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:03.499435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:03.506681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:03.507560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:03.508520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:03.508998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:03.512160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:03.966886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:03.980317 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad5ccb2e-67d9-4a07-bb85-cc8b5af9a45b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1465 microversion: 2.1 time: 0.508440 Mar 26 21:04:03.981618 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2063/3881] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:03 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1465 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:04.219936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:04.252943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-780e1840-a740-47be-b50f-3e33e08198b8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.800670 Mar 26 21:04:04.256632 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1819/3882] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:03 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:04.879847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ff2fe087-d124-4d45-8b85-ab36bbc16f99 req-eaab96e7-2066-41ae-b272-77d334b69d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d592c622-2697-4d42-9596-2206cecec6fc", "name": "network-vif-deleted", "tag": "470cb57e-9e38-439d-8123-521c30a5d964"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:04.944330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ff2fe087-d124-4d45-8b85-ab36bbc16f99 req-eaab96e7-2066-41ae-b272-77d334b69d29 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:04.946022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ff2fe087-d124-4d45-8b85-ab36bbc16f99 req-eaab96e7-2066-41ae-b272-77d334b69d29 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:04.987565 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ff2fe087-d124-4d45-8b85-ab36bbc16f99 req-eaab96e7-2066-41ae-b272-77d334b69d29 service nova] Creating event network-vif-deleted:470cb57e-9e38-439d-8123-521c30a5d964 for instance d592c622-2697-4d42-9596-2206cecec6fc on nch2-master-1 Mar 26 21:04:04.999794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:05.002501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:05.021013 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ff2fe087-d124-4d45-8b85-ab36bbc16f99 req-eaab96e7-2066-41ae-b272-77d334b69d29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149524 Mar 26 21:04:05.021749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:05.022223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:05.023036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:05.027735 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2064/3883] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:05.028838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:05.258494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:05.272917 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae210b3d-4a5f-45cf-9598-77000deeca69 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 200 len: 1299 microversion: 2.1 time: 0.278840 Mar 26 21:04:05.274962 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1820/3884] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:04 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:05.285207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:05.287255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:05.303137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:05.306053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:05.308701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:05.311597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:05.912424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:05.924776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5b68f477-f3f1-42a6-b45e-3ffad0da3343 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.657950 Mar 26 21:04:05.956301 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2065/3885] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:05 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:06.045149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-703869150", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:06.148223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] validate_networks() for [('29a33636-1c6f-4164-b055-8f1a3b4ee463', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:04:06.290582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:06.291283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: d592c622-2697-4d42-9596-2206cecec6fc] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:06.305431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.306235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.315339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.321343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.355900 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance d592c622-2697-4d42-9596-2206cecec6fc could not be found. Mar 26 21:04:06.362436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 404 to user: Instance d592c622-2697-4d42-9596-2206cecec6fc could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:06.364461 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e42cd25-ee81-4163-8dee-59797ff5e753 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc" status: 404 len: 111 microversion: 2.1 time: 0.078132 Mar 26 21:04:06.365852 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2066/3886] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:06 2022] GET /compute/v2.1/servers/d592c622-2697-4d42-9596-2206cecec6fc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:04:06.380290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:06.381511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:06.395023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.397787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.398896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.401100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.439835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:06.558093 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c0a24ec-69a5-4dd8-8c6e-dffa032a3d84 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 204 len: 0 microversion: 2.1 time: 0.186314 Mar 26 21:04:06.560505 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2067/3887] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:06 2022] DELETE /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:04:06.574390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:06.576307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:06.587646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.588450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.589545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:06.590201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:06.961794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:06.980309 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-078b90b9-3897-477e-ab88-1d87eb77a6e7 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1506 microversion: 2.1 time: 0.414268 Mar 26 21:04:06.991816 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2068/3888] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:06 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:07.007911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:07.008911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:07.036586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:07.037395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:07.040795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:07.041502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:07.545614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:07.580112 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca68fb92-00be-49ca-8693-7eddd8cc4554 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.576200 Mar 26 21:04:07.580901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2069/3889] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:06 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:08.009506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:08.010137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:08.018618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.019364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.020439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.021092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.126633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:04:08.128402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:04:08.129926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:04:08.130744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:04:08.131698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:04:08.147657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.148493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.149944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.150807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.173721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:08.180956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for user cbbebd48cec04499a06386f886c8f99c and project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:08.196437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:04:08.200792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:04:08.266198 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0043b195-5bbe-42cb-83cf-09891d0db38d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.225641 Mar 26 21:04:08.267488 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1821/3890] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:04:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:04:08.283128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1c465936-1acb-4db9-a5d9-235e9ca2924c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:08.284514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1c465936-1acb-4db9-a5d9-235e9ca2924c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:08.439381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1c465936-1acb-4db9-a5d9-235e9ca2924c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:08.453480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1c465936-1acb-4db9-a5d9-235e9ca2924c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1224 microversion: 2.1 time: 0.179062 Mar 26 21:04:08.457948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1822/3891] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:08 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:08.598429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:08.599215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:08.625464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.629627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.636139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:08.636343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:08.640356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:08.648852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90711777-6b02-4102-a783-62cf7829e30d tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1506 microversion: 2.1 time: 0.643434 Mar 26 21:04:08.653025 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2070/3892] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:08 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:09.009757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-51b79e4b-19ad-4599-96fc-1a98e0a9dc10 req-e6792dd0-ad60-4ff9-99da-41c8bd709baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66eb7a91-bf1d-40ca-882d-97bb20634c24", "name": "network-vif-unplugged", "status": "completed", "tag": "731af6f7-c114-4f9d-be99-1eaeecb622c2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:09.026772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:09.029678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-51b79e4b-19ad-4599-96fc-1a98e0a9dc10 req-e6792dd0-ad60-4ff9-99da-41c8bd709baa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.030516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-51b79e4b-19ad-4599-96fc-1a98e0a9dc10 req-e6792dd0-ad60-4ff9-99da-41c8bd709baa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.045655 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-94f97f3d-eb5f-4b19-ac2d-7ec688791eee tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.451373 Mar 26 21:04:09.050898 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1823/3893] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:08 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:09.063859 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-51b79e4b-19ad-4599-96fc-1a98e0a9dc10 req-e6792dd0-ad60-4ff9-99da-41c8bd709baa service nova] Creating event network-vif-unplugged:731af6f7-c114-4f9d-be99-1eaeecb622c2 for instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 on nch2-master-1 Mar 26 21:04:09.092650 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-51b79e4b-19ad-4599-96fc-1a98e0a9dc10 req-e6792dd0-ad60-4ff9-99da-41c8bd709baa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087625 Mar 26 21:04:09.094230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2071/3894] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:04:09.366048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a8e57bfe-6a15-4a5d-b684-9a91d54e8e2d req-5e5b1708-0faa-4de3-87a3-d5c8e2d34347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66eb7a91-bf1d-40ca-882d-97bb20634c24", "name": "network-vif-deleted", "tag": "731af6f7-c114-4f9d-be99-1eaeecb622c2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:09.392209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a8e57bfe-6a15-4a5d-b684-9a91d54e8e2d req-5e5b1708-0faa-4de3-87a3-d5c8e2d34347 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.393075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a8e57bfe-6a15-4a5d-b684-9a91d54e8e2d req-5e5b1708-0faa-4de3-87a3-d5c8e2d34347 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.415847 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a8e57bfe-6a15-4a5d-b684-9a91d54e8e2d req-5e5b1708-0faa-4de3-87a3-d5c8e2d34347 service nova] Creating event network-vif-deleted:731af6f7-c114-4f9d-be99-1eaeecb622c2 for instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 on nch2-master-1 Mar 26 21:04:09.439755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a8e57bfe-6a15-4a5d-b684-9a91d54e8e2d req-5e5b1708-0faa-4de3-87a3-d5c8e2d34347 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078748 Mar 26 21:04:09.443388 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1824/3895] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:09.475880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:09.476880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:09.490657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.494668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.496532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.497830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.688502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:09.689374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:09.706828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.708196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.709324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.710021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.847807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:09.848744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:09.854547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lazy-loading 'fault' on Instance uuid 66eb7a91-bf1d-40ca-882d-97bb20634c24 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:04:09.979042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:09.996157 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ac62339-2a14-4797-8bfd-bf395d489c8e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1276 microversion: 2.1 time: 0.523670 Mar 26 21:04:09.998980 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2072/3896] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:09 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1276 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:10.033966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:10.051601 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-825f92df-b3d4-4536-9498-d01b2b3b43f9 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 200 len: 1304 microversion: 2.1 time: 0.381194 Mar 26 21:04:10.056031 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1825/3897] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:09 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 1304 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:10.068123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:10.069867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:10.085289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:10.085881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:10.092538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:10.093095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:10.589702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:10.604386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e07e2926-3fdc-46af-aa7d-792e549559f1 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.541117 Mar 26 21:04:10.604962 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2073/3898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:10 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:11.017733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:11.025733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:11.036871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.037547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.038697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.039356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.077207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:11.078657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 66eb7a91-bf1d-40ca-882d-97bb20634c24] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:11.100534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.102135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.105103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.107255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.129580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 could not be found. Mar 26 21:04:11.130467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 404 to user: Instance 66eb7a91-bf1d-40ca-882d-97bb20634c24 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:11.131588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca69c4eb-c0aa-4688-9ad1-2b29a0bd0076 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24" status: 404 len: 111 microversion: 2.1 time: 0.061219 Mar 26 21:04:11.133418 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2074/3899] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:11 2022] GET /compute/v2.1/servers/66eb7a91-bf1d-40ca-882d-97bb20634c24 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:04:11.144283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:11.144962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:11.152536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.154538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.155769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.156526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.204324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:11.351952 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fdbd4ade-4471-458c-961a-c23de2c846af tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 204 len: 0 microversion: 2.1 time: 0.213731 Mar 26 21:04:11.353546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2075/3900] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:11 2022] DELETE /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:11.379237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:11.382844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:11.399371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.401697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.403671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.407164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.617697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:11.632924 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22d3295e-0615-47e1-aa0a-1e9da1d87b27 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.619586 Mar 26 21:04:11.633822 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1826/3901] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:11 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:11.645986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:11.648440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:11.662198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.662661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.663460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:11.663995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:11.983200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:11.994979 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0fe4eae0-c6e3-47cc-b6bf-bc0fdec6797b tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1494 microversion: 2.1 time: 0.635976 Mar 26 21:04:11.997435 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2076/3902] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:11 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1494 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:12.004754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-83dfd281-ef32-4d9f-aa10-0c51d1a50493 req-d024916b-f35f-4fd7-9a20-61c4456e7e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "name": "network-vif-plugged", "status": "completed", "tag": "8f25af91-ddf8-43d9-bd4b-da9de00414d9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:12.054060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-83dfd281-ef32-4d9f-aa10-0c51d1a50493 req-d024916b-f35f-4fd7-9a20-61c4456e7e26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:12.056316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-83dfd281-ef32-4d9f-aa10-0c51d1a50493 req-d024916b-f35f-4fd7-9a20-61c4456e7e26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:12.084957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:12.106125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b27f4417-3436-4c09-8d4b-f5910aa432dd tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.469002 Mar 26 21:04:12.122720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1827/3903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:11 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:12.125042 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-83dfd281-ef32-4d9f-aa10-0c51d1a50493 req-d024916b-f35f-4fd7-9a20-61c4456e7e26 service nova] Creating event network-vif-plugged:8f25af91-ddf8-43d9-bd4b-da9de00414d9 for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:12.132709 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-83dfd281-ef32-4d9f-aa10-0c51d1a50493 req-d024916b-f35f-4fd7-9a20-61c4456e7e26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133884 Mar 26 21:04:12.133565 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2077/3904] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:12.664185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:12.664616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:12.680276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:12.680738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:12.681525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:12.681963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.035805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:13.037198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:13.058021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:13.058673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.060925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:13.062393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.536826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:13.554530 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-81d2cabb-e1ab-46f8-b643-390c811f62da tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 200 len: 1494 microversion: 2.1 time: 0.536285 Mar 26 21:04:13.556651 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2078/3905] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:13 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 1494 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:13.570241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:13.571157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:13.583662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:13.584740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.587688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:13.588499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.838305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:13.853533 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2052dd2b-e5d7-4236-baa5-927eee256b5d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 1.205313 Mar 26 21:04:13.855428 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1828/3906] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:12 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:13.869416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-918022c0-fdbc-424b-9a60-8a4f3daba5f6 req-455ead2f-da16-4f17-bae9-aba077cfbb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35d639d-4539-4055-a7b0-8aedab45bc8b", "tag": "04895254-7ae4-4fb2-ae0f-cb9ac5f3553f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:13.908108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-918022c0-fdbc-424b-9a60-8a4f3daba5f6 req-455ead2f-da16-4f17-bae9-aba077cfbb9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:13.908528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-918022c0-fdbc-424b-9a60-8a4f3daba5f6 req-455ead2f-da16-4f17-bae9-aba077cfbb9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:13.921668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-918022c0-fdbc-424b-9a60-8a4f3daba5f6 req-455ead2f-da16-4f17-bae9-aba077cfbb9b service nova] Creating event network-changed:04895254-7ae4-4fb2-ae0f-cb9ac5f3553f for instance a35d639d-4539-4055-a7b0-8aedab45bc8b on nch2-master-1 Mar 26 21:04:13.927666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-918022c0-fdbc-424b-9a60-8a4f3daba5f6 req-455ead2f-da16-4f17-bae9-aba077cfbb9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069397 Mar 26 21:04:13.929051 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1829/3907] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:14.048165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:14.061394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b833f22-68d6-45e2-994f-9d2813e2da4c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.502465 Mar 26 21:04:14.064784 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2079/3908] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:13 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:14.213100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6ed0d738-ce5b-426f-893e-4e153d334d48 req-284ae9af-f878-47dd-b8fa-adbdc1b6a3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "name": "network-vif-plugged", "status": "completed", "tag": "23dc7706-4cb5-4b0b-a08e-4821dcac60fb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:14.251683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ed0d738-ce5b-426f-893e-4e153d334d48 req-284ae9af-f878-47dd-b8fa-adbdc1b6a3ec service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.254878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ed0d738-ce5b-426f-893e-4e153d334d48 req-284ae9af-f878-47dd-b8fa-adbdc1b6a3ec service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.304958 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6ed0d738-ce5b-426f-893e-4e153d334d48 req-284ae9af-f878-47dd-b8fa-adbdc1b6a3ec service nova] Creating event network-vif-plugged:23dc7706-4cb5-4b0b-a08e-4821dcac60fb for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:14.334363 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6ed0d738-ce5b-426f-893e-4e153d334d48 req-284ae9af-f878-47dd-b8fa-adbdc1b6a3ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127687 Mar 26 21:04:14.338125 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1830/3909] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:14.577247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:14.577889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 9520886e-3914-4f48-a3dd-ab467f45feff] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:14.592510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.595194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.597025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.599431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.639386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance 9520886e-3914-4f48-a3dd-ab467f45feff could not be found. Mar 26 21:04:14.641263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 404 to user: Instance 9520886e-3914-4f48-a3dd-ab467f45feff could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:14.642439 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0bd6a961-e514-4bb6-8cf6-5a44f8fb8788 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff" status: 404 len: 111 microversion: 2.1 time: 0.073332 Mar 26 21:04:14.645135 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2080/3910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:14 2022] GET /compute/v2.1/servers/9520886e-3914-4f48-a3dd-ab467f45feff => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:14.656559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:14.657554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:14.673674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.675367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.676687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.677393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.714154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:14.875583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:14.877079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:14.886479 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd990d04-e473-4894-b2d2-9a1156bf4a26 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 204 len: 0 microversion: 2.1 time: 0.236326 Mar 26 21:04:14.888854 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1831/3911] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:14 2022] DELETE /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:14.899567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:14.900890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:14.912110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.913812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.915133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.923322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.956140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.958826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:14.963866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:14.969650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:15.416266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:15.449714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e50314c8-653b-4b5b-b42c-c4968c9ed861 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.580657 Mar 26 21:04:15.461469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2081/3912] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:14 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:15.482060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:15.482846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:15.494336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:15.499366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:15.500567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:15.501259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:15.544486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:15.553214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0e502923-6895-45d8-9eeb-e7b93c6268e5 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1676 microversion: 2.1 time: 0.659814 Mar 26 21:04:15.562318 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1832/3913] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:14 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1676 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:15.985895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6ff97549-4917-4198-911d-6e3f66a6165d req-a9e6737e-2426-426b-a6e6-1a8e0285b0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9520886e-3914-4f48-a3dd-ab467f45feff", "name": "network-vif-deleted", "tag": "70a83fdf-b383-49e1-962f-77e816017e97"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:16.003099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ff97549-4917-4198-911d-6e3f66a6165d req-a9e6737e-2426-426b-a6e6-1a8e0285b0d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:16.003476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6ff97549-4917-4198-911d-6e3f66a6165d req-a9e6737e-2426-426b-a6e6-1a8e0285b0d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:16.065405 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6ff97549-4917-4198-911d-6e3f66a6165d req-a9e6737e-2426-426b-a6e6-1a8e0285b0d1 service nova] Creating event network-vif-deleted:70a83fdf-b383-49e1-962f-77e816017e97 for instance 9520886e-3914-4f48-a3dd-ab467f45feff on nch2-master-1 Mar 26 21:04:16.074427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6ff97549-4917-4198-911d-6e3f66a6165d req-a9e6737e-2426-426b-a6e6-1a8e0285b0d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092250 Mar 26 21:04:16.086371 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1833/3914] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:16.113639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:16.127689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e3a1d362-a22d-405f-9902-8e5fc301bc28 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1334 microversion: 2.1 time: 0.664435 Mar 26 21:04:16.128839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2082/3915] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:15 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1334 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:16.476924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:16.478705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:16.491812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:16.492586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:16.493130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:16.493662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:16.579650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:16.582488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:16.596744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:16.598868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:16.600699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:16.603935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:16.900708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:16.912091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-954bdaf8-76ad-4a70-b3d2-2d259ded0dfc tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1676 microversion: 2.1 time: 0.336358 Mar 26 21:04:16.922488 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2083/3916] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:16 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1676 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:17.146929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:17.147559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:17.159352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.162400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.166630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.167115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.291361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:17.301364 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0dfb7856-1197-44b4-b8fb-b52fcd8dbf5e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.837429 Mar 26 21:04:17.306181 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1834/3917] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:16 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:17.475801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:17.489407 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2ff33d3-7ec1-409c-80fa-c29f3ac35ea6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1670 microversion: 2.1 time: 0.340477 Mar 26 21:04:17.508706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:17.509632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:17.514320 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2084/3918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:17 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1670 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:17.527073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.530386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.532887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.536348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.605414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b1309d2d-a1a8-49b3-b595-e1d59c42cbf8 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4/ips" status: 200 len: 180 microversion: 2.1 time: 0.101653 Mar 26 21:04:17.606815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1835/3919] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:04:17 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4/ips => generated 180 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:17.621694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:17.622275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:17.650720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.651194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.657524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.659006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.760339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:17.930907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:17.931889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:17.957703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.960007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:17.964200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:17.967545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:18.014826 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-371fd18a-b94e-4a83-9645-4419d67daa79 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 204 len: 0 microversion: 2.1 time: 0.399145 Mar 26 21:04:18.015935 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2085/3920] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:17 2022] DELETE /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:18.031105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:18.035262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:18.042024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:18.042629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:18.044156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:18.044749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:18.396690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:18.408885 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e00202a4-0275-4288-9040-11a44893e245 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1676 microversion: 2.1 time: 0.482037 Mar 26 21:04:18.409655 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1836/3921] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:17 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1676 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:18.426191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:18.429220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:18.445948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:18.452175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:18.453466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:18.454114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:19.106350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:19.124703 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af316baa-489f-4d86-91ee-af4b88534310 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.710436 Mar 26 21:04:19.126273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1837/3922] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:18 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:19.168549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:19.179392 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1128126c-ed47-4f1a-900f-7e4466c49b78 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1676 microversion: 2.1 time: 1.154343 Mar 26 21:04:19.190895 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2086/3923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:18 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1676 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:19.398218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e671ab9e-3df1-40e4-8c0f-1eebfb2b61eb req-941b343a-197a-4f84-b672-ba4a8a2dc79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d369-22fa-469b-b4f9-dca38fa6eede", "name": "network-vif-deleted", "tag": "5655cd88-9896-4588-87bb-f6ba5c5c42be"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:19.427210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:19.427859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:19.450749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e671ab9e-3df1-40e4-8c0f-1eebfb2b61eb req-941b343a-197a-4f84-b672-ba4a8a2dc79a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:19.451342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e671ab9e-3df1-40e4-8c0f-1eebfb2b61eb req-941b343a-197a-4f84-b672-ba4a8a2dc79a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:19.471833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:19.472575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:19.473506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:19.473987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:19.523646 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e671ab9e-3df1-40e4-8c0f-1eebfb2b61eb req-941b343a-197a-4f84-b672-ba4a8a2dc79a service nova] Creating event network-vif-deleted:5655cd88-9896-4588-87bb-f6ba5c5c42be for instance 70f4d369-22fa-469b-b4f9-dca38fa6eede on nch1-master-1 Mar 26 21:04:19.554275 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e671ab9e-3df1-40e4-8c0f-1eebfb2b61eb req-941b343a-197a-4f84-b672-ba4a8a2dc79a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160760 Mar 26 21:04:19.561717 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1838/3924] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:19.727693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70fab8e4c45d48ea8223a3acc60a5442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d58c339cd84f6891e4545c28bb7927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:19.740864 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b286ca4-05ed-4347-ae26-2396068bc5a3 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 200 len: 1324 microversion: 2.1 time: 0.318084 Mar 26 21:04:19.753274 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2087/3925] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:19 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:20.144357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:20.145376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:20.165378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.166154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.167453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.169963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.199811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:20.200540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:20.218507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.218983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.225559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.226026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.485446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:20.500791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37d3cd01-a76b-47d9-916a-053503f20f08 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1676 microversion: 2.1 time: 0.302467 Mar 26 21:04:20.501645 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2088/3926] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:20 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:20.520849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4533776a-7c58-4828-8537-616f9262e959 req-7df90526-38e0-4c2e-94c7-706c61173b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35d639d-4539-4055-a7b0-8aedab45bc8b", "name": "network-vif-plugged", "status": "completed", "tag": "04895254-7ae4-4fb2-ae0f-cb9ac5f3553f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:20.553123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4533776a-7c58-4828-8537-616f9262e959 req-7df90526-38e0-4c2e-94c7-706c61173b9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.556961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4533776a-7c58-4828-8537-616f9262e959 req-7df90526-38e0-4c2e-94c7-706c61173b9b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.587736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4533776a-7c58-4828-8537-616f9262e959 req-7df90526-38e0-4c2e-94c7-706c61173b9b service nova] Creating event network-vif-plugged:04895254-7ae4-4fb2-ae0f-cb9ac5f3553f for instance a35d639d-4539-4055-a7b0-8aedab45bc8b on nch2-master-1 Mar 26 21:04:20.599262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:20.607701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4533776a-7c58-4828-8537-616f9262e959 req-7df90526-38e0-4c2e-94c7-706c61173b9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094175 Mar 26 21:04:20.608379 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2089/3927] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:20.625080 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80f2e6f8-a291-418c-91ca-632a555f9bd0 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.471312 Mar 26 21:04:20.625870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1839/3928] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:20 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:20.761588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:20.764268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] [instance: 70f4d369-22fa-469b-b4f9-dca38fa6eede] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:20.786119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.787452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.790052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:20.790506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:20.810064 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] HTTP exception thrown: Instance 70f4d369-22fa-469b-b4f9-dca38fa6eede could not be found. Mar 26 21:04:20.811071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Returning 404 to user: Instance 70f4d369-22fa-469b-b4f9-dca38fa6eede could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:20.813336 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2710727-6d5d-41d3-bca7-b921dbfab699 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede" status: 404 len: 111 microversion: 2.1 time: 0.058135 Mar 26 21:04:20.814610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2090/3929] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:20 2022] GET /compute/v2.1/servers/70f4d369-22fa-469b-b4f9-dca38fa6eede => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:20.823887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f45bbf4e-2264-4394-829f-089c6d9dc154 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] Calling method '.version_select at 0x7f6e59658c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:20.849335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f45bbf4e-2264-4394-829f-089c6d9dc154 tempest-ServerActionsTestJSON-717608846 tempest-ServerActionsTestJSON-717608846-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228724138" status: 202 len: 0 microversion: 2.1 time: 0.030419 Mar 26 21:04:20.860440 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1840/3930] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228724138 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:04:21.171690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:21.172780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:21.187061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.188535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.190650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.193718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.263184 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4fe60575-fb28-49f7-9070-699533237e6e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/ips" status: 200 len: 152 microversion: 2.20 time: 0.097234 Mar 26 21:04:21.267522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2091/3931] 10.222.0.16 () {60 vars in 1288 bytes} [Sat Mar 26 21:04:21 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/ips => generated 152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:04:21.521622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:21.522556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:21.535828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.536564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.540104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.542556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.617594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7a11e2de-bd9a-4695-9932-9df9258d0004 req-4ed95dcb-2693-431f-a413-a97bb59fcb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "name": "network-vif-deleted", "tag": "23dc7706-4cb5-4b0b-a08e-4821dcac60fb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:21.634304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7a11e2de-bd9a-4695-9932-9df9258d0004 req-4ed95dcb-2693-431f-a413-a97bb59fcb16 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.637191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7a11e2de-bd9a-4695-9932-9df9258d0004 req-4ed95dcb-2693-431f-a413-a97bb59fcb16 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.659354 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7a11e2de-bd9a-4695-9932-9df9258d0004 req-4ed95dcb-2693-431f-a413-a97bb59fcb16 service nova] Creating event network-vif-deleted:23dc7706-4cb5-4b0b-a08e-4821dcac60fb for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:21.686108 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7a11e2de-bd9a-4695-9932-9df9258d0004 req-4ed95dcb-2693-431f-a413-a97bb59fcb16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070513 Mar 26 21:04:21.689176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2092/3932] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:21.695470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:21.713533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:21.740634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.741259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.742528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:21.743206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:21.753041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52006e4eed04870964f3b282818c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ef32a79723421e847963a749a03313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:21.769185 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73091bf7-9064-4ef1-a16e-ac6cbd9a6de5 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 200 len: 1613 microversion: 2.1 time: 0.253903 Mar 26 21:04:21.770379 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1841/3933] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:21 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 1613 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:22.600735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:22.649642 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3f3374e-751c-45d2-9800-560709b32e40 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1324 microversion: 2.1 time: 0.953062 Mar 26 21:04:22.652924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2093/3934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:21 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1324 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:22.788802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:22.789488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:22.802620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:22.804517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:22.805935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:22.808057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:22.849369 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. Mar 26 21:04:22.851167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:22.854332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cc47e505-5c17-44c3-a991-9a5eb86e8929 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 404 len: 111 microversion: 2.1 time: 0.069861 Mar 26 21:04:22.861003 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1842/3935] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:22 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:23.631556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:23.632148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:23.655306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:23.655847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:23.658044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:23.658960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:23.676262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:23.678340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:23.695354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:23.698075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:23.698906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:23.704816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:23.772651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lazy-loading 'flavor' on Instance uuid 39b61f71-6468-4d03-87ff-51120f2911c4 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:04:24.241736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dcafa3b1-5b5e-4ecc-bb91-3a91cd8ede76 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/action" status: 202 len: 0 microversion: 2.20 time: 0.616120 Mar 26 21:04:24.246634 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2094/3936] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:04:23 2022] POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:04:24.254408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:24.255879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:24.266381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:24.267561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:24.268859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:24.269515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:24.454987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:24.466254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:24.468177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:24.469893 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e07e8f15-9225-40c2-8675-76b54f6aa1cf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.221012 Mar 26 21:04:24.472438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2095/3937] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:24 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:24.484690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3ef38a25-f06d-48b4-93a0-07c8f5d67efd req-88e04a2a-5135-4306-86b5-ddfbe7328f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de0669-9de8-495a-897b-5f49433ecab4", "name": "network-vif-deleted", "tag": "8f25af91-ddf8-43d9-bd4b-da9de00414d9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:24.494217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3ef38a25-f06d-48b4-93a0-07c8f5d67efd req-88e04a2a-5135-4306-86b5-ddfbe7328f5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:24.495425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3ef38a25-f06d-48b4-93a0-07c8f5d67efd req-88e04a2a-5135-4306-86b5-ddfbe7328f5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:24.510277 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3ef38a25-f06d-48b4-93a0-07c8f5d67efd req-88e04a2a-5135-4306-86b5-ddfbe7328f5d service nova] Creating event network-vif-deleted:8f25af91-ddf8-43d9-bd4b-da9de00414d9 for instance 09de0669-9de8-495a-897b-5f49433ecab4 on nch2-master-1 Mar 26 21:04:24.523850 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3ef38a25-f06d-48b4-93a0-07c8f5d67efd req-88e04a2a-5135-4306-86b5-ddfbe7328f5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049850 Mar 26 21:04:24.524716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2096/3938] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:24.839338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:24.849329 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-243d83fe-2d8a-464b-836c-ffb68753b33f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1522 microversion: 2.1 time: 1.183004 Mar 26 21:04:24.849924 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1843/3939] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:23 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1522 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:24.880318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:24.882432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:24.899480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:24.900380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:24.902253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:24.903241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:25.164456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:25.177689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8c0ddf97-a8a4-4040-a3e7-5dbdabcbe729 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1522 microversion: 2.1 time: 0.308170 Mar 26 21:04:25.192135 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2097/3940] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:24 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:25.200302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-939362516"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:25.205841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:25.217139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:25.217622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:25.218472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:25.218923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:25.487364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:25.488133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:25.500173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:25.500805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:25.501422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:25.501869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:25.806163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:25.816239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:25.817977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:25.819871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-acb739b9-26dc-4bc4-b0c1-d9b7c81802e2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.336510 Mar 26 21:04:25.832634 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2098/3941] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:25 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:04:25.838217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c7e2aeb-1b4c-4579-9622-6aa54e20a35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b/action" status: 202 len: 0 microversion: 2.1 time: 0.644991 Mar 26 21:04:25.847379 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1844/3942] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:04:25 2022] POST /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:04:25.853720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c28da5cc-024a-48ea-8461-3c9e7bf7151b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e4be454c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:26.083815 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c28da5cc-024a-48ea-8461-3c9e7bf7151b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c" status: 204 len: 0 microversion: 2.1 time: 0.235501 Mar 26 21:04:26.085036 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2099/3943] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:25 2022] DELETE /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:04:26.101826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08b31d52-825c-41f0-8cef-9c7bf37f605d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e598ed700>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:26.125602 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-08b31d52-825c-41f0-8cef-9c7bf37f605d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Image not found. Mar 26 21:04:26.126213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08b31d52-825c-41f0-8cef-9c7bf37f605d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:26.127059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08b31d52-825c-41f0-8cef-9c7bf37f605d tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c" status: 404 len: 62 microversion: 2.1 time: 0.035048 Mar 26 21:04:26.128771 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1845/3944] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:26 2022] GET /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:04:26.137134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:26.137750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:26.144025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:26.144487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:26.145260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:26.145721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:26.315389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:26.326268 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79296059-9054-47a6-9d87-a6b10dbde02e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1534 microversion: 2.1 time: 0.192931 Mar 26 21:04:26.336828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2100/3945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:26 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1534 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:26.841171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:26.841901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:26.859337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:26.860038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:26.861340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:26.861340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:27.279506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:27.299083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:27.303774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:27.311708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3d60699-cee0-41fe-8e3d-310c6b13894f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.471924 Mar 26 21:04:27.322994 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1846/3946] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:26 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:27.345357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:27.346625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:27.358212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:27.358676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:27.359630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:27.359984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:28.185001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:28.193831 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-162c7c35-245c-43d2-9d3f-f548938e0acc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1540 microversion: 2.1 time: 0.853764 Mar 26 21:04:28.212234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2101/3947] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:27 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1540 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:28.331397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:28.338470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:28.369335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:28.369775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:28.370603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:28.371586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:29.044303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:29.054824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:29.056923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:29.058430 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90f0f3e7-9b64-4a84-982c-b8e98d61f4c0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.731084 Mar 26 21:04:29.059725 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1847/3948] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:28 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:04:29.220427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:29.221817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:29.240168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:29.240691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:29.241548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:29.242054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:29.951836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:29.963219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9aca9ce-14e2-4cc5-8ce1-db75be96de1b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1535 microversion: 2.1 time: 0.749088 Mar 26 21:04:29.977207 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2102/3949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:29 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1535 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:30.028376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.029726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:30.063708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.065682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.070009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.074840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.080262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.081128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:30.093936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.096626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.098346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.100716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.120878 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. Mar 26 21:04:30.123245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:30.124758 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fee91f78-6b55-40cb-94e3-529994e2f0f6 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 404 len: 111 microversion: 2.1 time: 0.100931 Mar 26 21:04:30.126069 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1848/3950] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:30 2022] DELETE /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:30.140633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.141487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 09de0669-9de8-495a-897b-5f49433ecab4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:30.149630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.150514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.151562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.152295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.168525 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. Mar 26 21:04:30.169492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 09de0669-9de8-495a-897b-5f49433ecab4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:30.170590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00d37c8f-99a8-4eba-b7a3-a660f857c61c tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4" status: 404 len: 111 microversion: 2.1 time: 0.040222 Mar 26 21:04:30.172422 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1849/3951] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:30 2022] GET /compute/v2.1/servers/09de0669-9de8-495a-897b-5f49433ecab4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:30.182111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.182917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:30.190441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.191179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.192254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.192905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.210696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. Mar 26 21:04:30.212483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:30.213737 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0dfd01d6-9c50-4ca9-9534-583089a82e74 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 404 len: 111 microversion: 2.1 time: 0.036266 Mar 26 21:04:30.215134 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1850/3952] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:30 2022] DELETE /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:30.226645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.232144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] [instance: 52870f4d-c936-4967-a1c4-8db0e2de5de0] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:30.244560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.245350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.247397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:30.248363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:30.265876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] HTTP exception thrown: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. Mar 26 21:04:30.267323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] Returning 404 to user: Instance 52870f4d-c936-4967-a1c4-8db0e2de5de0 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:30.268757 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a975e70d-52c5-44d5-ae18-f59bbcdf7192 tempest-ServersTestMultiNic-1359896988 tempest-ServersTestMultiNic-1359896988-project] 10.222.0.16 "GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0" status: 404 len: 111 microversion: 2.1 time: 0.048725 Mar 26 21:04:30.269555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1851/3953] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:30 2022] GET /compute/v2.1/servers/52870f4d-c936-4967-a1c4-8db0e2de5de0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:30.600914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:30.612473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:30.619141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:30.622428 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99acb16f-c1aa-456a-b2de-e120f4651dde tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.546295 Mar 26 21:04:30.624461 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2103/3954] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:30 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:30.987250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:30.988219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:31.000060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.000545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:31.001637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.002088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:31.641599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:31.642229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:31.649697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.651063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:31.652153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.653270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:31.956668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:31.965409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4351e463-5fbb-46f6-ae83-2f87177ef75b tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1522 microversion: 2.1 time: 0.982078 Mar 26 21:04:31.966000 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1852/3955] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:30 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1522 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:31.983066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:31.984050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:31.991639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.992305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:31.993342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:31.993947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:32.037431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:04:32.135651 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10ace910-4f6d-41d7-8083-a5dad3323cda tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 204 len: 0 microversion: 2.1 time: 0.156838 Mar 26 21:04:32.136764 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1853/3956] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:04:31 2022] DELETE /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:04:32.146124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:32.147012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:32.171908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:32.172753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:32.173866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:32.175420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:32.231325 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afb43c62-0180-414e-a0eb-fb897a7ff5db tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/ips" status: 200 len: 146 microversion: 2.1 time: 0.089015 Mar 26 21:04:32.231944 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1854/3957] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:04:32 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/ips => generated 146 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:32.257660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:32.258320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:32.267697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:32.268503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:32.269586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:32.270200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:32.410067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:32.420318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:32.425356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:32.431878 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b641ec1-c9d7-4c3b-9861-622ad7e96753 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.794178 Mar 26 21:04:32.432590 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2104/3958] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:31 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:32.717286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:32.727561 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb5610eb-8e74-47d3-928c-8871b4b1292c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1528 microversion: 2.1 time: 0.482415 Mar 26 21:04:32.728557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1855/3959] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:32 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1528 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:33.451953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:33.452779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:33.462781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:33.467388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:33.468481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:33.469223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:33.746531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:33.747483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:33.762739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:33.767426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:33.769787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:33.770616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:33.773420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:33.778628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:33.798036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:33.809278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4aee46d-d79c-4201-9381-5814b44d734f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.361358 Mar 26 21:04:33.826981 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2105/3960] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:33 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:34.475808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:34.486003 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0e3b8400-89d5-4265-97e7-deb72eda4292 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1528 microversion: 2.1 time: 0.744357 Mar 26 21:04:34.499011 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1856/3961] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:33 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1528 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:34.831936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:34.832775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:34.850698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:34.861224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:34.861224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:34.861224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:35.156446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:35.186996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:35.189261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:35.191513 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b5b964b-6fb9-49f0-91fc-bd63314d765f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.365341 Mar 26 21:04:35.206518 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2106/3962] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:34 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:35.361251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bc46c5-266e-44bc-843e-b5f8243721f5"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:35.365669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:35.375624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:35.376493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:35.377634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:35.378347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:35.511836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:35.512732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:35.539088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:35.539737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:35.541094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:35.541797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:35.832540 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f492cc3c-a428-4920-a776-43159333a81c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477725 Mar 26 21:04:35.834033 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1857/3963] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:04:35 2022] POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:36.045065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:36.064881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abd1b57e-c81d-45e2-a5c7-8e7ae03304a4 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1528 microversion: 2.1 time: 0.564250 Mar 26 21:04:36.077086 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2107/3964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:35 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1528 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:36.222096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:36.227548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:36.257936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:36.259083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:36.261478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:36.262954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:36.830108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:36.858804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:36.864377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:36.866357 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5fa71798-19ae-4805-a1c7-a3663a5575a2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.658307 Mar 26 21:04:36.869660 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1858/3965] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:36 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:36.918453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d368095a-32ec-4b4c-9eb8-d8173bf4def5 req-7e7a1b46-0cf1-4e18-ac1b-e6e792f9e5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35d639d-4539-4055-a7b0-8aedab45bc8b", "name": "network-vif-deleted", "tag": "04895254-7ae4-4fb2-ae0f-cb9ac5f3553f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:36.953461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d368095a-32ec-4b4c-9eb8-d8173bf4def5 req-7e7a1b46-0cf1-4e18-ac1b-e6e792f9e5c2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:36.954174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d368095a-32ec-4b4c-9eb8-d8173bf4def5 req-7e7a1b46-0cf1-4e18-ac1b-e6e792f9e5c2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:36.996442 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d368095a-32ec-4b4c-9eb8-d8173bf4def5 req-7e7a1b46-0cf1-4e18-ac1b-e6e792f9e5c2 service nova] Creating event network-vif-deleted:04895254-7ae4-4fb2-ae0f-cb9ac5f3553f for instance a35d639d-4539-4055-a7b0-8aedab45bc8b on nch2-master-1 Mar 26 21:04:37.008363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d368095a-32ec-4b4c-9eb8-d8173bf4def5 req-7e7a1b46-0cf1-4e18-ac1b-e6e792f9e5c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382957 Mar 26 21:04:37.018692 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2108/3966] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:37.091560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:37.092724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:37.111585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:37.112221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:37.118900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:37.124052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:37.280004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:37.281530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:37.282121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lazy-loading 'fault' on Instance uuid a35d639d-4539-4055-a7b0-8aedab45bc8b {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:04:37.545353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:37.555390 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-74438ddf-7c31-46f4-b3fc-4b0270c0188e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 200 len: 1314 microversion: 2.1 time: 0.475360 Mar 26 21:04:37.556839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1859/3967] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:37 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:37.890041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:37.891437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:37.899206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:37.899995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:37.901041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:37.901655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:38.212338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:38.226154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:38.228382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:38.231060 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-785097c7-effa-4395-8075-bdaa7a610e96 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.346046 Mar 26 21:04:38.232286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2109/3968] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:37 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:38.579135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:38.583888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:38.609560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:38.610955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:38.612167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:38.612686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:38.635588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. Mar 26 21:04:38.638153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:04:38.639479 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53550c23-8125-4fca-9301-e497d62ae35e tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 404 len: 111 microversion: 2.1 time: 0.068052 Mar 26 21:04:38.640557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1860/3969] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:38 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:38.821640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-332021313", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:38.900275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] validate_networks() for [('29a33636-1c6f-4164-b055-8f1a3b4ee463', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:04:39.257877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:39.258504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:39.276023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:39.276497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:39.277331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:39.277969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:39.584473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:39.597385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:39.599872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:39.601705 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19404266-121b-436e-998e-767b1001ca5b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.348618 Mar 26 21:04:39.602825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1861/3970] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:39 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:39.609121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5a9968e-eab2-47c3-91b8-86c653ab478d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:39.617782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5a9968e-eab2-47c3-91b8-86c653ab478d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:39.618552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5a9968e-eab2-47c3-91b8-86c653ab478d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:39.675853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c5a9968e-eab2-47c3-91b8-86c653ab478d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Going to try to stop instance {{(pid=141580) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:04:39.783182 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5a9968e-eab2-47c3-91b8-86c653ab478d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.178530 Mar 26 21:04:39.788753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1862/3971] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:04:39 2022] POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:04:40.199042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:04:40.200433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:04:40.201384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:04:40.202296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:04:40.202935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:04:40.218277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:40.219278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:40.220885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:40.222004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:40.252135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:40.259165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Getting quotas for user cbbebd48cec04499a06386f886c8f99c and project 3652534f0b48491f895462536365ef07. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:40.284148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:04:40.287143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:04:40.301565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-723832462", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "1ed8a85a-ba2e-4e38-8608-f7d0f831da7b"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:40.362418 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8dcad39-17ec-467c-a378-7643cf9aea07 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.547538 Mar 26 21:04:40.366432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2110/3972] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:04:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:04:40.377579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:40.379298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:40.388845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:40.389386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:40.390399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:40.390953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:40.447288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] validate_networks() for [('1ed8a85a-ba2e-4e38-8608-f7d0f831da7b', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:04:40.900045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:40.914577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8f14c9c-aa27-4700-af91-4ad5825defea tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.544822 Mar 26 21:04:40.915191 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2111/3973] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:40 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:40.929501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-931ec265-e31b-4c36-bf57-2eaf45357433 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:40.932270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-931ec265-e31b-4c36-bf57-2eaf45357433 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:41.061194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-931ec265-e31b-4c36-bf57-2eaf45357433 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:41.071320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-931ec265-e31b-4c36-bf57-2eaf45357433 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1224 microversion: 2.1 time: 0.153578 Mar 26 21:04:41.072304 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2112/3974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:40 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:41.079202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:41.080111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:41.086953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.087804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:41.103244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.104039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:41.338023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:04:41.339375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:04:41.340314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:04:41.340903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:04:41.341789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:04:41.365373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.366336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:41.368519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.369489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:41.412858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:41.427275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:41.435126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:41.436402 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6689bb10-e03b-4d7f-b073-4d4af61714b8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1745 microversion: 2.20 time: 0.362882 Mar 26 21:04:41.437129 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2113/3975] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:41 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1745 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:41.460089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Getting quotas for project b97ee3626b824293b17899943c256a52. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:41.508743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Getting quotas for user 9491de6627b346fca21989a44e262429 and project b97ee3626b824293b17899943c256a52. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:41.556236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:04:41.563139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:04:41.669679 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c2f5117-6d00-49e1-8516-863adbef0c8c tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879906 Mar 26 21:04:41.671002 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1863/3976] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:04:41.687039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8746e88-1897-4d28-8570-91d55114f079 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:41.689877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8746e88-1897-4d28-8570-91d55114f079 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:41.879785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8746e88-1897-4d28-8570-91d55114f079 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:41.888449 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8746e88-1897-4d28-8570-91d55114f079 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1227 microversion: 2.1 time: 0.206751 Mar 26 21:04:41.892133 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2114/3977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:41 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1227 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:41.945493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:41.946475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:41.977868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.979312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:41.981824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:41.984088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:42.090316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:42.090935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:42.473912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:42.493163 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbf629ed-319f-4c3c-91f8-bf1b350bb728 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.565194 Mar 26 21:04:42.495003 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1864/3978] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:41 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:42.510177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:42.511884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:42.532847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:42.553208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:42.557515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:42.562041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:42.858237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:42.859432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:42.860974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:42.861632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:43.040697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:43.061148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69c559ca-cdb9-4056-bf1b-f38fc63fcc6f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1282 microversion: 2.1 time: 0.975012 Mar 26 21:04:43.062098 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2115/3979] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:42 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1282 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:43.069182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:43.070112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:43.079779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:43.080662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:43.082541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:43.083217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:43.207905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:43.221609 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-569a327e-6c5d-4f29-9e27-b050537c7d3e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1231 microversion: 2.1 time: 0.158042 Mar 26 21:04:43.222267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2116/3980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:43 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1231 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:43.422562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:43.438994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:43.443645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:43.445437 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99407d5e-f39e-4e76-a006-b2769e3c999a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.947803 Mar 26 21:04:43.447677 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1865/3981] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:42 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:43.513716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:43.526632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:43.546866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:43.547340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:43.548840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:43.548840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.081782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:44.082414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:44.107675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.109359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.115229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.116005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.309310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:44.316499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:44.324654 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2175dd8b-7bea-4389-88a4-f3c7853f4de5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.816555 Mar 26 21:04:44.332924 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-914a2f55-b703-4880-8d50-2947a79a73ce tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1282 microversion: 2.1 time: 0.251591 Mar 26 21:04:44.337318 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2117/3982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:43 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:44.344472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-06ab0c5a-d517-4aea-870a-97d9394097d6 req-335e20bc-74e1-4e0f-a3c7-7e85e6095808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "name": "network-vif-plugged", "status": "completed", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:44.345439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1866/3983] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:44 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:44.358682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:44.364469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:44.373385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-06ab0c5a-d517-4aea-870a-97d9394097d6 req-335e20bc-74e1-4e0f-a3c7-7e85e6095808 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.375013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-06ab0c5a-d517-4aea-870a-97d9394097d6 req-335e20bc-74e1-4e0f-a3c7-7e85e6095808 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.383325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.385251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.386320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.387048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.419066 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-06ab0c5a-d517-4aea-870a-97d9394097d6 req-335e20bc-74e1-4e0f-a3c7-7e85e6095808 service nova] Creating event network-vif-plugged:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:04:44.470638 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-06ab0c5a-d517-4aea-870a-97d9394097d6 req-335e20bc-74e1-4e0f-a3c7-7e85e6095808 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131169 Mar 26 21:04:44.473962 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2118/3984] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:44.639330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:44.654906 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-083c2753-e81b-4298-aa83-0e44b9ec6aca tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1285 microversion: 2.1 time: 0.306734 Mar 26 21:04:44.657363 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1867/3985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:44 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1285 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:44.663682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:44.664653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:44.674393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.675380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.676501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:44.677614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:44.815535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1781649970", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:44.949921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:04:45.457633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:45.478230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:45.481255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:45.494964 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-824ad134-cf28-4491-b3ee-398fbce5d37e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.832762 Mar 26 21:04:45.495668 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1868/3986] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:44 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:45.511854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:45.518507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:45.540989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:45.544739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:45.546589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:45.556865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.254181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:04:46.254782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:04:46.255145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:04:46.255608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:04:46.256276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:04:46.276414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.279880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.281987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.282430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.312666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:46.315378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:04:46.321621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:04:46.322256 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e3c434b-db15-4721-8dc3-4bc828b60a85 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.825261 Mar 26 21:04:46.333197 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1869/3987] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:45 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:46.337713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:04:46.338580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:46.339230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:46.341190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:04:46.350977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.351501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.352394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.352918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.409399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1328c20b-c638-4361-a935-8da480840d58 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933624 Mar 26 21:04:46.410777 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2119/3988] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:04:46.419536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:46.420608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:46.429486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.430956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.432124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:46.432809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:46.864739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:46.881250 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ed833d1-dbe4-40b4-b6e2-9562c112c602 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.469036 Mar 26 21:04:46.881937 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2120/3989] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:46 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:46.892579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3130a7f7-7593-4702-82e7-16ffecb9fc07 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:46.895481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3130a7f7-7593-4702-82e7-16ffecb9fc07 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:47.004211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3130a7f7-7593-4702-82e7-16ffecb9fc07 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:47.011486 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3130a7f7-7593-4702-82e7-16ffecb9fc07 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1215 microversion: 2.1 time: 0.127631 Mar 26 21:04:47.016078 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2121/3990] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:46 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:47.023037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:47.024029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:47.044405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.045682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:47.046901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.048506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:47.664340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:47.679997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:47.681552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:47.682755 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0ac551b5-acda-403a-96f9-2f2f15212cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.665078 Mar 26 21:04:47.683853 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2122/3991] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:47 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:47.704954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:47.705705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:47.735381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:47.741789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.742309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:47.744609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.747332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:47.754320 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-702e98c8-85c4-425a-98a1-bdf131055cf8 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 1.418054 Mar 26 21:04:47.756059 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1870/3992] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:46 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:47.906633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:47.907279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:47.923247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.924765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:47.934666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:47.935472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.551546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:48.574793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cad0fb0-fa14-42a1-8e54-d9e257b2f223 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.889702 Mar 26 21:04:48.575988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2123/3993] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:47 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:48.582034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:48.582820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:48.590067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:48.591196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.591911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.592890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.593530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.612995 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d53f497-148c-49ec-85b7-12aaacca8828 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.716357 Mar 26 21:04:48.617152 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1871/3994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:47 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:48.702446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:48.704091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:48.710998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.718505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.722491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.731732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.852432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:48.864331 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-746fd2c0-eb82-4e33-b57d-c9c1f1713e1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1273 microversion: 2.1 time: 0.287021 Mar 26 21:04:48.865242 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2124/3995] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:48 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:48.883178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:48.883906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:48.895302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.895819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:48.896597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:48.897057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:49.748036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:49.756347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:49.769962 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3a9e5ef-460e-48af-b95d-44266614a064 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.903369 Mar 26 21:04:49.770242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:49.774116 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2125/3996] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:48 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:49.775194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:49.781447 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcf4d0c4-c634-4bcf-9e4c-fd94ba970318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 1.083928 Mar 26 21:04:49.782034 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1872/3997] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:48 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:49.791487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:49.797676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:49.801892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:49.803773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:49.813830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:49.815167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:49.817421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:49.818972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:49.819668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:49.821438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:49.823743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:49.826997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.328484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:50.349323 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4be6784d-6d3e-44a4-8edc-9a265b4cf7fd tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1723 microversion: 2.1 time: 0.570733 Mar 26 21:04:50.350292 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2126/3998] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:49 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1723 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:50.377540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:50.378252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:50.395675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.397547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.399546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.402369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.534555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:50.554383 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af8056b0-d66e-4644-b30c-6e52b01a2842 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1273 microversion: 2.1 time: 0.201649 Mar 26 21:04:50.556282 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2127/3999] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:50 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:50.565293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d73f7b17-bbb9-4770-9961-fd6d75c4d264 req-2b8fb827-4bce-48e5-b762-04f801e3ac42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ca3c6d-80db-493b-b680-579f6a6c6122", "tag": "6899fefc-bc5b-44c3-baeb-f5fc83645543"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:50.574221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:50.578632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d73f7b17-bbb9-4770-9961-fd6d75c4d264 req-2b8fb827-4bce-48e5-b762-04f801e3ac42 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.579454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d73f7b17-bbb9-4770-9961-fd6d75c4d264 req-2b8fb827-4bce-48e5-b762-04f801e3ac42 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.585477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb931945-45c1-492c-8544-909123d1c4a7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.801040 Mar 26 21:04:50.589870 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1873/4000] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:49 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:50.596475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d73f7b17-bbb9-4770-9961-fd6d75c4d264 req-2b8fb827-4bce-48e5-b762-04f801e3ac42 service nova] Creating event network-changed:6899fefc-bc5b-44c3-baeb-f5fc83645543 for instance 93ca3c6d-80db-493b-b680-579f6a6c6122 on nch2-master-1 Mar 26 21:04:50.605886 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d73f7b17-bbb9-4770-9961-fd6d75c4d264 req-2b8fb827-4bce-48e5-b762-04f801e3ac42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043676 Mar 26 21:04:50.606828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2128/4001] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:50.791045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:50.792354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:50.804736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.805195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.805990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.806438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.818355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:50.819315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:50.828712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.828712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:50.829440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:50.829896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:51.091883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:51.100951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:51.102792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:51.104116 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc7b4d68-2ba5-4662-9e1f-7345544f74b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.307268 Mar 26 21:04:51.116557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2129/4002] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:50 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:04:51.373646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:51.375015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:51.387639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:51.391136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:51.395746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:51.397951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:51.405313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:51.422742 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10e0e1d2-92b4-42ce-92b4-18d4a03367de tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.635615 Mar 26 21:04:51.432208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1874/4003] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:50 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:51.576462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:51.577544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:51.587036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:51.587885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:51.589587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:51.590349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.025938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:52.035529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-346e662b-6836-49a5-81ba-71084c1ffd5d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1700 microversion: 2.1 time: 0.671180 Mar 26 21:04:52.047530 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2130/4004] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:51 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1700 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:52.053132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:52.053752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:52.092996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.093490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.103454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.109269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.599892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:52.617098 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c2409188-b17a-433d-b2de-28764f961297 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.568168 Mar 26 21:04:52.618951 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2131/4005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:52 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:52.627038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5aaa4467-f2f6-4c94-b331-eeb3a7bb60ac tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:52.639655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5aaa4467-f2f6-4c94-b331-eeb3a7bb60ac tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.641326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5aaa4467-f2f6-4c94-b331-eeb3a7bb60ac tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.673045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5aaa4467-f2f6-4c94-b331-eeb3a7bb60ac tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:04:52.687998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:52.704125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dac1515b-d1b6-4f29-920a-8f4805964f6e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 1.132298 Mar 26 21:04:52.706425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1875/4006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:51 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:52.734567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:52.736261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:52.746651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.748129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.749189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.750254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.798807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5aaa4467-f2f6-4c94-b331-eeb3a7bb60ac tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.176043 Mar 26 21:04:52.800241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2132/4007] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:04:52 2022] POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:04:52.812483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:52.813938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:52.825281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.826312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:52.827431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:52.828203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:53.434558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:53.447948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c0695a54-0422-456f-b2b0-a03d445473e6 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.643700 Mar 26 21:04:53.451102 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2133/4008] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:52 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:53.478802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-235b4b70-ac85-4db8-8441-1f383a620000 req-913bea30-f61c-4d1a-bce9-d17f176fae24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207a5420-c546-4367-abbc-4b333b09ab7e", "tag": "b7e1d8a3-d570-4eb8-97be-9012d1e78442"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:53.491762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:53.504289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-235b4b70-ac85-4db8-8441-1f383a620000 req-913bea30-f61c-4d1a-bce9-d17f176fae24 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:53.505574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-235b4b70-ac85-4db8-8441-1f383a620000 req-913bea30-f61c-4d1a-bce9-d17f176fae24 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:53.506798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:53.511834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:53.513724 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24138798-c4ba-4c40-9362-0de7da1ce6b3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.785855 Mar 26 21:04:53.518917 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1876/4009] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:52 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:53.527014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:53.531429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:53.537429 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-235b4b70-ac85-4db8-8441-1f383a620000 req-913bea30-f61c-4d1a-bce9-d17f176fae24 service nova] Creating event network-changed:b7e1d8a3-d570-4eb8-97be-9012d1e78442 for instance 207a5420-c546-4367-abbc-4b333b09ab7e on nch2-master-1 Mar 26 21:04:53.544606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:53.545077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:53.548835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:53.549371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:53.550446 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-235b4b70-ac85-4db8-8441-1f383a620000 req-913bea30-f61c-4d1a-bce9-d17f176fae24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096970 Mar 26 21:04:53.551832 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2134/4010] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:53.636562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:53.637536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:53.648262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:53.649482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:53.651216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:53.652466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:54.295637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:54.305421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76d87844-8dbb-45e2-8d68-40f5346623a5 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1709 microversion: 2.1 time: 0.785069 Mar 26 21:04:54.306366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1877/4011] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:53 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1709 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:54.313932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:54.314766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:54.334611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:54.335540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:54.338170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:54.338653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:54.483254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:54.504496 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d42d4c7-d899-4176-b9eb-89d9d831f76e tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.869670 Mar 26 21:04:54.508501 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2135/4012] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:53 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:54.530429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:54.538417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:54.550386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:54.551204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:54.552350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:54.553097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:55.231847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:55.242224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1f0fe0cf-a027-49f2-9a55-a34f665590b7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.934361 Mar 26 21:04:55.242867 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1878/4013] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:54 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:55.262226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:55.278405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:55.295011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:55.304265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:55.305099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:55.305463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:55.994290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.033466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.035498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.040077 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-41bd000c-21e6-46e7-a832-749254f248bb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.779816 Mar 26 21:04:56.048130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1879/4014] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:55 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:04:56.116738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:56.117633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:56.141090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:56.142937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:56.144184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:56.144950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:56.560852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.577597 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-30248ed3-bffc-434d-bfca-fbda0b1511fc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 2.067739 Mar 26 21:04:56.587577 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2136/4015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:54 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:56.597956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:56.600248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:56.619784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:56.640205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:56.642222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:56.644493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:56.887610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.896385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d9f795c-fadb-458f-be99-970b4c33f3f3 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.309942 Mar 26 21:04:56.909670 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2137/4016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:56 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:56.918067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-405d5c22-4fd5-4920-91c2-08afad999335 req-fba7d3e9-37d2-460a-9a7e-348804b7f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02351463-2580-4d69-b96b-3d067d01c53b", "tag": "9933c1ea-5c1c-4820-8444-563e9b76d35d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:56.927777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-405d5c22-4fd5-4920-91c2-08afad999335 req-fba7d3e9-37d2-460a-9a7e-348804b7f6f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:56.928580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-405d5c22-4fd5-4920-91c2-08afad999335 req-fba7d3e9-37d2-460a-9a7e-348804b7f6f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:56.947055 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-405d5c22-4fd5-4920-91c2-08afad999335 req-fba7d3e9-37d2-460a-9a7e-348804b7f6f9 service nova] Creating event network-changed:9933c1ea-5c1c-4820-8444-563e9b76d35d for instance 02351463-2580-4d69-b96b-3d067d01c53b on nch1-master-1 Mar 26 21:04:56.962959 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-405d5c22-4fd5-4920-91c2-08afad999335 req-fba7d3e9-37d2-460a-9a7e-348804b7f6f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051643 Mar 26 21:04:56.964451 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2138/4017] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:04:56.975586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:56.985612 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cc861f84-47f5-4b2d-9a3e-e9fe55332b94 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1709 microversion: 2.1 time: 0.883389 Mar 26 21:04:56.988574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:56.989316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:56.990253 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1880/4018] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:56 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1709 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:57.007529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.008044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.008853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.009341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.066952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:57.067631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:57.077893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.078434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.079243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.079743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.382205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:57.394964 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-409fcf61-021d-496d-a6d4-af810db74c61 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.428948 Mar 26 21:04:57.397992 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2139/4019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:56 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:57.597125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:57.598680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:57.606060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.606944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.607999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.612657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.844626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:57.858137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c73648eb-174d-4f87-b144-0e6218d990b1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.261585 Mar 26 21:04:57.860892 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2140/4020] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:57 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:57.914866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:57.915847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:57.928206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.930435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:57.932302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:57.934536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.296970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.312790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.339769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b1d49fa-57c7-4de7-ae76-70b0956744d7 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.428822 Mar 26 21:04:58.341082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.344078 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2141/4021] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:57 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:58.349542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.352661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1f2fa87-1262-44ed-bce6-21ded71ec393 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 1.289665 Mar 26 21:04:58.353280 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1881/4022] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:57 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:04:58.358970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:58.367603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:58.387540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.388340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.390216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.390812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.414844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:58.415482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:58.428654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.429120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.442024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.442802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.858330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.869851 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb6ea583-b9ec-4342-8c51-a8eb77e7999d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.458038 Mar 26 21:04:58.871774 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1882/4023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:58 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:58.894659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:58.901849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:58.902909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:58.921557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.923252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:58.924457 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a544355e-94b9-403d-aa5f-f303ed0a8f54 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1713 microversion: 2.1 time: 0.575946 Mar 26 21:04:58.937460 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2142/4024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:58 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1713 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:58.938591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:58.939089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.313578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:59.326149 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d03661eb-672c-417a-8a73-cc4a6cb54947 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.450109 Mar 26 21:04:59.327373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1883/4025] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:58 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:04:59.362161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:59.363064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:59.374017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.376465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.377968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.379526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.548756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fc194e7f-0900-4b87-a2c5-6c07e92d5050 req-ea26ac5b-be65-4d39-ac12-3fda6da38b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ca3c6d-80db-493b-b680-579f6a6c6122", "name": "network-vif-plugged", "status": "completed", "tag": "6899fefc-bc5b-44c3-baeb-f5fc83645543"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:04:59.566469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fc194e7f-0900-4b87-a2c5-6c07e92d5050 req-ea26ac5b-be65-4d39-ac12-3fda6da38b1b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.567281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fc194e7f-0900-4b87-a2c5-6c07e92d5050 req-ea26ac5b-be65-4d39-ac12-3fda6da38b1b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.622246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fc194e7f-0900-4b87-a2c5-6c07e92d5050 req-ea26ac5b-be65-4d39-ac12-3fda6da38b1b service nova] Creating event network-vif-plugged:6899fefc-bc5b-44c3-baeb-f5fc83645543 for instance 93ca3c6d-80db-493b-b680-579f6a6c6122 on nch2-master-1 Mar 26 21:04:59.634576 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fc194e7f-0900-4b87-a2c5-6c07e92d5050 req-ea26ac5b-be65-4d39-ac12-3fda6da38b1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319425 Mar 26 21:04:59.646753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2143/4026] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:04:59.656411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:59.662411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:59.687055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.687768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.690323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.692742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.865253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:04:59.879486 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b79c207-dc98-48fc-9341-edca8c552034 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.520500 Mar 26 21:04:59.880813 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1884/4027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:59 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:04:59.896978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:04:59.900360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:04:59.924688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.925797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:04:59.930427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:04:59.931850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:00.227383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:00.236418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:00.241668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:00.244307 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b651293-8c02-491f-ac0c-000226fbe3e5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.595950 Mar 26 21:05:00.259799 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2144/4028] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:04:59 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:00.326879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:00.337251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-065f6781-7a9c-4700-a2e9-0a18269ee14c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.446316 Mar 26 21:05:00.344445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:00.345161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:00.349016 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1885/4029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:04:59 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:00.352593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:00.353131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:00.354156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:00.355153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:00.711982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:00.725048 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3284a555-6cef-4075-beaa-6d9ccc96d1fd tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1324 microversion: 2.1 time: 0.386089 Mar 26 21:05:00.730491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2145/4030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:00 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:00.898655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:00.899380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:00.913484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:00.914279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:00.915316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:00.916008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.267223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:01.267840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:01.279247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.279717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.285806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.286285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.556738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:01.585449 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b10d648d-7513-4419-ab47-d63692cd5340 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.675290 Mar 26 21:05:01.585449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1886/4031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:00 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:01.585449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:01.585449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:01.603178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.603645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.605024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.605654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.617812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:01.634134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:01.638232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:01.641237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-46333648-d9a8-405b-b316-eff868d69174 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.378030 Mar 26 21:05:01.652656 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2146/4032] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:01 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:01.699379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2e29249c-412d-4c2c-b5ab-6c0b4b950b7f req-7d98c83c-c49e-4ac2-844c-02e632d1940a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a5420-c546-4367-abbc-4b333b09ab7e", "name": "network-vif-plugged", "status": "completed", "tag": "b7e1d8a3-d570-4eb8-97be-9012d1e78442"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:01.761464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2e29249c-412d-4c2c-b5ab-6c0b4b950b7f req-7d98c83c-c49e-4ac2-844c-02e632d1940a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.764284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2e29249c-412d-4c2c-b5ab-6c0b4b950b7f req-7d98c83c-c49e-4ac2-844c-02e632d1940a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.847074 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2e29249c-412d-4c2c-b5ab-6c0b4b950b7f req-7d98c83c-c49e-4ac2-844c-02e632d1940a service nova] Creating event network-vif-plugged:b7e1d8a3-d570-4eb8-97be-9012d1e78442 for instance 207a5420-c546-4367-abbc-4b333b09ab7e on nch2-master-1 Mar 26 21:05:01.870776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2e29249c-412d-4c2c-b5ab-6c0b4b950b7f req-7d98c83c-c49e-4ac2-844c-02e632d1940a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171189 Mar 26 21:05:01.872887 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2147/4033] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:01.893626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:01.897957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:01.920608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.921093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:01.921914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:01.926372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.027360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:02.039551 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6870b0c7-9d30-48af-a5e2-5a9a4ac905c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.462332 Mar 26 21:05:02.040635 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1887/4034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:01 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:02.347819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:02.358121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1185e0f8-fc23-45c9-bef7-fe81cd649ae1 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1522 microversion: 2.1 time: 0.480889 Mar 26 21:05:02.359431 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2148/4035] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:01 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:02.382417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:02.386721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:02.395639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.396458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.404305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.404305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.451483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:02.574067 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac474ca2-378c-4178-b892-22e1dcb588c9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 204 len: 0 microversion: 2.1 time: 0.197557 Mar 26 21:05:02.576097 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1888/4036] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:02 2022] DELETE /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:05:02.585349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:02.586560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:02.599762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:02.600191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.601299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:02.601624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.602678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.603345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.619220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.619842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.621229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.621884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.821523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:02.835983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0feced18-2503-46e1-9c54-3cdd51ef627f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1528 microversion: 2.1 time: 0.255410 Mar 26 21:05:02.839335 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2149/4037] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:02 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:02.846012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:02.863285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:02.874641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.876065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:02.877138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:02.877857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.033393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:03.044949 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e48c3552-7550-4f3a-97ea-4212a7260dea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1327 microversion: 2.1 time: 0.452593 Mar 26 21:05:03.046623 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1889/4038] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:02 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1327 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:03.080299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:03.085046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:03.103751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:03.104347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.112989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:03.113698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.254722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:03.285615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:03.287810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:03.293678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19fa51fc-7a54-46ec-80f9-30747299aaab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.449962 Mar 26 21:05:03.295635 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2150/4039] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:02 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:03.589932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:03.600308 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63130cf0-82cd-4f2c-bad8-37b8856e3de6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.545486 Mar 26 21:05:03.601363 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1890/4040] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:03 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:03.856152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:03.856978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:03.870876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:03.871662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.873867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:03.875810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.904098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a284efc5-4c8c-4dfb-978b-ee6e413cf694 req-225bec54-05fd-41d5-afb6-67ba73150308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02351463-2580-4d69-b96b-3d067d01c53b", "name": "network-vif-plugged", "status": "completed", "tag": "9933c1ea-5c1c-4820-8444-563e9b76d35d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:03.936137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a284efc5-4c8c-4dfb-978b-ee6e413cf694 req-225bec54-05fd-41d5-afb6-67ba73150308 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:03.936610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a284efc5-4c8c-4dfb-978b-ee6e413cf694 req-225bec54-05fd-41d5-afb6-67ba73150308 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:03.963185 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a284efc5-4c8c-4dfb-978b-ee6e413cf694 req-225bec54-05fd-41d5-afb6-67ba73150308 service nova] Creating event network-vif-plugged:9933c1ea-5c1c-4820-8444-563e9b76d35d for instance 02351463-2580-4d69-b96b-3d067d01c53b on nch1-master-1 Mar 26 21:05:03.974583 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a284efc5-4c8c-4dfb-978b-ee6e413cf694 req-225bec54-05fd-41d5-afb6-67ba73150308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071432 Mar 26 21:05:03.975534 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1891/4041] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:04.092734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:04.093583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:04.109436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.110460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.111350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.113042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.178682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.208390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d7298cc-7132-431d-a3ea-78971bfcecad tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1528 microversion: 2.1 time: 0.357557 Mar 26 21:05:04.214877 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2151/4042] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:03 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1528 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:04.315172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:04.316338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:04.329631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.330405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.332296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.337378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.497679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.517777 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1255bd10-ab86-424b-a664-05de61c995f5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1526 microversion: 2.1 time: 0.435665 Mar 26 21:05:04.518399 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1892/4043] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:04 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1526 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:04.535466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:04.536368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:04.543335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.544043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.545084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.545674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.587839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.601136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.607396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.609198 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1d4adc7-ef38-44b1-8528-ecc177521074 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.298819 Mar 26 21:05:04.614956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2152/4044] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:04 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:04.620240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:04.621061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:04.628994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.630040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.631029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:04.632043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:04.897939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:04.920404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e1689f2-8c81-4e05-a52d-b116a60d9ed5 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1526 microversion: 2.1 time: 0.388601 Mar 26 21:05:04.971728 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1893/4045] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:04 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1526 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:04.984562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.026935 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-072c5071-a337-4a9d-bfbf-f2160bba32a5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1315 microversion: 2.1 time: 0.410251 Mar 26 21:05:05.033254 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2153/4046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:04 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:05.242126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:05.242995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:05.245698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:05.246970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:05.277346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.277796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.279397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.280761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.284088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.285109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.286124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.287063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.322014 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] HTTP exception thrown: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. Mar 26 21:05:05.322631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Returning 404 to user: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:05.324046 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9dfd9e6c-de44-48b0-8d7f-58954eb7cc1b tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 404 len: 111 microversion: 2.1 time: 0.350074 Mar 26 21:05:05.327680 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1894/4047] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:04 2022] DELETE /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 111 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:05.342393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:05.343681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:05.352878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.353336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.354155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.357583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.425902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbebd48cec04499a06386f886c8f99c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3652534f0b48491f895462536365ef07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.465667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-18c69931-13dd-4883-9ff4-c8cc781817cc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 200 len: 1486 microversion: 2.1 time: 0.237773 Mar 26 21:05:05.471820 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2154/4048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:05 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:05.633841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:05.634941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:05.652513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.653864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.657605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.659984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.947267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.951114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.961814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.964716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:05.966346 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d827e91f-4906-4a28-8f72-ed7810383fa5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1740 microversion: 2.20 time: 0.338066 Mar 26 21:05:05.967812 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b12d22ee-88e4-4041-ae91-6500a2eac834 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1526 microversion: 2.1 time: 0.637618 Mar 26 21:05:05.979273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1895/4049] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:05 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1526 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:05.979542 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2155/4050] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:05 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:05.985997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Action: 'update', calling method: >, body: {"server": {"name": "207a5420-c546-4367-abbc-4b333b09ab7e_new"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:05.987904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:05.989104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-60091a49-84e4-45af-91f5-5c00c8fa8cef req-3a993c68-944f-4ca5-b581-7ef39f2f9648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ca3c6d-80db-493b-b680-579f6a6c6122", "name": "network-vif-deleted", "tag": "6899fefc-bc5b-44c3-baeb-f5fc83645543"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:05.995514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.996295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:05.997294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:05.998299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.000427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-60091a49-84e4-45af-91f5-5c00c8fa8cef req-3a993c68-944f-4ca5-b581-7ef39f2f9648 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.000881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-60091a49-84e4-45af-91f5-5c00c8fa8cef req-3a993c68-944f-4ca5-b581-7ef39f2f9648 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.018086 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-60091a49-84e4-45af-91f5-5c00c8fa8cef req-3a993c68-944f-4ca5-b581-7ef39f2f9648 service nova] Creating event network-vif-deleted:6899fefc-bc5b-44c3-baeb-f5fc83645543 for instance 93ca3c6d-80db-493b-b680-579f6a6c6122 on nch2-master-1 Mar 26 21:05:06.023564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-60091a49-84e4-45af-91f5-5c00c8fa8cef req-3a993c68-944f-4ca5-b581-7ef39f2f9648 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042749 Mar 26 21:05:06.024928 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1896/4051] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:06.032570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] HTTP exception thrown: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. Mar 26 21:05:06.033315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] Returning 404 to user: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:06.034719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24c2f3a3-ea5e-4bf6-85e6-6ff987eec8a5 tempest-ServersNegativeTestMultiTenantJSON-1870889742 tempest-ServersNegativeTestMultiTenantJSON-1870889742-project] 10.222.0.16 "PUT /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 404 len: 111 microversion: 2.1 time: 0.053053 Mar 26 21:05:06.043759 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2156/4052] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 21:05:05 2022] PUT /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:06.051860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.052363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.053090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.053434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.062918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.064014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.065593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.066401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.077344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.078074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.078866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.079494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.115558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:06.222178 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-abf47db5-3b37-458f-89fd-08c36fa6adae tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 204 len: 0 microversion: 2.1 time: 0.177231 Mar 26 21:05:06.223389 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1897/4053] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:06 2022] DELETE /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:05:06.233818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.235093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.244544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.246345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.247561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.248214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.254410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:06.263258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cded9d1c-7178-4ca5-b232-def8d7eaba1e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1501 microversion: 2.1 time: 0.217670 Mar 26 21:05:06.264287 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2157/4054] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:06.282259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.283079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.289818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.290538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.292103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.292737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.321040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:06.461765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-969c4e33-92ff-4190-a353-cec8dac064d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 204 len: 0 microversion: 2.1 time: 0.183854 Mar 26 21:05:06.463105 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2158/4055] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:06 2022] DELETE /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:05:06.485644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.492946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.502216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.503020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.504303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.504571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.546163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:06.555056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4fb089b5-c709-4ef5-b4bc-d964da8652b0 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1532 microversion: 2.1 time: 0.326456 Mar 26 21:05:06.555873 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1898/4056] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1532 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:06.560930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.561785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 93ca3c6d-80db-493b-b680-579f6a6c6122] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.568655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.569355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.570149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.570597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.585751 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance 93ca3c6d-80db-493b-b680-579f6a6c6122 could not be found. Mar 26 21:05:06.586503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance 93ca3c6d-80db-493b-b680-579f6a6c6122 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:06.587424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ae3e23a-99c5-4b7a-b75d-0ccc5440532f tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122" status: 404 len: 111 microversion: 2.1 time: 0.030323 Mar 26 21:05:06.588024 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1899/4057] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/93ca3c6d-80db-493b-b680-579f6a6c6122 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:06.596726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e7ab56f-1787-4e4d-9a8d-9b310521127a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e593d9ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.620233 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1e7ab56f-1787-4e4d-9a8d-9b310521127a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Image not found. Mar 26 21:05:06.620818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e7ab56f-1787-4e4d-9a8d-9b310521127a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Image not found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:06.621817 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1e7ab56f-1787-4e4d-9a8d-9b310521127a tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c" status: 404 len: 62 microversion: 2.1 time: 0.028931 Mar 26 21:05:06.622358 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1900/4058] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] DELETE /compute/v2.1/images/0ef0ae1f-8fb1-4a89-a9d0-799e79b1881c => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 21:05:06.637726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.638256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.646215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.646986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.648011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.648673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.664870 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. Mar 26 21:05:06.665789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:06.667487 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-33e163ef-81e8-4423-8350-e54c3552de82 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 404 len: 111 microversion: 2.1 time: 0.040183 Mar 26 21:05:06.668311 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1901/4059] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:06 2022] DELETE /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:06.676562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.678698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: a35d639d-4539-4055-a7b0-8aedab45bc8b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:06.685631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.685999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.686924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:06.688083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:06.690356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:06.699786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7189004b-de0d-4f18-a88b-9c1d8eac3527 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1507 microversion: 2.1 time: 0.221881 Mar 26 21:05:06.700866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2159/4060] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:06.708261 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. Mar 26 21:05:06.709448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance a35d639d-4539-4055-a7b0-8aedab45bc8b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:06.710622 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8b94b358-6193-405e-8518-fad123de7e4c tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b" status: 404 len: 111 microversion: 2.1 time: 0.038161 Mar 26 21:05:06.711245 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1902/4061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/a35d639d-4539-4055-a7b0-8aedab45bc8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:06.722099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4fc305a-60f6-4cf4-ac96-e73413b887d9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e5816e790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.752710 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4fc305a-60f6-4cf4-ac96-e73413b887d9 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337609790" status: 202 len: 0 microversion: 2.1 time: 0.034332 Mar 26 21:05:06.757144 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2160/4062] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:05:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337609790 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:05:06.993130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:06.995996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:07.026522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.027096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.028263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.028612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.320572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:07.329642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:07.331495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:07.333709 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d7acd49-79be-4469-9f58-4c5680bc0835 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1722 microversion: 2.20 time: 0.347313 Mar 26 21:05:07.334936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1903/4063] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:06 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:07.573104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:07.573725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:07.596698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.597278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.598403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.598941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.717241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:07.717870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:07.728458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.728958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.730347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:07.730816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:07.971079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:07.986713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f99a90b-de3a-435f-9409-7f27c9c66031 tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1532 microversion: 2.1 time: 0.418376 Mar 26 21:05:07.998477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2161/4064] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:07 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1532 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:08.003420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ffc239a-674d-41e6-91f0-3e7e81113443 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '.version_select at 0x7f6e4bf3cf70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:08.032139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-1ffc239a-674d-41e6-91f0-3e7e81113443 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Image not found. Mar 26 21:05:08.032982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ffc239a-674d-41e6-91f0-3e7e81113443 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Image not found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:08.034086 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ffc239a-674d-41e6-91f0-3e7e81113443 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/images/f705586b-621c-4db4-b117-5e959b4a838d" status: 404 len: 62 microversion: 2.1 time: 0.034539 Mar 26 21:05:08.035551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2162/4065] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:07 2022] DELETE /compute/v2.1/images/f705586b-621c-4db4-b117-5e959b4a838d => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:05:08.043833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:08.044394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:08.051466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.052026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.052827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.053281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.067052 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. Mar 26 21:05:08.067946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:08.069463 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd85aa2f-6035-481b-90e3-e22a6e2aa908 tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 404 len: 111 microversion: 2.1 time: 0.029789 Mar 26 21:05:08.070546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2163/4066] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:08 2022] DELETE /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:08.078281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:08.079114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] [instance: 41e903a1-0361-4e29-ac79-3394b410f9da] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:08.085614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.086153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.087168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.087823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.103491 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] HTTP exception thrown: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. Mar 26 21:05:08.104683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] Returning 404 to user: Instance 41e903a1-0361-4e29-ac79-3394b410f9da could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:08.105738 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9fb9ccd-e8ed-458f-b3dc-1c7bb1de1dbc tempest-ImagesOneServerNegativeTestJSON-427855409 tempest-ImagesOneServerNegativeTestJSON-427855409-project] 10.222.0.16 "GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da" status: 404 len: 111 microversion: 2.1 time: 0.031247 Mar 26 21:05:08.106613 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2164/4067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:08 2022] GET /compute/v2.1/servers/41e903a1-0361-4e29-ac79-3394b410f9da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:08.331601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:08.341433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3a9cdf4-4498-4f53-86c4-88ba87fed3d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1507 microversion: 2.1 time: 0.628035 Mar 26 21:05:08.342138 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1904/4068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:07 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:08.357245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:08.358311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:08.365547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.366119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.366997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:08.367450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:08.985590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:08.994318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:08.996220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:09.000728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a3934415-bdce-4882-b10a-829fb73a5536 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1722 microversion: 2.20 time: 0.649637 Mar 26 21:05:09.000728 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2165/4069] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:08 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1722 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:09.013603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:09.014958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:09.028259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:09.028394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:09.029117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:09.029713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:09.359224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:09.359840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:09.371351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:09.371820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:09.372657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:09.373109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:09.545937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:09.572303 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39f746ec-21d9-4694-9266-11f1b8dfbaae tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 200 len: 1465 microversion: 2.1 time: 0.215099 Mar 26 21:05:09.580234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2166/4070] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:09 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 1465 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:09.675703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9491de6627b346fca21989a44e262429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97ee3626b824293b17899943c256a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:09.691910 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9418f7de-516b-418e-8db6-4c564d4324ea tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 200 len: 1532 microversion: 2.1 time: 0.686196 Mar 26 21:05:09.691910 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1905/4071] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:08 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 1532 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:09.701439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-8cd9b3ea-1a94-4876-a1cc-179b1b984439 req-2d042449-489e-4e6a-a774-fee24c52d0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a5420-c546-4367-abbc-4b333b09ab7e", "name": "network-vif-deleted", "tag": "b7e1d8a3-d570-4eb8-97be-9012d1e78442"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:09.748301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8cd9b3ea-1a94-4876-a1cc-179b1b984439 req-2d042449-489e-4e6a-a774-fee24c52d0a8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:09.749710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-8cd9b3ea-1a94-4876-a1cc-179b1b984439 req-2d042449-489e-4e6a-a774-fee24c52d0a8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:09.782093 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-8cd9b3ea-1a94-4876-a1cc-179b1b984439 req-2d042449-489e-4e6a-a774-fee24c52d0a8 service nova] Creating event network-vif-deleted:b7e1d8a3-d570-4eb8-97be-9012d1e78442 for instance 207a5420-c546-4367-abbc-4b333b09ab7e on nch2-master-1 Mar 26 21:05:09.795063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-8cd9b3ea-1a94-4876-a1cc-179b1b984439 req-2d042449-489e-4e6a-a774-fee24c52d0a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100259 Mar 26 21:05:09.802063 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1906/4072] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:10.022305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:10.023294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:10.039834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.041356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.045337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.046820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.077762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b2a8099d-58e1-41a9-957e-f1a178708ee3 req-1e1fa84f-4491-401c-9ffa-be341fbd1519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02351463-2580-4d69-b96b-3d067d01c53b", "name": "network-vif-deleted", "tag": "9933c1ea-5c1c-4820-8444-563e9b76d35d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:10.101149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b2a8099d-58e1-41a9-957e-f1a178708ee3 req-1e1fa84f-4491-401c-9ffa-be341fbd1519 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.102023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b2a8099d-58e1-41a9-957e-f1a178708ee3 req-1e1fa84f-4491-401c-9ffa-be341fbd1519 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.137682 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b2a8099d-58e1-41a9-957e-f1a178708ee3 req-1e1fa84f-4491-401c-9ffa-be341fbd1519 service nova] Creating event network-vif-deleted:9933c1ea-5c1c-4820-8444-563e9b76d35d for instance 02351463-2580-4d69-b96b-3d067d01c53b on nch1-master-1 Mar 26 21:05:10.161999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b2a8099d-58e1-41a9-957e-f1a178708ee3 req-1e1fa84f-4491-401c-9ffa-be341fbd1519 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579870 Mar 26 21:05:10.166517 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2167/4073] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:10.483509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0647a6b9-a82d-4b1d-8210-f7c892bd1946 req-0d5d9143-d0e8-4db0-b99f-4ea08b31c80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "name": "network-vif-unplugged", "status": "completed", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:10.497577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0647a6b9-a82d-4b1d-8210-f7c892bd1946 req-0d5d9143-d0e8-4db0-b99f-4ea08b31c80a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.498190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0647a6b9-a82d-4b1d-8210-f7c892bd1946 req-0d5d9143-d0e8-4db0-b99f-4ea08b31c80a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.546551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_external_events [req-0647a6b9-a82d-4b1d-8210-f7c892bd1946 req-0d5d9143-d0e8-4db0-b99f-4ea08b31c80a service nova] Unable to find a host for instance 39b61f71-6468-4d03-87ff-51120f2911c4. Dropping event network-vif-unplugged {{(pid=141581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 26 21:05:10.548550 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0647a6b9-a82d-4b1d-8210-f7c892bd1946 req-0d5d9143-d0e8-4db0-b99f-4ea08b31c80a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070902 Mar 26 21:05:10.551340 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2168/4074] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 26 21:05:10.558906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:10.580178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:10.584992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:10.594061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:10.594807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:10.597199 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56f50b8d-2e54-4b48-bf25-5c7c1762f00d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1665 microversion: 2.20 time: 0.573539 Mar 26 21:05:10.604148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1907/4075] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:10 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1665 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:10.606854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.607478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.608926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.609768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.638818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "575bb058-c5ae-4a01-831b-e61c0faaa551"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:10.642686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:10.659985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.661942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.664363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.666173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.693158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. Mar 26 21:05:10.699550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:10.702425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d47e1bd-f513-4ef8-ae47-45ec8cc56304 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 404 len: 111 microversion: 2.1 time: 0.110545 Mar 26 21:05:10.703965 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2169/4076] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:10 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:10.718800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:10.722894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] [instance: 207a5420-c546-4367-abbc-4b333b09ab7e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:10.743160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.745352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.746384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:10.748493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:10.798413 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] HTTP exception thrown: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. Mar 26 21:05:10.799052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] Returning 404 to user: Instance 207a5420-c546-4367-abbc-4b333b09ab7e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:10.799948 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-490782b3-0fd2-4a43-823a-cae75e7098ad tempest-ServersNegativeTestMultiTenantJSON-1476276452 tempest-ServersNegativeTestMultiTenantJSON-1476276452-project] 10.222.0.16 "GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e" status: 404 len: 111 microversion: 2.1 time: 0.086376 Mar 26 21:05:10.803221 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2170/4077] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:10 2022] GET /compute/v2.1/servers/207a5420-c546-4367-abbc-4b333b09ab7e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:11.023734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1566754039", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:11.176591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:05:11.361451 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da386e0a-9f1c-42f2-92f2-35f243712cf1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.739806 Mar 26 21:05:11.362499 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1908/4078] 10.222.0.16 () {62 vars in 1363 bytes} [Sat Mar 26 21:05:10 2022] POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments => generated 188 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:05:11.594939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:11.596586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:11.607595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:11.613254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:11.614387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:11.615902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:11.780278 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8588eaf-c201-4548-8b51-8660624ef318 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/action" status: 202 len: 0 microversion: 2.20 time: 0.189604 Mar 26 21:05:11.791126 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1909/4079] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:05:11 2022] POST /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:05:11.813148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:11.814908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:11.832654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:11.833550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:11.835244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:11.836633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:12.131063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:12.156293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:12.159870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:12.161628 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e9507af1-e312-4c57-bbcd-48e2a59d7155 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1751 microversion: 2.20 time: 0.355194 Mar 26 21:05:12.162599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1910/4080] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:11 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1751 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:13.187245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:13.188493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:13.202544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.203183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.204592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.205315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.261354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:05:13.262927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:05:13.264090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:05:13.264914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:05:13.266085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:05:13.303706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.304171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.306671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.307527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.358979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:13.369052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:13.400343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:05:13.404562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:05:13.512611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:13.528300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:13.553314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:13.554680 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b444bccf-ba6a-4b2b-904f-57b2b929a20f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1751 microversion: 2.20 time: 0.377355 Mar 26 21:05:13.568250 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1911/4081] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:13 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1751 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:13.576824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:13.577529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:13.584595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.584783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.585637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:13.586330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:13.677175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa627360-a603-46d3-b0eb-cc0d5cd42b4b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.653146 Mar 26 21:05:13.689123 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2171/4082] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:05:13.705906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7f45f7a-120f-4800-9f98-ebc57608926c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:13.717392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7f45f7a-120f-4800-9f98-ebc57608926c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:14.099590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:14.111383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:14.113394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:14.115305 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e8565a0c-216e-410e-9f77-a60aac6de681 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2942 microversion: 2.32 time: 0.545180 Mar 26 21:05:14.127955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1912/4083] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:13 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2942 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:14.149528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:14.150140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:14.157218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:14.157816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:14.158779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:14.159247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:14.292404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c7f45f7a-120f-4800-9f98-ebc57608926c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:14.306786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7f45f7a-120f-4800-9f98-ebc57608926c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1215 microversion: 2.1 time: 0.615782 Mar 26 21:05:14.312957 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2172/4084] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:13 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1215 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:14.459481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-32fab780-79f7-4d4b-badd-075de44faf1b tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.313777 Mar 26 21:05:14.460241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1913/4085] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:05:14 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925/os-interface => generated 1829 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:14.576710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:14.577647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:14.590446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:14.591187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:14.592233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:14.592898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:15.330957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:15.332317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:15.347883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:15.357977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:15.360093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:15.361367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:15.485863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:15.494366 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1f4f314e-1e5d-45f8-a620-3892c6a25fd4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1267 microversion: 2.1 time: 0.168570 Mar 26 21:05:15.504991 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1914/4086] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:15 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:16.196066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:16.214098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:16.223025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:16.227253 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a66ba2b-57ac-443f-9911-8e16f7a38978 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1753 microversion: 2.20 time: 1.653115 Mar 26 21:05:16.238142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2173/4087] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:14 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1753 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:16.522097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:16.523465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:16.543748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:16.544802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:16.545854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:16.546533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:16.673050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:16.692908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9be3023-eb0f-4d15-bf97-2ffc37c2a272 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1273 microversion: 2.1 time: 0.174690 Mar 26 21:05:16.694683 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1915/4088] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:16 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:17.254510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:17.258808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:17.302460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:17.302948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:17.309841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:17.310355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:17.712277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:17.712908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:17.720252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:17.720717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:17.721495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:17.730757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:17.960277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:17.988546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:17.997064 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23c843e7-7fe9-4dcc-a1ca-f8fd5dca6953 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1273 microversion: 2.1 time: 0.288630 Mar 26 21:05:17.998599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1916/4089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:17 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:18.028043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:18.029896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:18.031054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a75e37cf-04a6-45bf-8d11-7710aff1c0ca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.789058 Mar 26 21:05:18.031630 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2174/4090] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:17 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:19.017771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:19.019203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:19.035523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:19.036028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:19.043960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:19.044692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:19.053187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:19.053915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:19.067684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:19.073393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:19.074341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:19.074797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:19.640918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:19.650158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-49679123-9283-4256-be09-fe4fe39bb220 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.636579 Mar 26 21:05:19.655238 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1917/4091] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:19 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:20.656804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:20.673898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:20.675156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:20.686149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:20.692164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:20.693476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:20.693940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:20.702683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:20.705006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:20.709718 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68c648ad-c552-46c5-8746-f2f0f8b14323 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 1.661941 Mar 26 21:05:20.710276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2175/4092] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:19 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:21.729808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:21.731564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:21.747696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:21.749220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:21.756138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:21.757500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:21.854398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:21.864933 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73f4271d-3aff-4a80-a60c-88425f24b89f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 1.196038 Mar 26 21:05:21.875730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1918/4093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:20 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:22.669176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Action: 'create', calling method: .version_select at 0x7f6e5ec5caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-441090145"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:22.939692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:22.951987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:22.955898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:22.965803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e56ee897-d7fa-493c-8d62-e9c582c34c81 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 1.236079 Mar 26 21:05:22.970279 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2176/4094] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:21 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:22.993332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:22.997935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:23.021386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:23.024178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:23.029192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:23.029640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:23.571584 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9e6746c4-99fc-4fc4-8dad-5a2beb01d67d tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.236827 Mar 26 21:05:23.579895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1919/4095] 10.222.0.16 () {60 vars in 1154 bytes} [Sat Mar 26 21:05:22 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1246 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Mar 26 21:05:23.585265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba6e7b0a-6963-48f7-a017-fd192826b97a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e5ebefe50>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:23.714153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba6e7b0a-6963-48f7-a017-fd192826b97a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 200 len: 337 microversion: 2.1 time: 0.132533 Mar 26 21:05:23.714929 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1920/4096] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:23 2022] GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 337 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:23.986055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:23.987138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:24.007086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:24.007669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:24.008798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:24.010762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:24.099318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:24.116364 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d819704a-fb1a-440f-b7dd-3dcf06bd7685 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 1.142383 Mar 26 21:05:24.120695 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2177/4097] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:22 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:24.590267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:24.609177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:24.652008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:24.653385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6bc8e4a-d87c-4327-aefb-9b76f90df7fa tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.672585 Mar 26 21:05:24.661825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1921/4098] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:23 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:24.667344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-13f5564d-d0dd-49b4-9942-1bee45224216 req-156b0c5c-d346-4d2b-b72e-868d71d7f5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e291b53c-8620-4e94-915b-ef3c614c12ac", "tag": "351f6d49-7dc1-4586-92ad-1ec0e7a14585"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:24.692048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-13f5564d-d0dd-49b4-9942-1bee45224216 req-156b0c5c-d346-4d2b-b72e-868d71d7f5dd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:24.699631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-13f5564d-d0dd-49b4-9942-1bee45224216 req-156b0c5c-d346-4d2b-b72e-868d71d7f5dd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:24.728685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c0726b5-6991-4796-ab95-30f3c749c975 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e5ebfd790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:24.748858 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-13f5564d-d0dd-49b4-9942-1bee45224216 req-156b0c5c-d346-4d2b-b72e-868d71d7f5dd service nova] Creating event network-changed:351f6d49-7dc1-4586-92ad-1ec0e7a14585 for instance e291b53c-8620-4e94-915b-ef3c614c12ac on nch1-master-1 Mar 26 21:05:24.764156 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-13f5564d-d0dd-49b4-9942-1bee45224216 req-156b0c5c-d346-4d2b-b72e-868d71d7f5dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100851 Mar 26 21:05:24.770806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2178/4099] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:24.873938 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c0726b5-6991-4796-ab95-30f3c749c975 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 200 len: 338 microversion: 2.1 time: 0.151027 Mar 26 21:05:24.876777 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1922/4100] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:24 2022] GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 338 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:24.890815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6712a9f1-66d1-49db-90ef-a43034eff727 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Action: 'create', calling method: .version_select at 0x7f6e581b6820>, body: {"snapshot": {"volume_id": "2cfb8459-6389-48d4-97fc-57fedabc288a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-187521275"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:25.139015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:25.140227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:25.173282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:25.175260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:25.180365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:25.191850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:25.355608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6712a9f1-66d1-49db-90ef-a43034eff727 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.472147 Mar 26 21:05:25.356539 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2179/4101] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Mar 26 21:05:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:25.366633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c06a3ee-5f0c-4cdc-bf40-ea475e203671 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e5819b040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:25.454484 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c06a3ee-5f0c-4cdc-bf40-ea475e203671 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 200 len: 286 microversion: 2.1 time: 0.092054 Mar 26 21:05:25.455684 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2180/4102] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:25 2022] GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:25.466407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d42cd0d2-f94b-4811-894d-02db25ef96a5 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e581b1f70>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:25.592358 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d42cd0d2-f94b-4811-894d-02db25ef96a5 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.130972 Mar 26 21:05:25.593435 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2181/4103] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 21:05:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:25.604403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fa7e5d0-0e82-42d8-be3a-9c8a857c2066 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e4bf1a040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:25.677382 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2fa7e5d0-0e82-42d8-be3a-9c8a857c2066 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 200 len: 286 microversion: 2.1 time: 0.078078 Mar 26 21:05:25.678132 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2182/4104] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:25 2022] GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:25.701276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:25.706334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:25.737718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:25.738447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:25.739356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:25.739887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:26.018426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:26.070644 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-009c9369-660c-4625-b9ea-aa52b81c048e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.923916 Mar 26 21:05:26.077498 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1923/4105] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:25 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:26.240486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Action: 'create', calling method: .version_select at 0x7f6e5ebf0820>, body: {"keypair": {"name": "tempest-keypair-1594123671"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:26.364553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for project 62670a489b2b43b78d9e1e71371e7886. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:26.396392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for user 4a76b26808b84a2ba82f49753035dd89 and project 62670a489b2b43b78d9e1e71371e7886. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:26.448793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:26.466698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:26.499548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:26.501383 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-979310b6-f936-4a44-b481-980c890a7c2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.812318 Mar 26 21:05:26.513104 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2183/4106] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:25 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:26.689931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fe400845-aa2a-4d92-baf9-5cdfbaaa8f5c tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e581b6a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:26.768368 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fe400845-aa2a-4d92-baf9-5cdfbaaa8f5c tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 200 len: 287 microversion: 2.1 time: 0.082240 Mar 26 21:05:26.774365 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2184/4107] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:26 2022] GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:26.780838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2282b651-161f-412b-8ba7-71f9d3e56a68 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e58049790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:26.951249 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2282b651-161f-412b-8ba7-71f9d3e56a68 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 202 len: 0 microversion: 2.1 time: 0.174864 Mar 26 21:05:26.951911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2185/4108] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:05:26 2022] DELETE /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:05:26.964219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f48c447-72d2-43c0-a205-9278ed9fbdf8 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e4beec9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:27.045193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f48c447-72d2-43c0-a205-9278ed9fbdf8 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 200 len: 286 microversion: 2.1 time: 0.088917 Mar 26 21:05:27.045770 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2186/4109] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:26 2022] GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:27.096310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:27.097003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:27.118182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:27.118435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for project 62670a489b2b43b78d9e1e71371e7886. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:27.119101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:27.119650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:27.126290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:27.130020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for user 4a76b26808b84a2ba82f49753035dd89 and project 62670a489b2b43b78d9e1e71371e7886. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:27.197590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2423bb92-352e-4932-a741-59590b3becf8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.075036 Mar 26 21:05:27.201341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1924/4110] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:05:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:27.533124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:27.536821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:27.546221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:27.552676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:27.553545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:27.553999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:28.093100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:28.101303 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8897c069-0fc2-4693-a8e3-75cf9c0126f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 1.011132 Mar 26 21:05:28.116264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2187/4111] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:27 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:28.118550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:28.128704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a457074e-eb17-4f51-b205-64178de85a0a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e4bf255e0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:28.146977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:28.154586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:28.156941 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c6cb5c0-0fc2-442c-a4ad-54c9910a9519 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.630278 Mar 26 21:05:28.160285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1925/4112] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:27 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:28.181191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a457074e-eb17-4f51-b205-64178de85a0a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] HTTP exception thrown: Snapshot 0bff87eb-fa86-47c7-bae2-4a0593059e37 could not be found. Mar 26 21:05:28.182124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a457074e-eb17-4f51-b205-64178de85a0a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Returning 404 to user: Snapshot 0bff87eb-fa86-47c7-bae2-4a0593059e37 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:28.183140 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a457074e-eb17-4f51-b205-64178de85a0a tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37" status: 404 len: 111 microversion: 2.1 time: 0.065807 Mar 26 21:05:28.187284 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2188/4113] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:28 2022] GET /compute/v2.1/os-snapshots/0bff87eb-fa86-47c7-bae2-4a0593059e37 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:28.197527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-91b3d960-37b8-45b2-acf3-e8220913aba8 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e5ebf0160>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:28.367816 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-91b3d960-37b8-45b2-acf3-e8220913aba8 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 202 len: 0 microversion: 2.1 time: 0.177084 Mar 26 21:05:28.368963 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1926/4114] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:28 2022] DELETE /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:05:28.379169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eb1dd88c-071d-4bc0-8885-9ac27b452bd4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e581b6700>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:28.478222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eb1dd88c-071d-4bc0-8885-9ac27b452bd4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 200 len: 337 microversion: 2.1 time: 0.103981 Mar 26 21:05:28.479418 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2189/4115] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:28 2022] GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:29.123365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:29.123365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:29.138685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:29.146149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:29.147880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:29.149057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:29.180615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:29.182581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:29.202270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:29.204125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:29.206176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:29.209094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:29.527107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:29.537762 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-043ad841-a608-4efa-89c6-3f59bbd7131d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.422615 Mar 26 21:05:29.539504 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1927/4116] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:29 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:29.552941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9bb3fff-fa72-4d8a-8c84-8892bbf30747 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e591d58b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:29.616129 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b9bb3fff-fa72-4d8a-8c84-8892bbf30747 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] HTTP exception thrown: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. Mar 26 21:05:29.616747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b9bb3fff-fa72-4d8a-8c84-8892bbf30747 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Returning 404 to user: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:29.625080 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b9bb3fff-fa72-4d8a-8c84-8892bbf30747 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 404 len: 109 microversion: 2.1 time: 0.077111 Mar 26 21:05:29.628373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1928/4117] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:29 2022] GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:29.637916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dfec3863-4007-41f6-8e53-305eaba59890 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e5ebf0040>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:29.711209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-dfec3863-4007-41f6-8e53-305eaba59890 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] HTTP exception thrown: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. Mar 26 21:05:29.711859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dfec3863-4007-41f6-8e53-305eaba59890 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Returning 404 to user: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:29.713314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dfec3863-4007-41f6-8e53-305eaba59890 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 404 len: 109 microversion: 2.1 time: 0.078871 Mar 26 21:05:29.717510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1929/4118] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:29 2022] DELETE /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:29.723018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12902547-34d4-495b-8c83-39d8c89e88f4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Calling method '.version_select at 0x7f6e591d58b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:29.783433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-12902547-34d4-495b-8c83-39d8c89e88f4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] HTTP exception thrown: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. Mar 26 21:05:29.784367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12902547-34d4-495b-8c83-39d8c89e88f4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] Returning 404 to user: Volume 2cfb8459-6389-48d4-97fc-57fedabc288a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:29.785504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12902547-34d4-495b-8c83-39d8c89e88f4 tempest-VolumesSnapshotsTestJSON-1134480779 tempest-VolumesSnapshotsTestJSON-1134480779-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a" status: 404 len: 109 microversion: 2.1 time: 0.066328 Mar 26 21:05:29.787090 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1930/4119] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:29 2022] GET /compute/v2.1/os-volumes/2cfb8459-6389-48d4-97fc-57fedabc288a => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:29.924743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:29.966939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:29.975764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:29.982500 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1c1b23e1-55c1-4e31-8c2a-949f0131b970 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.803227 Mar 26 21:05:29.987741 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2190/4120] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:29 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:30.560411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:30.561003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:30.606031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:30.606812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:30.612400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:30.618776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:30.992316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:31.011201 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cccfcde7-289d-4c90-8ed5-4fb9d4d44109 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.458358 Mar 26 21:05:31.013692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:31.014993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:31.022602 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1931/4121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:30 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:31.038231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:31.038764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:31.039591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:31.044520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:32.031088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:32.032503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:32.058555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:32.059232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:32.061565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:32.062014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:32.543526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:32.564251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3a573ce-035b-425b-bdf1-74cfc904d575 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.539470 Mar 26 21:05:32.580452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1932/4122] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:32 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:32.676017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:32.692088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:32.700196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:32.706516 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8947dc5-d1cc-4138-9dc4-09eeff6fbe41 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 1.703520 Mar 26 21:05:32.708973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2191/4123] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:31 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:33.584900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:33.586235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:33.615176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:33.616097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:33.617251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:33.617938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:33.727570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:33.728866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:33.741435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:33.741893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:33.743583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:33.744640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:33.820437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:33.842328 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b26e2bef-30f0-41f9-b982-9f83892b44b6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.261976 Mar 26 21:05:33.844563 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1933/4124] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:33 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:34.062758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0b09c438-edd8-4448-9c2a-2bf3b16018af req-45cfb223-d2e0-4bb5-85ac-6202fd0d9955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e291b53c-8620-4e94-915b-ef3c614c12ac", "name": "network-vif-plugged", "status": "completed", "tag": "351f6d49-7dc1-4586-92ad-1ec0e7a14585"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:34.084369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0b09c438-edd8-4448-9c2a-2bf3b16018af req-45cfb223-d2e0-4bb5-85ac-6202fd0d9955 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:34.089536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0b09c438-edd8-4448-9c2a-2bf3b16018af req-45cfb223-d2e0-4bb5-85ac-6202fd0d9955 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:34.133426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0b09c438-edd8-4448-9c2a-2bf3b16018af req-45cfb223-d2e0-4bb5-85ac-6202fd0d9955 service nova] Creating event network-vif-plugged:351f6d49-7dc1-4586-92ad-1ec0e7a14585 for instance e291b53c-8620-4e94-915b-ef3c614c12ac on nch1-master-1 Mar 26 21:05:34.144254 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0b09c438-edd8-4448-9c2a-2bf3b16018af req-45cfb223-d2e0-4bb5-85ac-6202fd0d9955 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089140 Mar 26 21:05:34.147357 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1934/4125] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:34.554209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1357720799", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "697ff91d-d756-413d-ac36-72a2d2ec1b6f"}], "security_groups": [{"name": "tempest-securitygroup--699585865"}], "key_name": "tempest-keypair-1594123671", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:34.576377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:34.589664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:34.591549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:34.593499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e062d8c8-4c28-4f68-9eee-65abc3e31247 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.870590 Mar 26 21:05:34.594672 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2192/4126] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:33 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:34.816800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] validate_networks() for [('697ff91d-d756-413d-ac36-72a2d2ec1b6f', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:05:34.861451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:34.862698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:34.872519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:34.875633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:34.878293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:34.881187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:35.190718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:35.201918 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f5311cbb-0e23-4b7f-b31a-40b99cc86d85 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1315 microversion: 2.1 time: 0.343070 Mar 26 21:05:35.203227 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2193/4127] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:34 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:35.413624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for project 62670a489b2b43b78d9e1e71371e7886. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:35.419355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for user 4a76b26808b84a2ba82f49753035dd89 and project 62670a489b2b43b78d9e1e71371e7886. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:35.433400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:05:35.434089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:05:35.434751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:05:35.435348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:05:35.435776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:05:35.444587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:35.445240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:35.446474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:35.447670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:35.466493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for project 62670a489b2b43b78d9e1e71371e7886. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:35.471997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Getting quotas for user 4a76b26808b84a2ba82f49753035dd89 and project 62670a489b2b43b78d9e1e71371e7886. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:35.485570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:05:35.488618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:05:35.546080 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f2743bb-810a-4566-b4b4-03968b5fd70c tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998339 Mar 26 21:05:35.547414 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1935/4128] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:05:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 21:05:35.558753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9afb0981-24c9-43f8-b93f-fb1b67cd993f tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:35.559779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9afb0981-24c9-43f8-b93f-fb1b67cd993f tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:35.613913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:35.614539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:35.622813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:35.623630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:35.624459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:35.624906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:35.637949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9afb0981-24c9-43f8-b93f-fb1b67cd993f tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:35.645148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9afb0981-24c9-43f8-b93f-fb1b67cd993f tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1270 microversion: 2.1 time: 0.091420 Mar 26 21:05:35.645728 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2194/4129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:35 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:35.803136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:35.816229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:35.817824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:35.819321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0cd4978c-1ba3-4028-891b-b804316b7c27 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.210333 Mar 26 21:05:35.821364 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1936/4130] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:35 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:35.870363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1851947510", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:35.930219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] validate_networks() for None {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:05:36.220004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:36.220628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:36.227651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.229091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.230060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.230665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.406353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:36.417085 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19e6eff9-31db-42b3-a946-4a0512730298 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1501 microversion: 2.1 time: 0.200933 Mar 26 21:05:36.419006 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1937/4131] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:36 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:36.456584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:05:36.457155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:05:36.457685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:05:36.459294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:05:36.459722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:05:36.472498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.473450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.474472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.475335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.504225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Getting quotas for project ffeef0caf635437194fed3721a8d1d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:36.511828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Getting quotas for user bfac7b943d654fc88c08d106d57201d6 and project ffeef0caf635437194fed3721a8d1d0d. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:36.527398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:05:36.529931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:05:36.590473 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-47b7b11b-f4b3-4a4f-acec-7a7b198c7433 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725350 Mar 26 21:05:36.593120 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2195/4132] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:05:36.602996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9683653e-d5c7-4d2d-9535-374a4fd373e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:36.604395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9683653e-d5c7-4d2d-9535-374a4fd373e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:36.662575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:36.663098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:36.677088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.677558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.678353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.678806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.714067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9683653e-d5c7-4d2d-9535-374a4fd373e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:36.727020 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9683653e-d5c7-4d2d-9535-374a4fd373e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1215 microversion: 2.1 time: 0.126693 Mar 26 21:05:36.741782 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1938/4133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:36 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:36.839638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:36.840465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:36.854465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.855427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.866977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:36.870622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:36.872353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:36.883498 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19a6cc02-268f-44ec-b5be-e69923ed9c41 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1322 microversion: 2.1 time: 0.224666 Mar 26 21:05:36.908657 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2196/4134] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:36 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:37.324383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:37.336546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:37.338151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:37.344428 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad13ddfb-eb82-4389-ab0d-54d40fa5e6bf tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.509338 Mar 26 21:05:37.355379 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1939/4135] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:36 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:37.751194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:37.752172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:37.764935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.765396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:37.767490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.768253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:37.819899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:37.820798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:37.831342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.835567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:37.836524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.837108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:37.880509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:37.897888 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0b915f0-540b-4c8b-94ad-a91487b971e0 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1267 microversion: 2.1 time: 0.149320 Mar 26 21:05:37.900491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2197/4136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:37 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:37.926132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:37.928792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:37.943256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.945663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:37.947167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:37.955226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.034122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lazy-loading 'services' on Instance uuid d4c0441e-1bda-47d4-a6d1-9139adecc0b5 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:38.206056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c68b4ff9-d091-4cf1-a8b4-1b18779c948a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments/b5bc46c5-266e-44bc-843e-b5f8243721f5" status: 202 len: 0 microversion: 2.1 time: 0.390571 Mar 26 21:05:38.223366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1940/4137] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:05:37 2022] DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments/b5bc46c5-266e-44bc-843e-b5f8243721f5 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:05:38.270896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:38.276030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af628bd3-b055-4def-b114-c56cacb63061"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:38.279271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:38.285773 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-070a11ba-5f43-4567-956e-85315b0702e8 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1328 microversion: 2.1 time: 0.381486 Mar 26 21:05:38.287788 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2198/4138] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:37 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1328 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:38.310117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.311228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.313456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.314168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.363616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:38.364489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:38.373297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.373952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.375495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.376133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.740981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:38.756817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:38.760884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:38.762131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-174c5b0f-1ad4-4fea-b5df-1c023bede11f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.403413 Mar 26 21:05:38.763343 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2199/4139] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:38 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:38.801052 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-833b6ca7-9058-4224-af24-bca27e5754cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530762 Mar 26 21:05:38.808730 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1941/4140] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:05:38 2022] POST /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:38.916849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:38.918308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:38.943592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.947936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:38.952150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:38.956219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:39.310677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:39.313088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:39.331774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:39.332400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:39.333432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:39.334526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:39.370876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:39.384601 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8b36b57-0031-42e5-bca2-cb546955264c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1273 microversion: 2.1 time: 0.471339 Mar 26 21:05:39.386179 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2200/4141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:38 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1273 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:39.451606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52b30a05-dd7e-47d2-8e17-6f5a0efaa885 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:39.463987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52b30a05-dd7e-47d2-8e17-6f5a0efaa885 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:39.464688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52b30a05-dd7e-47d2-8e17-6f5a0efaa885 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:39.539842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52b30a05-dd7e-47d2-8e17-6f5a0efaa885 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:05:39.680220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52b30a05-dd7e-47d2-8e17-6f5a0efaa885 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.232949 Mar 26 21:05:39.697571 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2201/4142] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:05:39 2022] POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:05:39.724544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:39.726490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:39.746069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:39.748226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:39.749233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:39.753059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:40.224330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.238292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db41bd70-041f-4505-b8cf-e7b88391d413 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.531694 Mar 26 21:05:40.242619 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2202/4143] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:39 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:40.268359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:40.277903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:40.300649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:40.307886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:40.311621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:40.312638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:40.552476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.569445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e6940dd5-a114-416c-91c0-75fa4fa427a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 1.266196 Mar 26 21:05:40.570048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1942/4144] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:39 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:40.591301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:40.591965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:40.622514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:40.622998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:40.627358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:40.627834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:40.641549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.655327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.657332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.665141 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cbdbd6e7-d2be-48df-9db4-9423ba72dc05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.421284 Mar 26 21:05:40.666741 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2203/4145] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:40 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:40.828880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:40.840929 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c4d0de4-b9d2-49b9-a830-6d47d424f37d tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1273 microversion: 2.1 time: 0.269778 Mar 26 21:05:40.841718 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1943/4146] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:40 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:41.045652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-16df0958-2700-413a-b1c9-b1da0662fb45 req-b32c6c19-727d-4327-a5fa-e9d9432596d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f", "tag": "2e96d99e-6384-4822-8e8d-47269f37f9f7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:41.077083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-16df0958-2700-413a-b1c9-b1da0662fb45 req-b32c6c19-727d-4327-a5fa-e9d9432596d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.078761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-16df0958-2700-413a-b1c9-b1da0662fb45 req-b32c6c19-727d-4327-a5fa-e9d9432596d9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.110628 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-16df0958-2700-413a-b1c9-b1da0662fb45 req-b32c6c19-727d-4327-a5fa-e9d9432596d9 service nova] Creating event network-changed:2e96d99e-6384-4822-8e8d-47269f37f9f7 for instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f on nch2-master-1 Mar 26 21:05:41.124097 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-16df0958-2700-413a-b1c9-b1da0662fb45 req-b32c6c19-727d-4327-a5fa-e9d9432596d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084791 Mar 26 21:05:41.133681 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2204/4147] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:41.160484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e4062819-e397-4272-8ff0-0d52b3d6e50b req-f7edfbaa-4dac-40c2-906f-540dcb886cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "name": "network-vif-plugged", "status": "completed", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:41.176207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e4062819-e397-4272-8ff0-0d52b3d6e50b req-f7edfbaa-4dac-40c2-906f-540dcb886cf6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.176990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e4062819-e397-4272-8ff0-0d52b3d6e50b req-f7edfbaa-4dac-40c2-906f-540dcb886cf6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.210782 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e4062819-e397-4272-8ff0-0d52b3d6e50b req-f7edfbaa-4dac-40c2-906f-540dcb886cf6 service nova] Creating event network-vif-plugged:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:05:41.227414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e4062819-e397-4272-8ff0-0d52b3d6e50b req-f7edfbaa-4dac-40c2-906f-540dcb886cf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067589 Mar 26 21:05:41.230185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1944/4148] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:41.262719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:41.263805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:41.292311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.294969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.298393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.299632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.586520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:41.587312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:41.602017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.602489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.603506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.604156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.839157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:41.850876 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59dfc4d4-3fb8-4c94-993a-5577aac72a8e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.595406 Mar 26 21:05:41.867388 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2205/4149] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:41 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:41.874538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:41.875163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:41.881220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.881665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:41.882444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:41.882887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:42.074875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:42.084072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:42.085800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:42.087680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91c4354a-be09-425b-8f4d-9b4a8ab900f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.218073 Mar 26 21:05:42.088426 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2206/4150] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:41 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:42.093866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:42.094595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:42.100845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:42.101380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:42.102542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:42.103510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:42.116412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:42.125461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dfac7272-d4ec-48c2-9bad-600185c3d042 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 0.543626 Mar 26 21:05:42.126684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1945/4151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:41 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:42.262381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:42.271058 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cf2dba1-978d-4f57-bbb6-bc59a6e6e231 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.181481 Mar 26 21:05:42.272293 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2207/4152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:42 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:42.875632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:42.881023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:42.919768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:42.920636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:42.921531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:42.921980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.106853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:43.108051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:43.123620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.125354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.127561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.135051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.344093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:43.353126 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87cff95d-973e-4ab1-907d-a897c5709ba2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.486221 Mar 26 21:05:43.355836 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1946/4153] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:42 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:43.362639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:43.363541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:43.372553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.373439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.374475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.375337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.662144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:43.672051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:43.677360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:43.684780 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ce43d7ff-0066-4643-a9ea-55fdc7c97f04 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1809 microversion: 2.20 time: 0.582744 Mar 26 21:05:43.687011 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2208/4154] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:43 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1809 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:05:43.701778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:43.702660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:43.715600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.718625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.720339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.724112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.909671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:43.929895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cd56dd2-a969-4dd5-bc0c-36376abc5695 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 0.570801 Mar 26 21:05:43.936165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1947/4155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:43 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:43.945844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:43.954276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:43.971717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.973912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:43.977651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:43.979508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.068305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:44.154215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.166296 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54137423-599d-4397-9c62-67ccdfa789b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.475935 Mar 26 21:05:44.170736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2209/4156] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:43 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:44.176351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2c9ca06b-8697-444b-b7b5-97a331f300e7 req-4aecd517-9041-4f6e-9e94-cff8cda739d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5e27c5-2e06-4f48-9d52-505acebdbbe1", "tag": "aba33f32-869b-4871-8328-07d2ead1bde3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:44.194994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2c9ca06b-8697-444b-b7b5-97a331f300e7 req-4aecd517-9041-4f6e-9e94-cff8cda739d3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.200518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2c9ca06b-8697-444b-b7b5-97a331f300e7 req-4aecd517-9041-4f6e-9e94-cff8cda739d3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.216843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2c9ca06b-8697-444b-b7b5-97a331f300e7 req-4aecd517-9041-4f6e-9e94-cff8cda739d3 service nova] Creating event network-changed:aba33f32-869b-4871-8328-07d2ead1bde3 for instance cd5e27c5-2e06-4f48-9d52-505acebdbbe1 on nch2-master-1 Mar 26 21:05:44.235828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-175c486f-3dd2-446e-b463-dbe3639f11f7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 204 len: 0 microversion: 2.1 time: 0.296448 Mar 26 21:05:44.237870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2c9ca06b-8697-444b-b7b5-97a331f300e7 req-4aecd517-9041-4f6e-9e94-cff8cda739d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065693 Mar 26 21:05:44.238117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1948/4157] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:43 2022] DELETE /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:05:44.239021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2210/4158] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:44.249604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:44.253624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:44.265434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.266218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.267281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.268015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.371967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:44.373057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:44.392254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.392789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.393678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.394201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.578656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.586835 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54ccda23-4ad3-4f2f-9d92-0a8d053b0040 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.219742 Mar 26 21:05:44.598982 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2211/4159] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:44 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:44.692234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.708682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:44.709920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:44.715132 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-06278f5c-677e-4125-8d3d-ff7005fdac16 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1553 microversion: 2.1 time: 0.471003 Mar 26 21:05:44.720132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.720472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1949/4160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:44 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1553 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:44.721160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.722189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.722860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.947877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.953782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:44.954886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:44.960310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.962016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:44.963961 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68624706-a1de-4295-a183-1d3e7118ea90 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1796 microversion: 2.20 time: 0.259445 Mar 26 21:05:44.965035 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2212/4161] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:05:44 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1796 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:05:44.979263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.980405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:44.984363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:44.985389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.193171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:45.194014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:45.213020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.216531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.218544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.220066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.412279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:45.420893 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f657c58f-c217-429c-bffe-686444497928 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.236138 Mar 26 21:05:45.421685 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2213/4162] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:45 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:45.604948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:45.605812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:45.627546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.630397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.632888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.635137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.849856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:45.850529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:45.860273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1edf60a1-762e-4a6c-bc65-b7a436b54ed0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.259804 Mar 26 21:05:45.860510 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb8c0268-1509-43ec-813e-be411128a7cf tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 0.912550 Mar 26 21:05:45.861063 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1950/4163] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:44 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:45.868729 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2214/4164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:45 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:45.879550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:45.880257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:45.888439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.889569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:45.890619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:45.891186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:46.402544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:46.437992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:46.438809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:46.446828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-665837b5-774e-4119-9e99-79d2679c77f5 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1553 microversion: 2.1 time: 0.581520 Mar 26 21:05:46.447456 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1951/4165] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:45 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1553 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:46.451895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:46.452384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:46.453193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:46.453636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:46.878959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:46.883269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:46.908806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:46.909624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:46.911196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:46.911849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.119421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:47.129245 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-35bd9088-b50e-450a-994b-81ff95d7f04e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 0.253922 Mar 26 21:05:47.129767 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1952/4166] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:46 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:47.135353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:47.136026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:47.143079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:47.143529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.144579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:47.145030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.322634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:47.331644 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da74a011-7d8d-42ad-896a-a5a1b3858f3c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.200503 Mar 26 21:05:47.334748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1953/4167] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:47 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:47.457042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:47.464353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:47.465736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:47.468219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8465cf4e-96df-431a-b1c6-2c84d19c9f53 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 1.034008 Mar 26 21:05:47.474062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:47.474893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.476777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:47.477483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.480896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2215/4168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:46 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:47.708192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:47.713582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-bbf78223-9022-4dd4-b241-18d7bff27125 req-a67c1ab8-c4f6-4a9e-a9e2-374f060f89fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f", "name": "network-vif-plugged", "status": "completed", "tag": "2e96d99e-6384-4822-8e8d-47269f37f9f7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:47.719060 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ea744000-ef02-428c-b0c3-07a890a6e46c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1553 microversion: 2.1 time: 0.258563 Mar 26 21:05:47.730281 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1954/4169] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:47 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:47.733265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bbf78223-9022-4dd4-b241-18d7bff27125 req-a67c1ab8-c4f6-4a9e-a9e2-374f060f89fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:47.734017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bbf78223-9022-4dd4-b241-18d7bff27125 req-a67c1ab8-c4f6-4a9e-a9e2-374f060f89fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:47.763422 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-bbf78223-9022-4dd4-b241-18d7bff27125 req-a67c1ab8-c4f6-4a9e-a9e2-374f060f89fd service nova] Creating event network-vif-plugged:2e96d99e-6384-4822-8e8d-47269f37f9f7 for instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f on nch2-master-1 Mar 26 21:05:47.778055 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-bbf78223-9022-4dd4-b241-18d7bff27125 req-a67c1ab8-c4f6-4a9e-a9e2-374f060f89fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069386 Mar 26 21:05:47.778734 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2216/4170] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:48.081298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-29469695-fe78-4e07-8591-e86ae848f5fa req-81ec6f39-d402-463f-9daf-572f2b249f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e291b53c-8620-4e94-915b-ef3c614c12ac", "name": "network-vif-deleted", "tag": "351f6d49-7dc1-4586-92ad-1ec0e7a14585"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:48.096686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-29469695-fe78-4e07-8591-e86ae848f5fa req-81ec6f39-d402-463f-9daf-572f2b249f0d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.097140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-29469695-fe78-4e07-8591-e86ae848f5fa req-81ec6f39-d402-463f-9daf-572f2b249f0d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.138857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-29469695-fe78-4e07-8591-e86ae848f5fa req-81ec6f39-d402-463f-9daf-572f2b249f0d service nova] Creating event network-vif-deleted:351f6d49-7dc1-4586-92ad-1ec0e7a14585 for instance e291b53c-8620-4e94-915b-ef3c614c12ac on nch1-master-1 Mar 26 21:05:48.144479 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-29469695-fe78-4e07-8591-e86ae848f5fa req-81ec6f39-d402-463f-9daf-572f2b249f0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066820 Mar 26 21:05:48.145365 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1955/4171] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:48.148335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:48.149048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:48.164610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.165102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.165900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.166532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.351259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:48.352173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:48.366906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.372260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.375503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.376150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.465540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:48.476451 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1333057f-c663-416b-b179-c84b622800cb tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1395 microversion: 2.1 time: 0.332806 Mar 26 21:05:48.487774 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2217/4172] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:48 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1395 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:48.493950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:48.494641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:48.501918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.502480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.503329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.504013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.588857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:48.597816 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a75c36d4-9d12-4d83-8901-b8e47d9a4f3e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.250473 Mar 26 21:05:48.607950 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1956/4173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:48 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:48.737570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:48.741694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:48.754562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.755108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.766802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.767694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.803540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:48.804363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:48.804792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'fault' on Instance uuid e291b53c-8620-4e94-915b-ef3c614c12ac {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:48.846204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:48.850759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:48.856381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6758fb69-679a-454b-8971-e344c1f05b1c tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.366916 Mar 26 21:05:48.857226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2218/4174] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:48 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:48.861720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-812dfffb-716b-42e1-98ae-56e81b6994d0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 200 len: 1305 microversion: 2.1 time: 0.128309 Mar 26 21:05:48.862765 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1957/4175] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:48 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:49.494928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:49.495489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:49.502198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.502650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.503429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.503867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.617655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:49.618814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:49.625736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.626202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.626992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.627454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.763498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:49.772736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56531581-11a4-45cd-b7ce-080c47d92f4d tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1576 microversion: 2.1 time: 0.280877 Mar 26 21:05:49.773349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2219/4176] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:49 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:49.789473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:49.790254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:49.796372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.797007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.797945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.798535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.852981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:49.860569 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a90b503-7be8-4ee1-851b-4b88cee5a754 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1677 microversion: 2.1 time: 0.246808 Mar 26 21:05:49.861161 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1958/4177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:49 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:49.881293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:49.882314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:49.889965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.890746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.891539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.892141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.976372 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c88dc10c-126b-416c-9f26-b76db35109d7 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190694 Mar 26 21:05:49.977443 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2220/4178] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:05:49 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:49.983072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:49.983707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:49.997323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.997844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:49.998986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:49.999641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:50.020488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. Mar 26 21:05:50.021373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:50.022485 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07dfa1eb-aa88-4183-a955-893b282bb911 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 404 len: 111 microversion: 2.1 time: 0.044070 Mar 26 21:05:50.023371 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2221/4179] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:49 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:50.165131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:50.166406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:50.174684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:50.175640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:50.176867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:50.177486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:50.193982 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. Mar 26 21:05:50.195470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:50.197232 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-550749de-88d7-4e94-9e9f-60fb9e2c4063 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037038 Mar 26 21:05:50.197983 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2222/4180] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:05:50 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:50.319106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:50.333279 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9653801-db26-48a8-ac34-49098121bb47 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.460823 Mar 26 21:05:50.334615 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1959/4181] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:49 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:50.380089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1242532184", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:50.442992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:05:50.878883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:50.880978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:50.893658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:50.894123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:50.894938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:50.895391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.207635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:51.222951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da62d150-5de1-4e90-8e78-7d5a37864805 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1654 microversion: 2.1 time: 0.347218 Mar 26 21:05:51.225942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1960/4182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:50 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1654 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:51.251236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca76b968-6b2d-43a6-8680-016991832db4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:51.263529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca76b968-6b2d-43a6-8680-016991832db4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.264376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca76b968-6b2d-43a6-8680-016991832db4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.294559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca76b968-6b2d-43a6-8680-016991832db4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Going to try to start instance {{(pid=141580) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:05:51.369408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca76b968-6b2d-43a6-8680-016991832db4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.129177 Mar 26 21:05:51.371170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1961/4183] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:05:51 2022] POST /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:05:51.381748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-788e151c-0162-4836-b116-3be0e4c42578 req-61cfd845-c245-4f70-8753-66108f166f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5e27c5-2e06-4f48-9d52-505acebdbbe1", "name": "network-vif-plugged", "status": "completed", "tag": "aba33f32-869b-4871-8328-07d2ead1bde3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:51.393395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-788e151c-0162-4836-b116-3be0e4c42578 req-61cfd845-c245-4f70-8753-66108f166f2e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.394471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-788e151c-0162-4836-b116-3be0e4c42578 req-61cfd845-c245-4f70-8753-66108f166f2e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.414133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-788e151c-0162-4836-b116-3be0e4c42578 req-61cfd845-c245-4f70-8753-66108f166f2e service nova] Creating event network-vif-plugged:aba33f32-869b-4871-8328-07d2ead1bde3 for instance cd5e27c5-2e06-4f48-9d52-505acebdbbe1 on nch2-master-1 Mar 26 21:05:51.420729 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-788e151c-0162-4836-b116-3be0e4c42578 req-61cfd845-c245-4f70-8753-66108f166f2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047226 Mar 26 21:05:51.421897 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1962/4184] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:51.429682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:51.431191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:51.439188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.440291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.441297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.443108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.540742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:05:51.541229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:05:51.542116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:05:51.542544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:05:51.542972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:05:51.582868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.583798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.585741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.588287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.635677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:51.657257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:51.691160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:05:51.693993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:05:51.758374 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-011439ab-2914-488d-8afa-b21e752db48b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382256 Mar 26 21:05:51.762276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2223/4185] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:05:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:05:51.772107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:51.778033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:51.792322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.794335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.796520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.797919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.823262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:51.831034 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-650cb902-2638-4549-82f8-f4d514150403 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1315 microversion: 2.1 time: 0.407520 Mar 26 21:05:51.832486 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1963/4186] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:51 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:51.838502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:51.839280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:51.855979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.860359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:51.866391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:51.868940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.164299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:52.176356 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b147813-9688-448e-9901-9079dda7efcc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1663 microversion: 2.1 time: 0.412703 Mar 26 21:05:52.187973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2224/4187] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:51 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1663 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:52.196796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0d718dbd-1421-48bb-92c5-4bdb3635492f req-e55afcbb-b0c9-4d96-8ff2-5a76c31a0eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f", "tag": "2e96d99e-6384-4822-8e8d-47269f37f9f7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:52.219815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0d718dbd-1421-48bb-92c5-4bdb3635492f req-e55afcbb-b0c9-4d96-8ff2-5a76c31a0eaf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.220307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0d718dbd-1421-48bb-92c5-4bdb3635492f req-e55afcbb-b0c9-4d96-8ff2-5a76c31a0eaf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.246943 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0d718dbd-1421-48bb-92c5-4bdb3635492f req-e55afcbb-b0c9-4d96-8ff2-5a76c31a0eaf service nova] Creating event network-changed:2e96d99e-6384-4822-8e8d-47269f37f9f7 for instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f on nch2-master-1 Mar 26 21:05:52.263954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0d718dbd-1421-48bb-92c5-4bdb3635492f req-e55afcbb-b0c9-4d96-8ff2-5a76c31a0eaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085407 Mar 26 21:05:52.265067 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2225/4188] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:52.270781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45483c8f-69ca-46de-b8a1-636ed64f8652 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:52.271694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45483c8f-69ca-46de-b8a1-636ed64f8652 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:52.376197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:52.386646 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0dc24d87-475d-4324-b743-7f2b63132a56 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1576 microversion: 2.1 time: 0.552932 Mar 26 21:05:52.389696 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1964/4189] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:51 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1576 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:52.482379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45483c8f-69ca-46de-b8a1-636ed64f8652 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:52.490168 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45483c8f-69ca-46de-b8a1-636ed64f8652 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040" status: 200 len: 1215 microversion: 2.1 time: 0.223695 Mar 26 21:05:52.495852 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2226/4190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:52 2022] GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:52.509391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:52.509906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:52.525184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.525979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.527018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.527462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.568030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:52.599201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.599611 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.622373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'flavor' on Instance uuid 2bacac7c-0083-43a8-938e-b6f900094040 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:52.648864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'system_metadata' on Instance uuid 2bacac7c-0083-43a8-938e-b6f900094040 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:52.772318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'metadata' on Instance uuid 2bacac7c-0083-43a8-938e-b6f900094040 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:52.852256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:52.853749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:52.879617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.880669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.884090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:52.885261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:52.977938 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.scheduler.client.report [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Deleted allocations for instance 2bacac7c-0083-43a8-938e-b6f900094040 Mar 26 21:05:53.021588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-97d93891-65c6-408f-93b2-f193b3e81760 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040" status: 204 len: 0 microversion: 2.1 time: 0.517357 Mar 26 21:05:53.022456 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1965/4191] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:52 2022] DELETE /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:05:53.032772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:53.034581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:53.050714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.051270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.052178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.052702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.068427 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. Mar 26 21:05:53.069134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:53.070649 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2907efb4-9d25-4296-a0b2-a8bb2aa143e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040" status: 404 len: 111 microversion: 2.1 time: 0.041987 Mar 26 21:05:53.072747 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1966/4192] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:53 2022] GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:53.195864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:53.197512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:53.216807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.217544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.218573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.222228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.337231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:53.349636 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fb268e2c-7aaa-4a93-a223-36c884c77849 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1464 microversion: 2.1 time: 0.503811 Mar 26 21:05:53.350618 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2227/4193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:52 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1464 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:53.359874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-104462272", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:53.449771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:05:53.627940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:53.636616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6406b003-cfa3-43f7-af35-d776dedba218 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1663 microversion: 2.1 time: 0.446356 Mar 26 21:05:53.637820 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1967/4194] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:53 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1663 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:53.643132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:53.643938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:53.651285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.651812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.652729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.653239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.683335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:05:53.775510 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b183c33c-9b0f-48f8-bf91-433e4e17969f tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 204 len: 0 microversion: 2.1 time: 0.136204 Mar 26 21:05:53.776380 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1968/4195] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:53 2022] DELETE /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:05:53.785513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:53.786695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:53.794506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.795225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:53.796453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:53.797226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:54.062486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:54.072318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4a7ef2c7-5093-4d0b-bf26-8810f6e05f56 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1470 microversion: 2.1 time: 0.290708 Mar 26 21:05:54.072923 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1969/4196] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:53 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:54.106565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:05:54.107015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:05:54.107442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:05:54.108061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:05:54.108633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:05:54.127069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:54.127532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:54.128537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:54.128958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:54.166811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:05:54.172965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:05:54.187490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:05:54.190175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:05:54.252689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35b0ea8e-8c18-4792-b594-dd2fc46a08c8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900069 Mar 26 21:05:54.254349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2228/4197] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:05:54.264961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eda9e163-3979-4e05-9f54-f7b751ce425f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:54.265709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eda9e163-3979-4e05-9f54-f7b751ce425f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:54.347841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eda9e163-3979-4e05-9f54-f7b751ce425f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:54.356418 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eda9e163-3979-4e05-9f54-f7b751ce425f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1214 microversion: 2.1 time: 0.095322 Mar 26 21:05:54.367902 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1970/4198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:54 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:54.654879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:54.655957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:54.665360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:54.666006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:54.667336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:54.667981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:55.091521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:55.092326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:55.105445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:55.106069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:55.109888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:55.111431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:55.131178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:55.141511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8db08714-7daa-455e-ae1e-e75b792155b0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1667 microversion: 2.1 time: 0.489988 Mar 26 21:05:55.142118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2229/4199] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:54 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1667 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:55.385852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:55.386489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:55.395411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:55.398450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:55.399557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:55.406292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:55.431184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:55.448668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2876fc2-84cd-4cf1-910b-c477d81852b7 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1470 microversion: 2.1 time: 0.361866 Mar 26 21:05:55.458310 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1971/4200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:55 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:05:55.518685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:55.543825 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b4e3fa99-d452-490d-ab84-c442d5118330 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1266 microversion: 2.1 time: 0.162522 Mar 26 21:05:55.544464 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2230/4201] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:55 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:56.253491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0f87619f-027c-4a05-b56c-0d2cf57ad87a req-448ac285-5733-46dd-a4c0-9f31de286c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5e27c5-2e06-4f48-9d52-505acebdbbe1", "name": "network-vif-deleted", "tag": "aba33f32-869b-4871-8328-07d2ead1bde3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:56.276438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0f87619f-027c-4a05-b56c-0d2cf57ad87a req-448ac285-5733-46dd-a4c0-9f31de286c50 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.277017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0f87619f-027c-4a05-b56c-0d2cf57ad87a req-448ac285-5733-46dd-a4c0-9f31de286c50 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.292402 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0f87619f-027c-4a05-b56c-0d2cf57ad87a req-448ac285-5733-46dd-a4c0-9f31de286c50 service nova] Creating event network-vif-deleted:aba33f32-869b-4871-8328-07d2ead1bde3 for instance cd5e27c5-2e06-4f48-9d52-505acebdbbe1 on nch2-master-1 Mar 26 21:05:56.309871 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0f87619f-027c-4a05-b56c-0d2cf57ad87a req-448ac285-5733-46dd-a4c0-9f31de286c50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060326 Mar 26 21:05:56.310790 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1972/4202] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:05:56.475814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:56.478101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:56.491034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.491718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.492799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.493640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.541273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.542213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.542853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lazy-loading 'fault' on Instance uuid cd5e27c5-2e06-4f48-9d52-505acebdbbe1 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:05:56.562127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:56.562834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:56.580016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.584287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.586176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:56.588381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:56.598171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfac7b943d654fc88c08d106d57201d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffeef0caf635437194fed3721a8d1d0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:56.612842 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b260ff70-eb4f-4586-bc57-acfa4acc6614 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 200 len: 1305 microversion: 2.1 time: 0.148758 Mar 26 21:05:56.614400 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2231/4203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:56 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:56.955386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:56.962919 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25f752ba-3360-4c7f-8c0d-83d40452d200 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1314 microversion: 2.1 time: 0.405018 Mar 26 21:05:56.963725 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1973/4204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:56 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:57.415711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4c836e72-e7fa-4aa3-a9c1-4fca39410458 req-37766126-70b0-43a6-b14f-661f09766a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3", "tag": "8d48f211-ac1b-4be6-b4f7-5b36f78d1307"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:05:57.433163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4c836e72-e7fa-4aa3-a9c1-4fca39410458 req-37766126-70b0-43a6-b14f-661f09766a91 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:57.435109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4c836e72-e7fa-4aa3-a9c1-4fca39410458 req-37766126-70b0-43a6-b14f-661f09766a91 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:57.461426 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4c836e72-e7fa-4aa3-a9c1-4fca39410458 req-37766126-70b0-43a6-b14f-661f09766a91 service nova] Creating event network-changed:8d48f211-ac1b-4be6-b4f7-5b36f78d1307 for instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 on nch1-master-1 Mar 26 21:05:57.473565 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4c836e72-e7fa-4aa3-a9c1-4fca39410458 req-37766126-70b0-43a6-b14f-661f09766a91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062174 Mar 26 21:05:57.479396 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2232/4205] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:05:57.630551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:57.631265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] [instance: cd5e27c5-2e06-4f48-9d52-505acebdbbe1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:57.638118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:57.654251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:57.655267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:57.663822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:57.690711 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] HTTP exception thrown: Instance cd5e27c5-2e06-4f48-9d52-505acebdbbe1 could not be found. Mar 26 21:05:57.691580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] Returning 404 to user: Instance cd5e27c5-2e06-4f48-9d52-505acebdbbe1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:05:57.695759 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1563ff16-188b-46e3-bb62-f99570c831f8 tempest-VolumesNegativeTest-1084825935 tempest-VolumesNegativeTest-1084825935-project] 10.222.0.16 "GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1" status: 404 len: 111 microversion: 2.1 time: 0.069018 Mar 26 21:05:57.696945 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1974/4206] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:57 2022] GET /compute/v2.1/servers/cd5e27c5-2e06-4f48-9d52-505acebdbbe1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:57.982856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:57.986215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:58.001809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:58.002242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:58.003096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:58.003481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:58.474649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:58.486007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b9cb6e3-5318-41a3-a7fb-1659d346cbb0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1314 microversion: 2.1 time: 0.508625 Mar 26 21:05:58.508202 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2233/4207] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:57 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:05:59.504858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:05:59.505490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:05:59.514233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:59.514703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:59.515489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:05:59.516582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:05:59.859832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:05:59.897627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe551baa-4aab-4e17-a40e-f563836bdae4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1314 microversion: 2.1 time: 0.392254 Mar 26 21:05:59.902380 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1975/4208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:59 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:00.919778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:00.926010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:00.936396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:00.938394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:00.943800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:00.945765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:01.187049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:01.195943 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1f0c6c05-3256-497c-b0fa-540ad46a1d56 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1314 microversion: 2.1 time: 0.281212 Mar 26 21:06:01.197247 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2234/4209] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:00 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:02.033943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b7eef80b-22ba-4f02-b9d0-6b94ef25aed5 req-c035e2b1-b138-4455-85e3-859cda780bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3", "name": "network-vif-plugged", "status": "completed", "tag": "8d48f211-ac1b-4be6-b4f7-5b36f78d1307"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:02.047396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b7eef80b-22ba-4f02-b9d0-6b94ef25aed5 req-c035e2b1-b138-4455-85e3-859cda780bfb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:02.048489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b7eef80b-22ba-4f02-b9d0-6b94ef25aed5 req-c035e2b1-b138-4455-85e3-859cda780bfb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:02.081394 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b7eef80b-22ba-4f02-b9d0-6b94ef25aed5 req-c035e2b1-b138-4455-85e3-859cda780bfb service nova] Creating event network-vif-plugged:8d48f211-ac1b-4be6-b4f7-5b36f78d1307 for instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 on nch1-master-1 Mar 26 21:06:02.089587 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b7eef80b-22ba-4f02-b9d0-6b94ef25aed5 req-c035e2b1-b138-4455-85e3-859cda780bfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059633 Mar 26 21:06:02.094484 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1976/4210] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:02.214438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:02.215449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:02.226899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:02.234314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:02.236284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:02.247882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:02.550743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:02.560279 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af034d04-5c4d-4a2b-b59b-f0d038740a8b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1314 microversion: 2.1 time: 0.350534 Mar 26 21:06:02.562118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2235/4211] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:02 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:03.579736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:03.581197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:03.607378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:03.608016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:03.610175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:03.611475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:03.938300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:03.952627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a1347117-d25f-4e6e-bce6-79fea40b2ea0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1500 microversion: 2.1 time: 0.375661 Mar 26 21:06:03.953366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1977/4212] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:03 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:03.971634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:03.972313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:03.986768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:03.987243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:03.988099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:03.988550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:04.116034 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-718bbf3a-3a3c-4912-bef0-4c283e42dc38 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3/action" status: 202 len: 0 microversion: 2.1 time: 0.150307 Mar 26 21:06:04.117350 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2236/4213] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:06:03 2022] POST /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:06:04.136823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:04.139616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:04.170185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:04.178949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:04.180661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:04.181326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:04.536548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:04.547345 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d0a69df-2e28-4f0d-83f7-843bb5914b3e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1505 microversion: 2.1 time: 0.421810 Mar 26 21:06:04.549441 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1978/4214] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:04 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:05.568337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:05.569919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:05.583314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:05.584234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:05.585364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:05.586279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:05.840259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:05.851806 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d5356ef-a1f6-429b-a217-4a31cfe8571f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1485 microversion: 2.1 time: 0.288426 Mar 26 21:06:05.853006 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2237/4215] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:05 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:05.869498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:05.870088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:05.882625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:05.883113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:05.884116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:05.884829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:05.929681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:06:06.032734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cd4732c4-da8e-41bb-b11e-b52acc1f95f6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 204 len: 0 microversion: 2.1 time: 0.166889 Mar 26 21:06:06.036767 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1979/4216] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:06:05 2022] DELETE /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:06.054243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:06.054886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:06.061917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:06.062378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:06.067800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:06.071777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:06.447061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:06.455545 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1daa0ff4-b9ab-4c8a-a125-e99987400719 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1491 microversion: 2.1 time: 0.417799 Mar 26 21:06:06.456381 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2238/4217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:06 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1491 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:07.480513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:07.486634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:07.510271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:07.510271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:07.510271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:07.510271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:07.815823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:07.825845 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c74a9cd3-a72e-4abc-8ce3-42c4961c07cb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1491 microversion: 2.1 time: 0.354363 Mar 26 21:06:07.838481 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1980/4218] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:07 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1491 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:08.763035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-773bca27-0493-4820-a34b-476d7edea3bb req-def627c6-e64d-4016-aa1e-25cf4c9764c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3", "name": "network-vif-deleted", "tag": "8d48f211-ac1b-4be6-b4f7-5b36f78d1307"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:08.776726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-773bca27-0493-4820-a34b-476d7edea3bb req-def627c6-e64d-4016-aa1e-25cf4c9764c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:08.778029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-773bca27-0493-4820-a34b-476d7edea3bb req-def627c6-e64d-4016-aa1e-25cf4c9764c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:08.797902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-773bca27-0493-4820-a34b-476d7edea3bb req-def627c6-e64d-4016-aa1e-25cf4c9764c6 service nova] Creating event network-vif-deleted:8d48f211-ac1b-4be6-b4f7-5b36f78d1307 for instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 on nch1-master-1 Mar 26 21:06:08.804307 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-773bca27-0493-4820-a34b-476d7edea3bb req-def627c6-e64d-4016-aa1e-25cf4c9764c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058475 Mar 26 21:06:08.806685 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2239/4219] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:08.843626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:08.844298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:08.855792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:08.856598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:08.857808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:08.859180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:08.892589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:08.893322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:08.893966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'fault' on Instance uuid b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:06:08.948931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:08.957475 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-07eee08a-9237-48ec-a152-eb305293ebad tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 200 len: 1304 microversion: 2.1 time: 0.117872 Mar 26 21:06:08.968734 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1981/4220] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:08 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:09.976233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:09.977838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:09.989275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:09.990303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:09.993386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:09.994579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:10.014273 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. Mar 26 21:06:10.015216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:06:10.016270 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14c94c0d-0a65-42d0-a37b-e02fec5cb93b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 404 len: 111 microversion: 2.1 time: 0.045355 Mar 26 21:06:10.027226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2240/4221] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:09 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:06:10.225390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-57505148", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:10.300409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:06:11.160589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:06:11.161330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:06:11.162054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:06:11.162709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:06:11.163348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:06:11.181426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:11.182154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:11.183235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:11.185162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:11.233230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:11.257572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:11.296027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:06:11.298692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:06:11.386520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-448c0934-348b-466b-bc91-979f38907525 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164685 Mar 26 21:06:11.389228 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1982/4222] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:06:11.399824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c204c8f-2c47-408f-b31b-3a83c74e03ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:11.401136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c204c8f-2c47-408f-b31b-3a83c74e03ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:11.500869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c204c8f-2c47-408f-b31b-3a83c74e03ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:11.510121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c204c8f-2c47-408f-b31b-3a83c74e03ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1213 microversion: 2.1 time: 0.114588 Mar 26 21:06:11.512504 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2241/4223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:11 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:12.529811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:12.531001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:12.537298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:12.537764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:12.538552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:12.538998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:12.664284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:12.672518 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26d2583b-57c0-420a-9ee4-3bb3f14c6d94 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1265 microversion: 2.1 time: 0.147281 Mar 26 21:06:12.683615 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1983/4224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:12 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:13.693323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:13.693951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:13.709031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:13.709697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:13.714070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:13.716487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:13.927731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:13.939680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f75f1d7b-9c4a-4dda-80fe-ccc3a267baed tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1271 microversion: 2.1 time: 0.252247 Mar 26 21:06:13.940959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2242/4225] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:13 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1271 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:14.959000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:14.959599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:14.976344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:14.991790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:14.993315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:14.994046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:15.433805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:15.449121 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7e4cf4f-7d59-41d1-b5eb-0241cafb0b4a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.493936 Mar 26 21:06:15.460842 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1984/4226] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:14 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:16.181968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ec93a5fc-fea3-408f-872a-b4b748348196 req-6dc18244-3f54-425b-82d4-8e655aea65c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6", "tag": "81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:16.202279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec93a5fc-fea3-408f-872a-b4b748348196 req-6dc18244-3f54-425b-82d4-8e655aea65c1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:16.202755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec93a5fc-fea3-408f-872a-b4b748348196 req-6dc18244-3f54-425b-82d4-8e655aea65c1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:16.228869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ec93a5fc-fea3-408f-872a-b4b748348196 req-6dc18244-3f54-425b-82d4-8e655aea65c1 service nova] Creating event network-changed:81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20 for instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 on nch1-master-1 Mar 26 21:06:16.246850 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ec93a5fc-fea3-408f-872a-b4b748348196 req-6dc18244-3f54-425b-82d4-8e655aea65c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Mar 26 21:06:16.248069 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2243/4227] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:16.468101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:16.468639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:16.488457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:16.489229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:16.490226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:16.490844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:17.390952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:17.398908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-16756f65-03b1-45e2-baa1-0395a9488ec0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.935794 Mar 26 21:06:17.401635 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1985/4228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:16 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:18.051651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:18.052401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:18.060146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.061021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.064989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.065906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.143216 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c788e327-fac6-4102-b8d1-d044ee50cde5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments/575bb058-c5ae-4a01-831b-e61c0faaa551" status: 200 len: 194 microversion: 2.20 time: 0.096103 Mar 26 21:06:18.153241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2244/4229] 10.222.0.16 () {60 vars in 1453 bytes} [Sat Mar 26 21:06:18 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments/575bb058-c5ae-4a01-831b-e61c0faaa551 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:06:18.259661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:18.260296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:18.271034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.271888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.273040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.275138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.427989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:18.428935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:18.437030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lazy-loading 'services' on Instance uuid 39b61f71-6468-4d03-87ff-51120f2911c4 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:06:18.454170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.457712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.458734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.461053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.625526 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8524f3d1-b5f2-4483-b3f8-16c05765942b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments/575bb058-c5ae-4a01-831b-e61c0faaa551" status: 202 len: 0 microversion: 2.20 time: 0.370167 Mar 26 21:06:18.626517 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1986/4230] 10.222.0.16 () {60 vars in 1456 bytes} [Sat Mar 26 21:06:18 2022] DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments/575bb058-c5ae-4a01-831b-e61c0faaa551 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:18.646512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:18.658265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:18.681202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.681968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.691036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:18.691819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:18.778404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0b7aba83-13ee-42b6-bbc9-37645a3b32ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147151 Mar 26 21:06:18.789516 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1987/4231] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 21:06:18 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:06:18.964406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:18.974396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edfc0e16-3a51-4d5b-9779-dda377896eb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.560480 Mar 26 21:06:18.986658 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2245/4232] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:18 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:19.802177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:19.804150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:19.820108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:19.821178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:19.821994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:19.822445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:19.867895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48dbb091-c3b1-455d-87e4-e41a7570245b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071260 Mar 26 21:06:19.878144 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1988/4233] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 21:06:19 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:19.964718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:19.965217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:19.973029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:19.973778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:19.974750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:19.975365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:19.993039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:19.995281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:20.003249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.004557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.005586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.006551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.035083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:06:20.142992 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcca5561-a070-47e4-aa15-fcb2c0b87d13 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 204 len: 0 microversion: 2.20 time: 0.181500 Mar 26 21:06:20.144883 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2246/4234] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:06:19 2022] DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:06:20.157613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:20.158366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:20.168888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.169725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.171128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.172450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.297174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:20.316718 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e587cd3-045c-4497-9144-8db7cd5eb1e8 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.323669 Mar 26 21:06:20.317670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1989/4235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:19 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:20.548296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2aab1b49-503c-4342-8e2f-a94be8e0c0de tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1518339534", "availability_zone": "foo_zone"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:20.550291 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:20.550291 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:20.551434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.aggregate [None req-2aab1b49-503c-4342-8e2f-a94be8e0c0de tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Generated uuid d1e9251d-6b8f-478d-89b7-88387dcab34c for aggregate {{(pid=141580) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 26 21:06:20.599496 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2aab1b49-503c-4342-8e2f-a94be8e0c0de tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.280678 Mar 26 21:06:20.600955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1990/4236] 10.222.0.16 () {60 vars in 1163 bytes} [Sat Mar 26 21:06:20 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:20.613852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92582834-0ab9-4704-8178-a9655c940d3d tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:20.615308 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:20.615308 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:20.650299 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92582834-0ab9-4704-8178-a9655c940d3d tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.040872 Mar 26 21:06:20.651512 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1991/4237] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 21:06:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:20.662969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:20.671682 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:20.671682 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:20.673711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.674299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.675160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.675595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.733493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d06265fa-6756-4b9a-afe7-6e2a8a764f25 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076124 Mar 26 21:06:20.742153 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1992/4238] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Mar 26 21:06:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:06:20.746987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3ef3a8d-1d52-473b-af2a-04c1f8e148d7 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:20.747893 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:20.747893 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:20.758162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3ef3a8d-1d52-473b-af2a-04c1f8e148d7 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014586 Mar 26 21:06:20.761304 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1993/4239] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 21:06:20 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:20.768966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a929c952-61c9-4b70-884b-890b32238bfb tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:20.770284 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:20.770284 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:20.780046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a929c952-61c9-4b70-884b-890b32238bfb tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:20.780564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a929c952-61c9-4b70-884b-890b32238bfb tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:20.832454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:20.845668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:20.852127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:20.860202 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4b3a291-e933-4dcb-8193-4cf87b73041f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.707709 Mar 26 21:06:20.861617 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2247/4240] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:20 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:21.088897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a929c952-61c9-4b70-884b-890b32238bfb tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.323400 Mar 26 21:06:21.090194 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1994/4241] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 21:06:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:06:21.100805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d20fbd4-05ec-455d-aefc-a163ce24d923 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:21.101857 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.101857 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:06:21.110654 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d20fbd4-05ec-455d-aefc-a163ce24d923 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013940 Mar 26 21:06:21.111454 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2248/4242] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 21:06:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:06:21.122928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-129d957d-e6de-4b06-88c1-0d233041eafc tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-187464510", "availability_zone": "foo_zone"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:21.124381 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.124381 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:21.177654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-129d957d-e6de-4b06-88c1-0d233041eafc tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.058613 Mar 26 21:06:21.183948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1995/4243] 10.222.0.16 () {60 vars in 1172 bytes} [Sat Mar 26 21:06:21 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:21.194492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c0fbfff-7896-43b5-9a2f-684d64674e1d tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:21.196639 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.196639 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:06:21.234730 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c0fbfff-7896-43b5-9a2f-684d64674e1d tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.044384 Mar 26 21:06:21.236269 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2249/4244] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 21:06:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:21.248283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fce4f6f9-7ab8-4dea-be8b-6c47dab7f3e4 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:21.249438 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.249438 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:06:21.261857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fce4f6f9-7ab8-4dea-be8b-6c47dab7f3e4 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.018833 Mar 26 21:06:21.262426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1996/4245] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 21:06:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:06:21.276093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f880b205-3107-4ce1-ac40-44d36f99cb8c tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:21.277337 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.277337 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:06:21.285807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f880b205-3107-4ce1-ac40-44d36f99cb8c tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:21.286227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f880b205-3107-4ce1-ac40-44d36f99cb8c tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:21.337934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:21.338834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:21.352548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:21.355114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:21.356281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:21.357341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:21.550408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f880b205-3107-4ce1-ac40-44d36f99cb8c tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.279611 Mar 26 21:06:21.551366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2250/4246] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Mar 26 21:06:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:21.563398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72a650da-1b3c-417f-86c6-c261e8e3ad13 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:21.564492 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:06:21.564492 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:06:21.583776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:21.596030 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72a650da-1b3c-417f-86c6-c261e8e3ad13 tempest-TestAggregatesBasicOps-423035475 tempest-TestAggregatesBasicOps-423035475-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.036542 Mar 26 21:06:21.597396 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2251/4247] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 21:06:21 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 26 21:06:21.607141 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-116a1b6d-c7e7-4be9-a29c-fedd4f4069cc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.275752 Mar 26 21:06:21.615979 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1997/4248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:21 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:21.889779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:21.892282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:21.899265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:21.900016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:21.901017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:21.901469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:22.181398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:22.242129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:22.246347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:22.249101 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f5d62268-01e0-4056-b695-d5b7d45fa830 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.372133 Mar 26 21:06:22.250020 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2252/4249] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:21 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:22.632302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:22.633162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:22.646944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:22.649555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:22.650745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:22.651480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:23.244002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:23.255322 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92004ff8-2653-42a4-af54-fabd575c56ca tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.628875 Mar 26 21:06:23.256265 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1998/4250] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:22 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:23.266834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:23.268185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:23.284545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:23.285089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:23.286120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:23.286896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:23.625567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:23.638717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:23.647633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:23.649482 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-339ce056-c51a-4b2a-a088-3baf7663a3f6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1724 microversion: 2.20 time: 0.386862 Mar 26 21:06:23.650097 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2253/4251] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:23 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:24.281617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:24.284084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:24.327486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.331752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.333123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.337705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.358423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cfdc9127-7976-4c86-91c5-e9d1366e715b req-69a6fcf4-858c-46a2-b3d7-1d5712e3eaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b61f71-6468-4d03-87ff-51120f2911c4", "name": "network-vif-deleted", "tag": "0b287a38-d197-43f5-93fb-a9adf2828080"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:24.382750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cfdc9127-7976-4c86-91c5-e9d1366e715b req-69a6fcf4-858c-46a2-b3d7-1d5712e3eaa8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.384496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cfdc9127-7976-4c86-91c5-e9d1366e715b req-69a6fcf4-858c-46a2-b3d7-1d5712e3eaa8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.419218 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cfdc9127-7976-4c86-91c5-e9d1366e715b req-69a6fcf4-858c-46a2-b3d7-1d5712e3eaa8 service nova] Creating event network-vif-deleted:0b287a38-d197-43f5-93fb-a9adf2828080 for instance 39b61f71-6468-4d03-87ff-51120f2911c4 on nch1-master-1 Mar 26 21:06:24.435958 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cfdc9127-7976-4c86-91c5-e9d1366e715b req-69a6fcf4-858c-46a2-b3d7-1d5712e3eaa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084474 Mar 26 21:06:24.437363 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2254/4252] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:06:24.678369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:24.680219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:24.691292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.692880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.701133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.702082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.783728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:24.787051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:24.788731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lazy-loading 'fault' on Instance uuid 39b61f71-6468-4d03-87ff-51120f2911c4 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:06:24.869856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:24.885763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:24.890151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:24.891738 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2fe76677-1c29-427f-98dd-5d96162d59cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 200 len: 1372 microversion: 2.20 time: 0.226199 Mar 26 21:06:24.893986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2255/4253] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:24 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:24.922882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:24.937599 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5ea0fb8-bf27-4ee4-a396-0a329ca5bf08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.667435 Mar 26 21:06:24.943173 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 1999/4254] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:24 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:25.272973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cb981cf1-9942-444d-b660-af9cfd091007 req-d8b168a2-8bd0-44f2-8afa-0b271c93773f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6", "name": "network-vif-plugged", "status": "completed", "tag": "81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:25.295534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb981cf1-9942-444d-b660-af9cfd091007 req-d8b168a2-8bd0-44f2-8afa-0b271c93773f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:25.298651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb981cf1-9942-444d-b660-af9cfd091007 req-d8b168a2-8bd0-44f2-8afa-0b271c93773f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:25.340399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cb981cf1-9942-444d-b660-af9cfd091007 req-d8b168a2-8bd0-44f2-8afa-0b271c93773f service nova] Creating event network-vif-plugged:81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20 for instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 on nch1-master-1 Mar 26 21:06:25.357396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cb981cf1-9942-444d-b660-af9cfd091007 req-d8b168a2-8bd0-44f2-8afa-0b271c93773f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088894 Mar 26 21:06:25.360596 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2256/4255] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:25.915292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:25.917475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:25.931190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:25.934011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:25.936255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:25.941605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:25.961545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:25.962532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:25.978880 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. Mar 26 21:06:25.979888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:06:25.981049 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3371b651-0ed2-4e78-882a-d136fc7acb3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 404 len: 111 microversion: 2.20 time: 0.072267 Mar 26 21:06:25.981213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:25.981526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:25.981940 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2000/4256] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:25 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:06:25.992154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3fc177ac-f420-4b2a-95d4-b674d22b09b9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '.version_select at 0x7f6e586e9310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:25.993099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:25.993785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:26.076651 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3fc177ac-f420-4b2a-95d4-b674d22b09b9 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081840065" status: 204 len: 0 microversion: 2.20 time: 0.061091 Mar 26 21:06:26.076651 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2001/4257] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 21:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081840065 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:06:26.721651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:26.738211 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4814ebdb-c8d6-446a-a37f-939383230168 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1313 microversion: 2.1 time: 0.781659 Mar 26 21:06:26.739674 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2257/4258] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:25 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:27.236921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:27.244271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:27.245438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Searching by: {'deleted': False, 'project_id': '62670a489b2b43b78d9e1e71371e7886'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:06:27.254773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.255623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.256722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.258030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.305755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:06:27.341378 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba85bfc9-2ac5-4947-a0be-1bf037b73128 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.110213 Mar 26 21:06:27.342269 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2002/4259] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 21:06:27 2022] GET /compute/v2.1/servers => generated 334 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:27.354874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:27.358694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:27.359632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Searching by: {'deleted': False, 'project_id': '62670a489b2b43b78d9e1e71371e7886'} {{(pid=141581) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:06:27.369730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.370604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.371732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.372637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.414328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.multi_cell_list [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141581) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:06:27.458142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:27.465906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.466608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.758119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:27.759167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:27.769671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.771069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:27.772814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:27.774061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:28.194319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:28.223144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c32b5b4b-fe7d-4df7-9b50-916ed4290c21 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1500 microversion: 2.1 time: 0.465404 Mar 26 21:06:28.238015 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2003/4260] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:27 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1500 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:28.250999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:28.252397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:28.270552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:28.271286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:28.275299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:28.282070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:28.332423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'flavor' on Instance uuid ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:06:28.400881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ecd1787d-f13b-4139-953a-bfaa59e8d8d0 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.050876 Mar 26 21:06:28.413418 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2258/4261] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:06:27 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:28.424332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6941c504-c018-47bd-bd9f-c13d3d020974 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:28.471723 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6941c504-c018-47bd-bd9f-c13d3d020974 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.056171 Mar 26 21:06:28.477103 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2259/4262] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:06:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:28.802297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:28.802754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:28.813545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:28.818821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:28.829468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:28.830324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:28.864375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:06:29.032281 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b65c2556-2987-4594-91e8-5512dbfd6e79 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "DELETE /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 204 len: 0 microversion: 2.1 time: 0.234330 Mar 26 21:06:29.033246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2260/4263] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:06:28 2022] DELETE /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:29.054339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:29.061535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:29.065311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9605c4b1-7778-46c7-97fe-a6a338d768e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6/action" status: 202 len: 0 microversion: 2.1 time: 0.822929 Mar 26 21:06:29.075076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:29.077161 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2004/4264] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:06:28 2022] POST /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:06:29.079665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:29.082847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:29.085157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:29.086431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:29.100544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:29.134016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:29.144419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:29.145594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:29.146057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:29.437582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:29.453601 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-586b3a21-b007-4a8d-9b32-54c6de35d5c6 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1701 microversion: 2.1 time: 0.415033 Mar 26 21:06:29.475142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2261/4265] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:29 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1701 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:29.485324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: .version_select at 0x7f6e581fd040>, body: {"keypair": {"name": "tempest-keypair-683392406"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:29.523252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:29.539659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:29.812329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:29.838367 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4b3789b-169c-49b0-9472-bf1ca20f153c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.758207 Mar 26 21:06:29.840074 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2005/4266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:29 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:30.283867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:30.293048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:30.322635 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4705fa7d-840a-4ce8-94cb-8ac29c93d190 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.845419 Mar 26 21:06:30.329300 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2262/4267] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 21:06:29 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 853 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:06:30.478823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:30.479781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:30.490230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:30.495260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:30.496355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:30.499687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:30.858411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:30.859191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:30.873014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:30.873753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:30.879349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:30.880211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:31.108107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:31.120806 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5894fd61-d590-4dbe-a617-23ae51987de1 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1701 microversion: 2.1 time: 0.645855 Mar 26 21:06:31.121408 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2006/4268] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:30 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1701 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:31.358385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:31.374633 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7d37777-02ef-4f72-ab96-0cc5def6e41c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.521449 Mar 26 21:06:31.375249 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2263/4269] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:30 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:32.144510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:32.147803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:32.159725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:32.161807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:32.163208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:32.164410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:32.318765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:32.331180 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-398327bb-e192-4cb0-8036-03198f3f266e tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1634 microversion: 2.1 time: 0.193006 Mar 26 21:06:32.332833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2007/4270] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:32 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1634 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:32.392617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:32.394639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:32.402920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:32.404942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:32.406987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:32.408254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:33.242256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7b39ea46-528f-48e9-aeb2-ee7d2a0da61c req-40a30ca9-09a0-46f2-98dc-43b4665cae76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f", "name": "network-vif-deleted", "tag": "2e96d99e-6384-4822-8e8d-47269f37f9f7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:33.267474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7b39ea46-528f-48e9-aeb2-ee7d2a0da61c req-40a30ca9-09a0-46f2-98dc-43b4665cae76 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:33.269733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7b39ea46-528f-48e9-aeb2-ee7d2a0da61c req-40a30ca9-09a0-46f2-98dc-43b4665cae76 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:33.302099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7b39ea46-528f-48e9-aeb2-ee7d2a0da61c req-40a30ca9-09a0-46f2-98dc-43b4665cae76 service nova] Creating event network-vif-deleted:2e96d99e-6384-4822-8e8d-47269f37f9f7 for instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f on nch2-master-1 Mar 26 21:06:33.311980 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7b39ea46-528f-48e9-aeb2-ee7d2a0da61c req-40a30ca9-09a0-46f2-98dc-43b4665cae76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076218 Mar 26 21:06:33.313323 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2008/4271] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:33.352676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:33.353718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:33.380047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:33.380519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:33.384740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:33.385639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:33.515848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:33.520309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:33.521258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lazy-loading 'fault' on Instance uuid 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:06:33.644889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a76b26808b84a2ba82f49753035dd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62670a489b2b43b78d9e1e71371e7886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:33.654875 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b904171a-a77e-4fa9-a0a8-9fcf0317c3a9 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 200 len: 1360 microversion: 2.1 time: 0.308727 Mar 26 21:06:33.660110 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2009/4272] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:33 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:33.854860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:33.871615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b2109f2-c43e-4efd-b1d7-f79323f0dcda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 1.483551 Mar 26 21:06:33.874728 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2264/4273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:32 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:34.432671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.433738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:34.445060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.446055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.447328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.448172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.486683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a105940-17bf-4e20-914f-c575cc50f347 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059189 Mar 26 21:06:34.487674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2010/4274] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:06:34 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:06:34.604121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.605078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:34.618825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.619295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.624037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.624765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.677670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.678373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] [instance: 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:34.689958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.694161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.705009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.707806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.720063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:06:34.732587 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] HTTP exception thrown: Instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f could not be found. Mar 26 21:06:34.735466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Returning 404 to user: Instance 371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:06:34.737886 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca072e39-4475-4c8d-b9a5-9d76af8f8605 tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f" status: 404 len: 111 microversion: 2.1 time: 0.064952 Mar 26 21:06:34.743573 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2011/4275] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:34 2022] GET /compute/v2.1/servers/371d3b1f-fe63-4a79-81a9-dd47d8ec0d3f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:06:34.758998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-129063d5-cd9a-47ee-90e8-41fcd13b7fad tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] Calling method '.version_select at 0x7f6e5876bca0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.788611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-129063d5-cd9a-47ee-90e8-41fcd13b7fad tempest-ServersTestJSON-1945293171 tempest-ServersTestJSON-1945293171-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594123671" status: 202 len: 0 microversion: 2.1 time: 0.042383 Mar 26 21:06:34.790285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2012/4276] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1594123671 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:06:34.891753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.892777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:34.907973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.911073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.912194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.919450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.926830 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c2635cff-3797-4f50-9bae-9a1387e39f15 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 204 len: 0 microversion: 2.1 time: 0.326441 Mar 26 21:06:34.928402 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2265/4277] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:06:34 2022] DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:34.951214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:34.952385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:34.970836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.971394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:34.972287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:34.972817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:35.885359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:35.895317 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96183bc6-900c-4821-ba37-ed2a8088dca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 1.008540 Mar 26 21:06:35.901476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2013/4278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:34 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:35.907569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1618933516", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb6c52d1-d568-4f84-9ff8-81cc9efd0e84"}], "security_groups": [{"name": "tempest-securitygroup--1224925184"}], "key_name": "tempest-keypair-683392406", "user_data": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:35.942697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:35.952048 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38a87e42-c958-4c9d-a103-4e60fe9c2b66 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1673 microversion: 2.1 time: 1.018965 Mar 26 21:06:35.966131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2266/4279] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:34 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1673 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:36.227882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] validate_networks() for [('bb6c52d1-d568-4f84-9ff8-81cc9efd0e84', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:06:36.916046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:36.916965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:36.924513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:36.925542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:36.932770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:36.933240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:37.667080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:37.677882 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-098297b8-b0b9-49f4-936a-cc9377689a8f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.765753 Mar 26 21:06:37.682102 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2267/4280] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:36 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:37.688940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:37.690630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:37.700050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:37.701661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:37.702748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:37.703501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:37.816691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:06:37.818604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:06:37.819260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:06:37.819880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:06:37.820489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:06:37.842489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:37.843159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:37.844184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:37.844871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:37.883849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:37.908029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Getting quotas for user 321431f1b82447d28c58e7d03fd20515 and project 5a748aa42d5c4f55bd7d2d86838ff112. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:37.934327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:06:37.936972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:06:38.062213 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-21ae5260-d86f-4061-a076-a6e7d27a0657 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.159346 Mar 26 21:06:38.063822 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2014/4281] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:06:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:06:38.076564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:38.078263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:38.250243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:38.271304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:38.280683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:38.283520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b52f17d-8df5-45de-b9b2-56ae091b2971 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1281 microversion: 2.20 time: 0.213589 Mar 26 21:06:38.289867 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2015/4282] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:38 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:38.431733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:38.439810 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-905cd1cd-03b0-4bbd-bdf4-2dc47388ccda tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1673 microversion: 2.1 time: 0.755755 Mar 26 21:06:38.440501 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2268/4283] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:37 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1673 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:38.701366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:38.702232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:38.746335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:38.751960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:38.756879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:38.758323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:39.306799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:39.307414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:39.322341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:39.322806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:39.327028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:39.328905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:39.503585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:39.511581 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6c842e6-109a-4be4-b5b5-1bd68ed0eeb6 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.817106 Mar 26 21:06:39.516101 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2016/4284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:38 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:39.521128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:39.530752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:39.540088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:39.540625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:39.549561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:39.550131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:39.661103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:39.673449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:39.675782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:39.681252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9dc1812-fef0-462e-9f2a-dd67c002f8b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1277 microversion: 2.20 time: 0.379493 Mar 26 21:06:39.692132 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2269/4285] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:39 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:06:40.218563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:40.225744 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-237b1477-7c14-444e-95e2-010a203082ca tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1605 microversion: 2.1 time: 0.708248 Mar 26 21:06:40.226345 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2017/4286] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:39 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1605 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:40.533033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:40.534253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:40.550519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:40.551183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:40.552202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:40.552812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:40.699702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:40.700564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:40.713701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:40.714157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:40.723189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:40.724990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:40.966107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:40.977632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:40.981051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:40.981681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:40.987069 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c5ebac0-ee97-45d6-9579-c2bd46dc881a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1339 microversion: 2.20 time: 0.289408 Mar 26 21:06:40.988303 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2018/4287] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:40 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1339 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:06:41.003793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c3ce7a3-5b20-44d5-b2c0-e84deea03693 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.474526 Mar 26 21:06:41.004439 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2270/4288] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:40 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:41.247398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:41.248477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:41.256860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:41.257640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:41.258439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:41.258876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:41.578456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:41.586910 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-91f8cd45-a211-4086-afe9-2ccb95fd4b00 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1605 microversion: 2.1 time: 0.347780 Mar 26 21:06:41.597214 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2019/4289] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:41 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1605 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:42.005724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:42.006347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:42.021688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:42.022315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:42.030672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.031130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.031941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.037333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.045294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.046161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.046612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.050004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.612853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:42.620966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:42.632725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:42.633939 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e8203dfa-bf71-4d51-8f97-9f84fdf64269 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1339 microversion: 2.20 time: 0.632266 Mar 26 21:06:42.651766 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2271/4290] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:42 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1339 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:42.657480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:42.658110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:42.672305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.672757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.673580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.680630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.852403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:42.862203 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a32a031-9133-43e5-955c-b4a07d2647e2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 200 len: 1605 microversion: 2.1 time: 0.209030 Mar 26 21:06:42.865247 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2272/4291] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:42 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:42.887967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-edd23286-a94d-483d-814f-6ec8aa878962 req-7c00824b-4478-4a90-89b5-a0094e103b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c0441e-1bda-47d4-a6d1-9139adecc0b5", "name": "network-vif-deleted", "tag": "e9dccde5-6613-4ef8-9812-952d9a6c882a"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:42.912124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-edd23286-a94d-483d-814f-6ec8aa878962 req-7c00824b-4478-4a90-89b5-a0094e103b5b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:42.912721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-edd23286-a94d-483d-814f-6ec8aa878962 req-7c00824b-4478-4a90-89b5-a0094e103b5b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:42.947984 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-edd23286-a94d-483d-814f-6ec8aa878962 req-7c00824b-4478-4a90-89b5-a0094e103b5b service nova] Creating event network-vif-deleted:e9dccde5-6613-4ef8-9812-952d9a6c882a for instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 on nch1-master-1 Mar 26 21:06:42.961811 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-edd23286-a94d-483d-814f-6ec8aa878962 req-7c00824b-4478-4a90-89b5-a0094e103b5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092525 Mar 26 21:06:42.962781 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2273/4292] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:43.090314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:43.099169 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61d37b9a-6be6-4b52-8ee3-1a3a377404d4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 1.081278 Mar 26 21:06:43.104236 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2020/4293] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:42 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:43.656110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:43.656818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:43.668120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:43.670564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:43.671632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:43.672358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:43.882584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:43.883640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:43.893148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:43.895062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:43.896571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:43.897236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:43.920921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. Mar 26 21:06:43.925038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:06:43.926126 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7eb64220-2849-4e51-a528-ec28bb92383c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 404 len: 111 microversion: 2.1 time: 0.047657 Mar 26 21:06:43.927076 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2021/4294] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:43 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:06:43.939316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0ec6412-7c15-4e8d-8419-a5dd3d1c9aff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '.version_select at 0x7f6e586a43a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:43.984687 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0ec6412-7c15-4e8d-8419-a5dd3d1c9aff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680823649" status: 202 len: 0 microversion: 2.1 time: 0.049333 Mar 26 21:06:43.987559 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2022/4295] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:06:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680823649 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:06:44.119680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:44.121771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:44.142710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:44.143230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:44.145292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:44.148046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:44.682196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:44.694672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:44.696836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:44.698385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d900fa2d-65ed-4e31-9880-461fbdabe008 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 1.051439 Mar 26 21:06:44.699213 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2274/4296] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:43 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:45.261139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:45.273557 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c9729f0-628a-40c8-b921-149db4c05081 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 1.157465 Mar 26 21:06:45.277012 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2023/4297] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:44 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:45.716693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:45.717289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:45.726108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:45.726577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:45.727383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:45.727828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:46.293961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:46.294829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:46.304953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:46.305409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:46.309297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:46.309788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:46.938658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:46.972533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:46.981356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:46.986634 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b37cc05-f180-491b-9ea1-ced53a143fc0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 1.273865 Mar 26 21:06:46.988916 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2275/4298] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:45 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:47.035213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:47.049038 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-caef2d27-6456-4546-a0b9-bab27c77995a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.759044 Mar 26 21:06:47.053254 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2024/4299] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:46 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:47.438658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: .version_select at 0x7f6e5819bdc0>, body: {"keypair": {"name": "tempest-keypair-2022620646"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:47.473318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:47.485981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:47.635444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b3739f5d-b515-40d1-9b2e-90efeedebc49 req-8635e9b4-b73a-4f60-8852-3c30409f7da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:47.666637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b3739f5d-b515-40d1-9b2e-90efeedebc49 req-8635e9b4-b73a-4f60-8852-3c30409f7da8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:47.667094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b3739f5d-b515-40d1-9b2e-90efeedebc49 req-8635e9b4-b73a-4f60-8852-3c30409f7da8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:47.709648 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b3739f5d-b515-40d1-9b2e-90efeedebc49 req-8635e9b4-b73a-4f60-8852-3c30409f7da8 service nova] Creating event network-changed:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:06:47.732995 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b3739f5d-b515-40d1-9b2e-90efeedebc49 req-8635e9b4-b73a-4f60-8852-3c30409f7da8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116849 Mar 26 21:06:47.735962 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2025/4300] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:48.026060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:48.027058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:48.037776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:48.041651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:48.042754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:48.044212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:48.110012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:48.117671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:48.138046 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84353047-8651-4740-88ac-d55467060a1c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.703333 Mar 26 21:06:48.139392 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2276/4301] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:06:47 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:48.164124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:48.169390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:48.185860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:48.186473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:48.187488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:48.188071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:48.601217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:48.611209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:48.620711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:48.625475 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-390bd77a-8254-44cd-8d31-6d2fa2df1547 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.610790 Mar 26 21:06:48.626426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2026/4302] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:48 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:49.167565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:49.187410 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-30c94734-6a7c-4d2a-af65-4b0c05efe95d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 1.044961 Mar 26 21:06:49.202625 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2277/4303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:48 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:49.650837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:49.651705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:49.672542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:49.673510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:49.674654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:49.676252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:50.120967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:50.136144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:50.138000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:50.139148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0b56af1-d4c7-4468-b1a3-722c765d3d38 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.494942 Mar 26 21:06:50.140697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2027/4304] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:49 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:50.211452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:50.213810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:50.226957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:50.227416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:50.232987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:50.233446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:50.928200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:50.945538 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af8ff81f-3865-4a04-a5a6-20f363934f59 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.738762 Mar 26 21:06:50.948644 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2278/4305] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:50 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:51.158396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:51.159022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:51.172115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:51.172590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:51.173393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:51.173947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:51.474698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:51.505526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:51.507238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:51.509053 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77369b40-4a15-41a4-8f61-74e8a7a0c301 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.353975 Mar 26 21:06:51.509053 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2028/4306] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:51 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:51.561673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-515289187", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1bac26e-253d-45b2-a5d6-7223981a082f"}], "security_groups": [{"name": "tempest-securitygroup--1030987327"}], "key_name": "tempest-keypair-2022620646", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:51.890260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] validate_networks() for [('d1bac26e-253d-45b2-a5d6-7223981a082f', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:06:51.966561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:51.967346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:51.984910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:51.985368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:51.986393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:51.987266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:52.213577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:52.225783 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c733c630-a7ae-49c5-8007-47e4fb4cdeda tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.264286 Mar 26 21:06:52.227720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2029/4307] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:51 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:52.530972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:52.531871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:52.547833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:52.548537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:52.552971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:52.553747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:53.061011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:53.106075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:53.115240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:53.123300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e9e76747-48b7-4cf0-999f-09fe874b669f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.596384 Mar 26 21:06:53.125817 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2030/4308] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:52 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:06:53.224141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:06:53.225752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:06:53.226926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:06:53.228742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:06:53.229508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:06:53.265779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:53.266936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:53.271097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:53.271643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:53.272986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:53.276148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:53.286266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:53.286916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:53.289067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:53.291087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:53.327962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for project 32df8b04107445c89edb0d809d87d6fc. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:53.342074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Getting quotas for user 8cab4cf432764bb487de9abc0f283898 and project 32df8b04107445c89edb0d809d87d6fc. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:53.365407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:06:53.373502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:06:53.496742 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5505f71e-0a8e-4b8c-8d66-8a5343cf2ce0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.939351 Mar 26 21:06:53.497411 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2279/4309] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:06:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:06:53.509786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da6e3a65-f042-4dff-8db4-c382be4783ff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:53.510402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da6e3a65-f042-4dff-8db4-c382be4783ff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:53.630111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:53.646538 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1ea5292-d8c8-4289-9e93-59155eb587ef tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.388961 Mar 26 21:06:53.649526 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2031/4310] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:53 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:53.704500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da6e3a65-f042-4dff-8db4-c382be4783ff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:53.711642 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da6e3a65-f042-4dff-8db4-c382be4783ff tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1237 microversion: 2.1 time: 0.205754 Mar 26 21:06:53.712266 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2280/4311] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:53 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:54.143250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:54.144513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:54.159317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.159801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:54.160849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.161305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:54.365631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:54.399671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:54.404557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:54.408059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6cfd2cb5-cec1-48b8-94bd-de001da6fc5f tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.268717 Mar 26 21:06:54.410347 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2032/4312] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:54 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:54.666058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:54.666681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:54.681349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.682075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:54.689020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.689730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:54.729345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:54.731311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:54.743472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.744708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:54.745904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:54.746732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:55.345419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:55.354128 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e39a3c33-0b40-4ca7-a190-8f667ea5509d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.692440 Mar 26 21:06:55.363480 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2281/4313] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:54 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:55.428213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:55.429081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:55.445621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:55.446398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:55.447783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:55.448604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:55.937661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:55.954829 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa770eed-c41e-4d5e-870b-86d987613b86 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1289 microversion: 2.1 time: 1.228762 Mar 26 21:06:55.956814 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2033/4314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:54 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1289 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:56.086960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:56.106273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:56.114462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:56.127711 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5ac357d2-2500-47b7-95f1-f70a105dd0e8 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.703348 Mar 26 21:06:56.128344 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2282/4315] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:55 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:56.305632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e94e00cf-ff1d-49b4-beed-54b5f5ead780 req-8768f8fa-3a19-4351-9223-258f6b4aecf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-plugged", "status": "completed", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:56.314584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e94e00cf-ff1d-49b4-beed-54b5f5ead780 req-8768f8fa-3a19-4351-9223-258f6b4aecf4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:56.315048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e94e00cf-ff1d-49b4-beed-54b5f5ead780 req-8768f8fa-3a19-4351-9223-258f6b4aecf4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:56.344718 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e94e00cf-ff1d-49b4-beed-54b5f5ead780 req-8768f8fa-3a19-4351-9223-258f6b4aecf4 service nova] Creating event network-vif-plugged:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:06:56.366552 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e94e00cf-ff1d-49b4-beed-54b5f5ead780 req-8768f8fa-3a19-4351-9223-258f6b4aecf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064850 Mar 26 21:06:56.367748 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2283/4316] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:06:56.376102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:56.377270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:56.399890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:56.400574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:56.402846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:56.408671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:56.665092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-546648181", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "7e4f05b9-af7c-4e91-8672-7679cf5975c9"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:06:56.769879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] validate_networks() for [('7e4f05b9-af7c-4e91-8672-7679cf5975c9', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:06:56.919584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:56.932154 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2169892-135e-4375-a4f7-33c4c9ca49a9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.559218 Mar 26 21:06:56.935818 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2284/4317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:56 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:56.975387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:56.976270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:56.985201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:56.987519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:56.990386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:56.991582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:57.167617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:57.178383 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de2fc55f-2fb8-4ac2-b4b8-4c7f1ec1abb1 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1295 microversion: 2.1 time: 0.206286 Mar 26 21:06:57.183742 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2285/4318] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:56 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1295 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:57.192039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:57.192668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:57.223225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:57.223694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:57.224552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:57.225006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:57.838424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:57.857205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:57.865510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:57.867227 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e07430cf-5a12-41fb-947d-3286b4797d3c tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1407 microversion: 2.20 time: 0.682347 Mar 26 21:06:57.871952 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2286/4319] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:57 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:06:57.958299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:57.960259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:57.988530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:57.989719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:57.994229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:57.996132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:58.856293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:58.872862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-607013ac-24cb-4084-8374-72c069d1398b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1506 microversion: 2.1 time: 0.925617 Mar 26 21:06:58.875637 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2287/4320] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:57 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1506 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:06:58.884193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:58.885066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:58.893755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:58.894222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:58.895017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:58.900708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.088467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:06:59.088892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:06:59.090265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:06:59.090691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:06:59.091254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:06:59.113286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.113707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.114719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.115234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.155308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Getting quotas for project ddb5f339350b4d5facba9a6ffd84aa1b. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:06:59.176383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Getting quotas for user 0bfee91285f94b2eba5cd89004babf2e and project ddb5f339350b4d5facba9a6ffd84aa1b. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:06:59.195734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:06:59.198081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:06:59.328848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:59.343785 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fee5c450-6a7a-42af-a8bb-596eac85b9ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 0.466799 Mar 26 21:06:59.346568 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2288/4321] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:58 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:59.383554 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0d233de-46ae-4918-b8d6-9fd7c31b42cb tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.421190 Mar 26 21:06:59.386086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:59.387352 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2034/4322] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:06:59.389302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:59.405225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-52f36e80-0f07-49be-beb8-f8b3ef008b66 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:59.407429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-52f36e80-0f07-49be-beb8-f8b3ef008b66 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:59.417533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.418223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.419201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.419812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.504475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-52f36e80-0f07-49be-beb8-f8b3ef008b66 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:06:59.514801 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-52f36e80-0f07-49be-beb8-f8b3ef008b66 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1214 microversion: 2.1 time: 0.118439 Mar 26 21:06:59.517963 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2035/4323] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:59 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:06:59.894645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:06:59.895282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:06:59.926316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.926797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:06:59.927619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:06:59.928616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:00.644780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:00.662136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:00.667822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:00.672838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5bc57e21-ba59-4c89-8b2c-e2cb482b5ef1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1599 microversion: 2.20 time: 1.323584 Mar 26 21:07:00.676341 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2289/4324] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:06:59 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1599 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:00.685047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-35fd75f4-a955-4d87-b5c5-14645439bb12 req-bb8f3746-62e4-4a33-a863-86b0e6cd6b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d82499-c9cd-481a-bbec-a2822b0786f6", "tag": "3e1be3af-c4f0-434c-aa0e-29156495a7bb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:00.707026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-35fd75f4-a955-4d87-b5c5-14645439bb12 req-bb8f3746-62e4-4a33-a863-86b0e6cd6b56 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:00.707564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-35fd75f4-a955-4d87-b5c5-14645439bb12 req-bb8f3746-62e4-4a33-a863-86b0e6cd6b56 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:00.742319 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-35fd75f4-a955-4d87-b5c5-14645439bb12 req-bb8f3746-62e4-4a33-a863-86b0e6cd6b56 service nova] Creating event network-changed:3e1be3af-c4f0-434c-aa0e-29156495a7bb for instance 71d82499-c9cd-481a-bbec-a2822b0786f6 on nch1-master-1 Mar 26 21:07:00.753356 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-35fd75f4-a955-4d87-b5c5-14645439bb12 req-bb8f3746-62e4-4a33-a863-86b0e6cd6b56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072463 Mar 26 21:07:00.753988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2290/4325] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:00.770180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:00.770906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:00.783410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:00.783874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:00.784810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:00.785291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:00.846447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:00.857856 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a200c2df-f991-4f0a-8a17-21da757ecb76 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1527 microversion: 2.1 time: 0.968514 Mar 26 21:07:00.858490 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2036/4326] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:06:59 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1527 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:00.895362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:00.898044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:00.923048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:00.924872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:00.926183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:00.932003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:01.314206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:01.326424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9c08173-c871-4f83-bfd5-9c7a3cbbdfc2 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1266 microversion: 2.1 time: 0.463228 Mar 26 21:07:01.332506 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2037/4327] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:00 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:01.338102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:01.340218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:01.351525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:01.357977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:01.360295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:01.363482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:01.675311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a747c52b-cd61-40da-8b45-5ac9b0a1a408 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.341543 Mar 26 21:07:01.682720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2038/4328] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:07:01 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:07:01.834824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:01.850812 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a12457d-3a95-4206-bace-ff3000d57a7b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 1.093776 Mar 26 21:07:01.851522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2291/4329] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:00 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:01.877865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:01.879180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:01.888399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:01.889438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:01.890210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:01.890841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:02.353058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:02.353789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:02.363626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:02.366874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:02.368956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:02.371139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:02.516830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:02.527976 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-68079355-42df-402b-a80f-12151fc8637a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1272 microversion: 2.1 time: 0.181243 Mar 26 21:07:02.538040 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2292/4330] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:02 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:02.869760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:02.871106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:02.909471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:02.910518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:02.915788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:02.916392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:03.211625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:03.221098 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-060b6405-e1d9-4f33-839b-7848493a69db tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 1.347324 Mar 26 21:07:03.223946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2039/4331] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:01 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:03.545681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:03.546847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:03.559004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:03.559467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:03.567347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:03.567850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:03.662484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:03.681902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d73f8b00-b378-4864-95a3-34c9a1a25627 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 0.817074 Mar 26 21:07:03.682840 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2293/4332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:02 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:04.244066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:04.246340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:04.259012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:04.259784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:04.260812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:04.262790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:04.758323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:04.774830 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-71877e61-6421-4578-8dda-e40c32894ec9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 1.229817 Mar 26 21:07:04.787422 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2040/4333] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:03 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:04.813730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:04.819198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:04.847601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:04.873043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:04.874686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:04.885509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:04.997378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:05.026495 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e2247d0b-cfbf-492b-84d4-1ea097e2e2be tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.783878 Mar 26 21:07:05.027806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2294/4334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:04 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:05.074685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c4c10dde-f85a-402a-9ec7-83fbee67741a req-cee52748-554f-463e-8c6c-83b097e66025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6", "name": "network-vif-plugged", "status": "completed", "tag": "81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:05.090209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c4c10dde-f85a-402a-9ec7-83fbee67741a req-cee52748-554f-463e-8c6c-83b097e66025 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:05.090825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c4c10dde-f85a-402a-9ec7-83fbee67741a req-cee52748-554f-463e-8c6c-83b097e66025 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:05.122524 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c4c10dde-f85a-402a-9ec7-83fbee67741a req-cee52748-554f-463e-8c6c-83b097e66025 service nova] Creating event network-vif-plugged:81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20 for instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 on nch1-master-1 Mar 26 21:07:05.144155 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c4c10dde-f85a-402a-9ec7-83fbee67741a req-cee52748-554f-463e-8c6c-83b097e66025 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068329 Mar 26 21:07:05.145040 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2295/4335] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:05.704990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:05.713228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dafdc299-dcef-491a-9108-8cb51cde6908 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 0.932946 Mar 26 21:07:05.728568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2041/4336] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:04 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:05.799775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:05.803692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:05.815892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:05.816981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:05.818223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:05.819102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:06.044452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:06.045077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:06.056004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:06.056768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:06.057578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:06.058027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:06.508153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:06.525534 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39239987-31ff-45c1-9ad1-8fa9d1ad240a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.734066 Mar 26 21:07:06.526151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2296/4337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:05 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:06.821834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Action: 'create', calling method: .version_select at 0x7f6e58280550>, body: {"keypair": {"name": "tempest-keypair-588791818"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:06.869647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for project c58247395bea4447bc23f219d3c1cbc0. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:07:06.887874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for user c87af7ce66f048e3942c2846edb30c10 and project c58247395bea4447bc23f219d3c1cbc0. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:07:07.312036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:07.323636 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e910a033-7b05-4361-aba3-fd0fdb21b1ab tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 1.283213 Mar 26 21:07:07.324461 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2042/4338] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:06 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:07.343727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:07.344691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:07.355827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:07.368659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:07.369522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:07.369972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:07.634617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for project c58247395bea4447bc23f219d3c1cbc0. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:07:07.676912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for user c87af7ce66f048e3942c2846edb30c10 and project c58247395bea4447bc23f219d3c1cbc0. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:07:07.747075 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-378718c2-416b-4af7-ade4-c1b7c32b6751 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.210792 Mar 26 21:07:07.748115 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2297/4339] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:07:06 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:07.759504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:07.760181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:07.780388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:07.780856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:07.788270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:07.792054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:08.486759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:08.496549 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48c22f44-881e-4fff-8ffa-2c6133b0c1f1 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.746556 Mar 26 21:07:08.497239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2298/4340] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:07 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:08.511496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:08.514599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:08.535734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:08.536284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:08.545636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:08.546916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:09.266995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:09.298747 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e253a07c-e8c7-435c-9e8d-4c8e52bf1c45 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.795254 Mar 26 21:07:09.308264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2299/4341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:08 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:09.335987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-aea3e58d-cc9d-4e49-950e-f329f23f4612 req-c47b7779-d2ca-40c4-8c23-1aadbf086f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b8a479-6555-46fa-ab78-583e753a2e59", "tag": "7b0e0d6e-5f8a-42bc-be87-013dd0823c50"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:09.379487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aea3e58d-cc9d-4e49-950e-f329f23f4612 req-c47b7779-d2ca-40c4-8c23-1aadbf086f5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:09.382877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aea3e58d-cc9d-4e49-950e-f329f23f4612 req-c47b7779-d2ca-40c4-8c23-1aadbf086f5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:09.461424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-aea3e58d-cc9d-4e49-950e-f329f23f4612 req-c47b7779-d2ca-40c4-8c23-1aadbf086f5f service nova] Creating event network-changed:7b0e0d6e-5f8a-42bc-be87-013dd0823c50 for instance 20b8a479-6555-46fa-ab78-583e753a2e59 on nch2-master-1 Mar 26 21:07:09.474023 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-aea3e58d-cc9d-4e49-950e-f329f23f4612 req-c47b7779-d2ca-40c4-8c23-1aadbf086f5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163780 Mar 26 21:07:09.477405 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2300/4342] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:09.494461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-422ffc98-06ed-4ada-a2f4-5097c00dc4c9 req-8c978953-d440-4c5a-bfd5-c76f48221e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d82499-c9cd-481a-bbec-a2822b0786f6", "name": "network-vif-plugged", "status": "completed", "tag": "3e1be3af-c4f0-434c-aa0e-29156495a7bb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:09.533410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-422ffc98-06ed-4ada-a2f4-5097c00dc4c9 req-8c978953-d440-4c5a-bfd5-c76f48221e0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:09.536154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-422ffc98-06ed-4ada-a2f4-5097c00dc4c9 req-8c978953-d440-4c5a-bfd5-c76f48221e0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:09.559829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:09.567629 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-422ffc98-06ed-4ada-a2f4-5097c00dc4c9 req-8c978953-d440-4c5a-bfd5-c76f48221e0c service nova] Creating event network-vif-plugged:3e1be3af-c4f0-434c-aa0e-29156495a7bb for instance 71d82499-c9cd-481a-bbec-a2822b0786f6 on nch1-master-1 Mar 26 21:07:09.571188 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1a0e448-b6c1-4479-ab8b-912e8755b284 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 2.238123 Mar 26 21:07:09.572120 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2043/4343] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:07 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:09.578400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:09.582049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:09.594552 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-422ffc98-06ed-4ada-a2f4-5097c00dc4c9 req-8c978953-d440-4c5a-bfd5-c76f48221e0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115419 Mar 26 21:07:09.598601 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2301/4344] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:09.603887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:09.604554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:09.605466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:09.605979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:10.323091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:10.324330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:10.343288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:10.344154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:10.345427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:10.348569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:10.760664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:10.789225 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5e2c80a0-89e3-41c6-aee3-0d0843d08382 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.471921 Mar 26 21:07:10.791736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2302/4345] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:10 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:10.797282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:10.798128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:10.805414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:10.806170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:10.807281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:10.821678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:11.062722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:11.083335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a09b1e99-1c63-415b-b790-c97cc202e91b tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 1.509431 Mar 26 21:07:11.088289 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2044/4346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:09 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:11.543334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2ecc4c65-492a-49a9-87af-7dec12768650 req-9c0bbf76-f95b-45e0-878c-c8acca276c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:11.561341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ecc4c65-492a-49a9-87af-7dec12768650 req-9c0bbf76-f95b-45e0-878c-c8acca276c48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:11.561796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2ecc4c65-492a-49a9-87af-7dec12768650 req-9c0bbf76-f95b-45e0-878c-c8acca276c48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:11.622908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2ecc4c65-492a-49a9-87af-7dec12768650 req-9c0bbf76-f95b-45e0-878c-c8acca276c48 service nova] Creating event network-changed:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:07:11.633915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:11.649145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11a3d619-e5ec-4e52-9aab-f874ca96659c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1363 microversion: 2.1 time: 0.849236 Mar 26 21:07:11.649516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2ecc4c65-492a-49a9-87af-7dec12768650 req-9c0bbf76-f95b-45e0-878c-c8acca276c48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109693 Mar 26 21:07:11.650133 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2045/4347] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:11.655497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2303/4348] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:10 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1363 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:11.807532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:11.808280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:11.816978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:11.820216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:11.821955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:11.823649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:12.105213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:12.106701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:12.126710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:12.127690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:12.128613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:12.129225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:12.646185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:12.673428 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6cbad25d-d62b-40b0-8f75-31934a3566cd tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.571939 Mar 26 21:07:12.675638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2304/4349] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:12 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:12.688753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:12.697548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:12.718141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:12.720714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:12.722911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:12.732852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:13.341540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:13.353304 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14306820-c671-448a-85ec-4175f97a787f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1550 microversion: 2.1 time: 0.676096 Mar 26 21:07:13.368149 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2305/4350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:12 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1550 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:13.374536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:13.378258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:13.393439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:13.394040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:13.395639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:13.396878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:13.616411 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bd8c578-7f7b-46da-9896-2d0065f5b09d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.245811 Mar 26 21:07:13.617030 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2306/4351] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:07:13 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:13.692853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:13.694219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:13.710346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:13.711087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:13.712100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:13.716411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:13.993693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:14.002946 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2b4430b8-331e-49f8-af56-aea8c0649a9d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 2.199784 Mar 26 21:07:14.004035 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2046/4352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:11 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:14.065894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1951014513", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c67a0f98-3538-4aa5-858c-6d0bdcc0a7a8"}], "security_groups": [{"name": "tempest-securitygroup--1214693958"}], "key_name": "tempest-keypair-588791818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:14.160470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:14.168807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10cfd7ce-2fe3-455f-930e-5623d972e30d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.480642 Mar 26 21:07:14.179182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2307/4353] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:13 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:14.388761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] validate_networks() for [('c67a0f98-3538-4aa5-858c-6d0bdcc0a7a8', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:07:15.021060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:15.022854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:15.040069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:15.040813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:15.044417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:15.045269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:15.376014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:15.398088 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b8c6adf-b6f5-435a-a714-f093e046c78d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.381064 Mar 26 21:07:15.435051 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2308/4354] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:15 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:15.442997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:15.454826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:15.471168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:15.472468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:15.480300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:15.481078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:15.844910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:15.859985 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8025eed0-00c1-439a-a965-f6322b64f975 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.421762 Mar 26 21:07:15.862090 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2309/4355] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:15 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:16.005072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for project c58247395bea4447bc23f219d3c1cbc0. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:07:16.025966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for user c87af7ce66f048e3942c2846edb30c10 and project c58247395bea4447bc23f219d3c1cbc0. Resources: dict_keys(['metadata_items']) {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:07:16.088512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:07:16.089327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:07:16.091237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:07:16.092302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:07:16.092878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:07:16.132962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.137481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.138613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.139089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.148125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-44ec470f-4a14-4434-8bf5-a8a4b08414b4 req-69be43b4-e17f-401f-ad48-ebd230f43137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d82499-c9cd-481a-bbec-a2822b0786f6", "tag": "3e1be3af-c4f0-434c-aa0e-29156495a7bb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:16.174346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for project c58247395bea4447bc23f219d3c1cbc0. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:07:16.175099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-44ec470f-4a14-4434-8bf5-a8a4b08414b4 req-69be43b4-e17f-401f-ad48-ebd230f43137 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.175660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-44ec470f-4a14-4434-8bf5-a8a4b08414b4 req-69be43b4-e17f-401f-ad48-ebd230f43137 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.184832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Getting quotas for user c87af7ce66f048e3942c2846edb30c10 and project c58247395bea4447bc23f219d3c1cbc0. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:07:16.199083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-44ec470f-4a14-4434-8bf5-a8a4b08414b4 req-69be43b4-e17f-401f-ad48-ebd230f43137 service nova] Creating event network-changed:3e1be3af-c4f0-434c-aa0e-29156495a7bb for instance 71d82499-c9cd-481a-bbec-a2822b0786f6 on nch1-master-1 Mar 26 21:07:16.204063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:07:16.210673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:07:16.213005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-44ec470f-4a14-4434-8bf5-a8a4b08414b4 req-69be43b4-e17f-401f-ad48-ebd230f43137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081805 Mar 26 21:07:16.220911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2310/4356] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:16.294329 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c932193-e20c-4a4c-aa96-ae31e32480a8 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.270807 Mar 26 21:07:16.296888 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2047/4357] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:07:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:07:16.308689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa94f0b1-9b2d-4457-8634-34bd40168c58 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:16.309548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa94f0b1-9b2d-4457-8634-34bd40168c58 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:16.416564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:16.417312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:16.430703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.432768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.435258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.445034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.464182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa94f0b1-9b2d-4457-8634-34bd40168c58 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:16.474051 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa94f0b1-9b2d-4457-8634-34bd40168c58 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1277 microversion: 2.1 time: 0.168671 Mar 26 21:07:16.484079 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2311/4358] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:16 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:16.868184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:16.884604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c66c4a88-2698-4aa9-b735-f33727f3f98b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.473070 Mar 26 21:07:16.890044 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2048/4359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:16 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:16.895291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:16.896065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:16.914096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.919051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:16.922191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:16.924788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:17.302091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:17.312646 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27cc050b-cc87-4f10-9024-af5676aaf1bf tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.421302 Mar 26 21:07:17.324055 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2312/4360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:16 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:17.499079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:17.499747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:17.511702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:17.516400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:17.517931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:17.519100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:17.742037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:17.751195 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03ba584c-e2e1-47dd-a2dd-e322f55dbd30 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1273 microversion: 2.1 time: 0.256446 Mar 26 21:07:17.753015 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2049/4361] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:17 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:17.907443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:17.908472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:17.915704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:17.916194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:17.917145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:17.917758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:18.330924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:18.332212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:18.339224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:18.339652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:18.347471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:18.348166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:18.498107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:18.510449 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f68dbbaa-a9c8-4f1b-9d40-4e85a4b5fc22 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.607239 Mar 26 21:07:18.513170 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2313/4362] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:17 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:18.780336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:18.780978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:18.808037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:18.808527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:18.809404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:18.809783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:18.949126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:18.962259 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2dd22cc2-28b5-485d-ac31-3d26a9bef5ad tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1335 microversion: 2.1 time: 0.195403 Mar 26 21:07:18.966297 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2314/4363] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:18 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1335 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:19.061429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:19.070691 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b19a5f08-715e-462c-89ce-cb2fba34c262 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.743852 Mar 26 21:07:19.071751 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2050/4364] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:18 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:19.529332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:19.530007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:19.551623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:19.552126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:19.555728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:19.557470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:19.734683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-62929420-bcdf-4b41-8808-c5856ba8abb2 req-c230270b-4b44-4f6f-910d-0fe2244be64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b8a479-6555-46fa-ab78-583e753a2e59", "name": "network-vif-plugged", "status": "completed", "tag": "7b0e0d6e-5f8a-42bc-be87-013dd0823c50"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:19.756896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-62929420-bcdf-4b41-8808-c5856ba8abb2 req-c230270b-4b44-4f6f-910d-0fe2244be64b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:19.757352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-62929420-bcdf-4b41-8808-c5856ba8abb2 req-c230270b-4b44-4f6f-910d-0fe2244be64b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:19.786805 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-62929420-bcdf-4b41-8808-c5856ba8abb2 req-c230270b-4b44-4f6f-910d-0fe2244be64b service nova] Creating event network-vif-plugged:7b0e0d6e-5f8a-42bc-be87-013dd0823c50 for instance 20b8a479-6555-46fa-ab78-583e753a2e59 on nch2-master-1 Mar 26 21:07:19.811760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-62929420-bcdf-4b41-8808-c5856ba8abb2 req-c230270b-4b44-4f6f-910d-0fe2244be64b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080669 Mar 26 21:07:19.812414 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2051/4365] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:19.983141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:19.983847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:19.994000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:19.994454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:19.995233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:19.995672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:20.366423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:20.376295 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b5ddec33-2395-499b-9107-119368b7b9fe tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.852123 Mar 26 21:07:20.379218 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2315/4366] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:19 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:20.392984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:20.398730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:20.414597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:20.416596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:20.417619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:20.420548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:20.745274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:20.756314 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-846dd73e-a9d8-469e-8657-1496fcad5bda tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.777255 Mar 26 21:07:20.757590 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2052/4367] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:19 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:21.043452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:21.063693 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2f0aaf0-2222-4be3-b2a4-2241f20128e8 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1314 microversion: 2.1 time: 0.681768 Mar 26 21:07:21.066377 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2316/4368] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:20 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:21.398646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:21.399289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:21.412271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:21.413205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:21.417019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:21.417493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:21.447901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:21.448467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:21.468492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:21.469028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:21.469856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:21.486990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:21.585803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:07:21.898981 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-712568e9-5fe0-4310-802c-3ee1e3d5aacc tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 204 len: 0 microversion: 2.32 time: 1.139680 Mar 26 21:07:21.899867 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2053/4369] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:07:20 2022] DELETE /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:07:21.908990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-03047f13-3802-407c-864f-3bec6733b68f req-6d6298b6-3fc8-49db-bb3a-baeac3209680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331ad8cf-be35-4131-b01e-789202973f64", "tag": "4f2b792e-b9a0-468f-817b-6cfaf02808f7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:21.965962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-03047f13-3802-407c-864f-3bec6733b68f req-6d6298b6-3fc8-49db-bb3a-baeac3209680 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:21.980105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-03047f13-3802-407c-864f-3bec6733b68f req-6d6298b6-3fc8-49db-bb3a-baeac3209680 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.012231 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-03047f13-3802-407c-864f-3bec6733b68f req-6d6298b6-3fc8-49db-bb3a-baeac3209680 service nova] Creating event network-changed:4f2b792e-b9a0-468f-817b-6cfaf02808f7 for instance 331ad8cf-be35-4131-b01e-789202973f64 on nch1-master-1 Mar 26 21:07:22.019720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-03047f13-3802-407c-864f-3bec6733b68f req-6d6298b6-3fc8-49db-bb3a-baeac3209680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117480 Mar 26 21:07:22.021119 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2054/4370] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:22.027834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:22.028973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:22.039197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.040418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.042235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.043226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.056065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.071774 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d62df138-745d-40f5-86c2-1df11f28f24c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.679372 Mar 26 21:07:22.088408 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2317/4371] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:21 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:22.094016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:22.094870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:22.114068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.114990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.116048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.116673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.410784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.421490 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c37bee1-903b-4a9c-b984-d3bfb00e3263 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.398808 Mar 26 21:07:22.422634 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2055/4372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:22 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:22.433641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:22.434583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:22.447291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.448038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.449010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.449622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.550750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.566910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.568521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.572024 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b5e9e8f7-7429-438b-ab95-53e7ec242c3a tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2948 microversion: 2.32 time: 0.482184 Mar 26 21:07:22.572913 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2318/4373] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:22 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2948 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:22.726489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:22.735205 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca0e9583-543d-4b07-9c62-116c076c8a6e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1500 microversion: 2.1 time: 0.311357 Mar 26 21:07:22.736570 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2056/4374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:22 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1500 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:22.755874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:22.756900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:22.769304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.770167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:22.771893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:22.773154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.115654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:23.116296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:23.139785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.148315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.149744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.150412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.305262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:23.323594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2c33f0d8-4fbd-4afc-afa0-b99114628b50 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1500 microversion: 2.1 time: 0.572469 Mar 26 21:07:23.332471 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2319/4375] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:22 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1500 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:23.351634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:23.360769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:23.374824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.376452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.377875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.378624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.465533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lazy-loading 'flavor' on Instance uuid 20b8a479-6555-46fa-ab78-583e753a2e59 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:07:23.545849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:23.559201 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ed93a29-4f0c-4139-9c8b-6d4584839ee2 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.469712 Mar 26 21:07:23.559806 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2057/4376] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:23 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:23.586514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:23.586708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:23.612959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.615401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.616743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.620601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.630013 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa34ace4-255f-44f2-b7f7-fbd5f2e5be5a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action" status: 202 len: 0 microversion: 2.1 time: 0.280158 Mar 26 21:07:23.631009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2320/4377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:07:23 2022] POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:07:23.647433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:23.648501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:23.656718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.658125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.659170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:23.660363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:23.990862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.012964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.015629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.018135 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af08b3b4-8162-4c86-80a7-243ca9500377 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2948 microversion: 2.32 time: 0.382506 Mar 26 21:07:24.019237 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2321/4378] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:23 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2948 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:24.028511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:24.029988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:24.040576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:24.041659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:24.043274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:24.044455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:24.312953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.323869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1eb8eb01-d223-457e-bc25-14a8ceb864c5 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1508 microversion: 2.1 time: 0.302876 Mar 26 21:07:24.324715 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2322/4379] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:24 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:24.356073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.366469 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-780116d8-6875-427f-aecc-78a9e311d048 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.791067 Mar 26 21:07:24.367339 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2058/4380] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:23 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:24.576844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:24.577475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:24.584402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:24.584873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:24.585678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:24.586131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:24.726378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:24.736884 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0343cab7-5f52-4e8e-b7a6-decac16b9abf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1522 microversion: 2.1 time: 0.163850 Mar 26 21:07:24.737898 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2323/4381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:24 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:25.059750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:25.060400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:25.068690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.069300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:25.070212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.070771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:25.349677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:25.350348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:25.362985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.363453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:25.366801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.367274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:25.779797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:25.793048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:25.799832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:25.805003 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-482ad32f-b3ef-46f4-9b32-683a10b12b0e tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2948 microversion: 2.32 time: 0.749492 Mar 26 21:07:25.812350 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2059/4382] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:25 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2948 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:25.819377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:25.822172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:25.836930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.837745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:25.838740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:25.839283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.059540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:26.082671 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd6cbf8f-f3cc-49ba-a735-6d3f5dbd9246 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1491 microversion: 2.1 time: 0.737331 Mar 26 21:07:26.084151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2324/4383] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:25 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1491 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:26.089622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:26.090548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:26.100366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.100918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.102406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.102936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.249121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:26.268170 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1f9900b-b6d2-4e06-a4b9-a20808df9593 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.453758 Mar 26 21:07:26.269710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2060/4384] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:25 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:26.276680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:26.277564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:26.287726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.289155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.290731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.291463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.444921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-083422a2-8978-4865-be89-f0a8d6da2a5e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action" status: 202 len: 0 microversion: 2.1 time: 0.173541 Mar 26 21:07:26.447685 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2061/4385] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:07:26 2022] POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:07:26.477572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:26.479017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:26.486017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.486754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.487812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.488449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.568765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:26.585724 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0016fc62-cbbf-496a-82ee-bd0e7a261c71 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1504 microversion: 2.1 time: 0.492820 Mar 26 21:07:26.586796 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2325/4386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:26 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:26.839690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:26.840588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:26.859635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.860136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:26.860930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:26.861590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:27.057697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:27.068721 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9428542-31f0-4c45-b00a-7576a2e1c359 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1497 microversion: 2.1 time: 0.605074 Mar 26 21:07:27.072074 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2062/4387] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:26 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1497 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:27.287539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:27.289044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:27.313646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:27.314987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:27.318383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:27.319029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:27.325560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:27.343289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:27.345270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:27.348761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9d497fb-9a76-458f-8a05-e95c9a51f7e1 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2927 microversion: 2.32 time: 0.513309 Mar 26 21:07:27.365755 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2326/4388] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:26 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2927 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:27.611498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:27.614226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:27.626123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:27.638045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:27.639418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:27.640159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.049556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.067582 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-814ea85c-5f92-46e3-96a3-af49fa42eaf5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.784267 Mar 26 21:07:28.071541 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2063/4389] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:27 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:28.078750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b285fb5c-c43e-40c2-9319-120097e23335 req-53f3e436-a70f-4f64-8375-d7eca9943ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-unplugged", "status": "completed", "tag": "52c8eed7-3c91-43b3-9001-30b914ea4cd7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:28.097204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b285fb5c-c43e-40c2-9319-120097e23335 req-53f3e436-a70f-4f64-8375-d7eca9943ed1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.098604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b285fb5c-c43e-40c2-9319-120097e23335 req-53f3e436-a70f-4f64-8375-d7eca9943ed1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.121692 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b285fb5c-c43e-40c2-9319-120097e23335 req-53f3e436-a70f-4f64-8375-d7eca9943ed1 service nova] Creating event network-vif-unplugged:52c8eed7-3c91-43b3-9001-30b914ea4cd7 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:28.152771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b285fb5c-c43e-40c2-9319-120097e23335 req-53f3e436-a70f-4f64-8375-d7eca9943ed1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078587 Mar 26 21:07:28.164381 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2064/4390] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:28.171001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.175566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:28.176848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:28.180264 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-34ce279a-eec8-44d0-a65b-1895c8b0ba00 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1504 microversion: 2.1 time: 0.578897 Mar 26 21:07:28.180851 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2327/4391] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:27 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:28.187778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.188592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.189802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.191034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.370355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:28.371024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:28.378635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.379089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.379870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.380371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.489059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.501604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-578e7cda-e24b-4155-b31b-a6934782c89a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1497 microversion: 2.1 time: 0.335611 Mar 26 21:07:28.502929 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2065/4392] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:28 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:28.743535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bb4c0265-540e-4853-af8f-c313f7c1484b req-3cbb6644-35cd-474f-9067-a938dcab8539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-deleted", "tag": "5a5ac11b-6501-4f2a-b826-a2beff85eb24"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:28.761106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bb4c0265-540e-4853-af8f-c313f7c1484b req-3cbb6644-35cd-474f-9067-a938dcab8539 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:28.761870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bb4c0265-540e-4853-af8f-c313f7c1484b req-3cbb6644-35cd-474f-9067-a938dcab8539 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:28.799575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.843491 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bb4c0265-540e-4853-af8f-c313f7c1484b req-3cbb6644-35cd-474f-9067-a938dcab8539 service nova] Creating event network-vif-deleted:5a5ac11b-6501-4f2a-b826-a2beff85eb24 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:28.861833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.865404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bb4c0265-540e-4853-af8f-c313f7c1484b req-3cbb6644-35cd-474f-9067-a938dcab8539 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120420 Mar 26 21:07:28.870494 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2066/4393] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:28.873864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:28.881578 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57127456-5de4-44a2-9bc0-8379bca6afb7 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2906 microversion: 2.32 time: 0.511240 Mar 26 21:07:28.884028 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2328/4394] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:28 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2906 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:29.087661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:29.088619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:29.097835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.101104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.101970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.102427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.198367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:29.199001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:29.212109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.212582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.213400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.213858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.382372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:29.390985 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e289e13c-4df5-4250-9447-5264f0c31e6d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.307805 Mar 26 21:07:29.392426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2067/4395] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:29 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:29.526688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:29.528557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:29.539591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.541690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.544917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.546098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.587170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:29.595096 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-641ef95e-760b-4c81-9a8e-cead9245097b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 200 len: 1447 microversion: 2.1 time: 0.401155 Mar 26 21:07:29.595693 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2329/4396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:29 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 1447 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:29.612399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:29.612910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:29.632237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.632696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.633728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.634173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.660470 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:07:29.667752 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Working on deleting snapshot 7761abd2-cada-4f04-a07d-a09ad122d0ae from shelved instance... Mar 26 21:07:29.947033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:29.955890 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4870df4-d22b-4fb9-8b54-c3d844f8d339 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1500 microversion: 2.1 time: 0.441065 Mar 26 21:07:29.969151 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2068/4397] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:29 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1500 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:29.977516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:29.978145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:29.986087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.986897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:29.987707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:29.988186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:30.657836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Doing local delete in cell 7ca092f8-977d-411e-a825-e2f3eb9c4cf0(cell1) {{(pid=141581) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 26 21:07:30.659339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:30.660021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:30.660626 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 26 21:07:30.665186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] deallocate_for_instance() {{(pid=141581) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 26 21:07:30.962243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:30.972986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:30.975824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:30.977579 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e883159-3cff-49a0-b7ae-952cf68c9f7c tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2700 microversion: 2.32 time: 1.007305 Mar 26 21:07:30.978155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2069/4398] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:29 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2700 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:30.983180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:30.984478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:31.001591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.002089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.002894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.003349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.031696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lazy-loading 'flavor' on Instance uuid 20b8a479-6555-46fa-ab78-583e753a2e59 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:07:31.137760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c114fa4-636d-4a53-b47c-3c8cd6ca777c tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action" status: 202 len: 0 microversion: 2.1 time: 0.158082 Mar 26 21:07:31.141672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2070/4399] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:07:30 2022] POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:07:31.151592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-unplugged", "status": "completed", "tag": "df90cff0-cb5b-4aad-bb76-1204dc22e346"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-unplugged", "status": "completed", "tag": "27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75"}, {"server_uuid": "331ad8cf-be35-4131-b01e-789202973f64", "name": "network-vif-plugged", "status": "completed", "tag": "4f2b792e-b9a0-468f-817b-6cfaf02808f7"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-unplugged", "status": "completed", "tag": "6ce9015d-d518-4977-9578-35a0aacefd54"}, {"server_uuid": "ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6", "name": "network-vif-unplugged", "status": "completed", "tag": "81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:31.169064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.169974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.192032 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Creating event network-vif-unplugged:df90cff0-cb5b-4aad-bb76-1204dc22e346 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:31.193313 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Creating event network-vif-unplugged:27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:31.206405 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Creating event network-vif-plugged:4f2b792e-b9a0-468f-817b-6cfaf02808f7 for instance 331ad8cf-be35-4131-b01e-789202973f64 on nch1-master-1 Mar 26 21:07:31.207580 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Creating event network-vif-unplugged:6ce9015d-d518-4977-9578-35a0aacefd54 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:31.208930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.compute.server_external_events [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] Unable to find a host for instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6. Dropping event network-vif-unplugged {{(pid=141580) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 26 21:07:31.223005 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ef18f0b8-60a0-4334-bf1f-9593e4cf465f req-1e3aabf1-bf40-4243-b27c-e8a22bfd8527 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 872 microversion: 2.1 time: 0.077555 Mar 26 21:07:31.246533 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2071/4400] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 872 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 26 21:07:31.255577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:31.258198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:31.268302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.281583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.285707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.286221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.863551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:31.876928 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4eae2350-3bb7-4e04-ba2d-4c97c1806ae0 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.627261 Mar 26 21:07:31.879535 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2072/4401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:31 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:31.891112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-20b2c110-63ff-4d0c-888b-08e3de5508eb req-a2f3775c-aad7-428d-95ce-7d57935eb9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-deleted", "tag": "6ce9015d-d518-4977-9578-35a0aacefd54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:31.901810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-20b2c110-63ff-4d0c-888b-08e3de5508eb req-a2f3775c-aad7-428d-95ce-7d57935eb9ac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.903310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-20b2c110-63ff-4d0c-888b-08e3de5508eb req-a2f3775c-aad7-428d-95ce-7d57935eb9ac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.918227 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-20b2c110-63ff-4d0c-888b-08e3de5508eb req-a2f3775c-aad7-428d-95ce-7d57935eb9ac service nova] Creating event network-vif-deleted:6ce9015d-d518-4977-9578-35a0aacefd54 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:31.925908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-20b2c110-63ff-4d0c-888b-08e3de5508eb req-a2f3775c-aad7-428d-95ce-7d57935eb9ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040905 Mar 26 21:07:31.927582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2073/4402] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:31.934488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:31.935695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:31.943536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.944470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:31.946587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:31.947244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:32.229304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:32.241662 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99505de1-4dcd-49c7-bafe-5a572ceb7762 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1491 microversion: 2.1 time: 0.312423 Mar 26 21:07:32.280340 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2074/4403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:31 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1491 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:32.291997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:32.296291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:32.310489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:32.314188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:32.318428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:32.319573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:32.541738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Updating instance_info_cache with network_info: [] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 21:07:32.996238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:33.006025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:33.013753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:33.016395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27ea5faa-4e95-442d-a163-c57e312a2941 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2541 microversion: 2.32 time: 0.734173 Mar 26 21:07:33.018523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2075/4404] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:32 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2541 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:33.033924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:33.035946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:33.056751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.057211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.068756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.069563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.135345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c56985e8-228a-407c-afd6-1573c1fef688 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 204 len: 0 microversion: 2.1 time: 3.526550 Mar 26 21:07:33.139353 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2330/4405] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:07:29 2022] DELETE /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 0 bytes in 3531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:07:33.156011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-30fb0712-e38e-409d-8f52-e68316844e35 req-9b4f30e4-989d-47e2-8dbb-496db55c197a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6", "name": "network-vif-deleted", "tag": "81f7ffd5-4a7a-4fb2-b8a1-ffa08e126b20"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:33.172371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-30fb0712-e38e-409d-8f52-e68316844e35 req-9b4f30e4-989d-47e2-8dbb-496db55c197a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.173237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-30fb0712-e38e-409d-8f52-e68316844e35 req-9b4f30e4-989d-47e2-8dbb-496db55c197a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.201223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_external_events [req-30fb0712-e38e-409d-8f52-e68316844e35 req-9b4f30e4-989d-47e2-8dbb-496db55c197a service nova] Unable to find a host for instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6. Dropping event network-vif-deleted {{(pid=141581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 26 21:07:33.202608 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-30fb0712-e38e-409d-8f52-e68316844e35 req-9b4f30e4-989d-47e2-8dbb-496db55c197a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061479 Mar 26 21:07:33.203402 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2331/4406] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 26 21:07:33.210772 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-448553f8-1537-4048-8dd5-a0b462db9e3e tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action" status: 202 len: 0 microversion: 2.1 time: 0.187071 Mar 26 21:07:33.212538 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2076/4407] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:07:33 2022] POST /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:07:33.226228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:33.228671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:33.231046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:33.232135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:33.247099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.248570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.249148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.249433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.250361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.250750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.251373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.254177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.289277 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. Mar 26 21:07:33.290021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:07:33.293249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96d3e0ad-d45a-4681-88a0-ec0abc5d02ea tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 404 len: 111 microversion: 2.1 time: 0.076490 Mar 26 21:07:33.296332 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2077/4408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:33 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:07:33.309571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:33.310582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:33.325197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.328221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.329197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.331805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.860965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:33.871150 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82727651-dfad-494e-9d61-ae3c53aa6e0a tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1497 microversion: 2.1 time: 0.572791 Mar 26 21:07:33.881801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:33.881801 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-653ca1e3-feb4-48de-8bb9-2ab95030348f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1403 microversion: 2.1 time: 0.676173 Mar 26 21:07:33.883623 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2078/4409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:33 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1497 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:33.883988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2332/4410] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:33 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1403 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:33.889754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-667278189", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:33.898944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:33.910230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:33.937073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.937827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.938804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.940137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:33.956426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:07:33.967358 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-798074a0-0ecf-4268-a61c-1dd9d23ca1b0 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/ips" status: 200 len: 152 microversion: 2.20 time: 0.082289 Mar 26 21:07:33.968643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2333/4411] 10.222.0.16 () {60 vars in 1288 bytes} [Sat Mar 26 21:07:33 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/ips => generated 152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:07:33.973634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-deleted", "tag": "52c8eed7-3c91-43b3-9001-30b914ea4cd7"}, {"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-deleted", "tag": "27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:33.984241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:33.984948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:34.000384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] Creating event network-vif-deleted:52c8eed7-3c91-43b3-9001-30b914ea4cd7 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:34.001823 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] Creating event network-vif-deleted:27ed7b48-4d3a-4fb2-ab1d-67bcc10c2c75 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:34.007892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ab456489-7346-4634-9ebb-6f5dddba6681 req-0c77cdf1-e3da-4420-8715-8a1753091611 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037769 Mar 26 21:07:34.009226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2334/4412] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:34.042170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:34.042962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:34.056943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:34.057592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:34.059066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:34.068756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:34.518707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:34.532359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:34.540296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87a1de01e7de440d86084c1b5b5aede4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9643f439b26e41cda482b9533143d636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:34.541801 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1c562d5-8508-4415-a0a7-9b43804413cd tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 200 len: 2209 microversion: 2.32 time: 0.504639 Mar 26 21:07:34.544955 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2335/4413] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:34 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 2209 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:34.888987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:34.890335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:34.899015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:34.899763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:34.901323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:34.902725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:35.489928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:07:35.490926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:07:35.491783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:07:35.492470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:07:35.493430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:07:35.517188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:35.523215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:35.524582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:35.529304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:35.574353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:07:35.581854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:07:35.600218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:07:35.602917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:07:35.659385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d610381-9c6d-4d71-a109-068e1ba333a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773823 Mar 26 21:07:35.660186 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2079/4414] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:07:35.666227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:35.666528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:35.673995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:35.674626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:35.675421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:35.675859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.000017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:36.015663 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f56d155-9fa0-4a82-93cd-527b78b0c870 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1497 microversion: 2.1 time: 1.129739 Mar 26 21:07:36.016412 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2336/4415] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:34 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1497 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:36.042148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:36.043417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:36.051432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.053163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.054948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.055745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.089913 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] HTTP exception thrown: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. Mar 26 21:07:36.090868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Returning 404 to user: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:07:36.091858 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e5b85a2-780c-484d-aaec-6ea4f4139dae tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 404 len: 111 microversion: 2.32 time: 0.073795 Mar 26 21:07:36.093544 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2337/4416] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:36 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:07:36.100452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f009ad7a-9fd6-47f6-9413-4891e5225409 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:36.101579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f009ad7a-9fd6-47f6-9413-4891e5225409 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:36.190248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f009ad7a-9fd6-47f6-9413-4891e5225409 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:36.202794 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f009ad7a-9fd6-47f6-9413-4891e5225409 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1214 microversion: 2.1 time: 0.107461 Mar 26 21:07:36.207083 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2338/4417] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:36 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:36.221780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e47e29aa-3103-4a11-a5ca-1b98757c2e55 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '.version_select at 0x7f6e58265550>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:36.243235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e47e29aa-3103-4a11-a5ca-1b98757c2e55 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268504012" status: 204 len: 0 microversion: 2.32 time: 0.032591 Mar 26 21:07:36.243902 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2339/4418] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Mar 26 21:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268504012 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:07:36.249893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fc112bcd-d07c-4b2f-b7f0-869601520b5e req-fac8b326-3c69-498f-aefa-49823606c4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce1f69-3633-4bcc-9f04-63d34647c925", "name": "network-vif-deleted", "tag": "df90cff0-cb5b-4aad-bb76-1204dc22e346"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:36.260727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fc112bcd-d07c-4b2f-b7f0-869601520b5e req-fac8b326-3c69-498f-aefa-49823606c4be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.261188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fc112bcd-d07c-4b2f-b7f0-869601520b5e req-fac8b326-3c69-498f-aefa-49823606c4be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.275286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fc112bcd-d07c-4b2f-b7f0-869601520b5e req-fac8b326-3c69-498f-aefa-49823606c4be service nova] Creating event network-vif-deleted:df90cff0-cb5b-4aad-bb76-1204dc22e346 for instance 90ce1f69-3633-4bcc-9f04-63d34647c925 on nch2-master-1 Mar 26 21:07:36.281894 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fc112bcd-d07c-4b2f-b7f0-869601520b5e req-fac8b326-3c69-498f-aefa-49823606c4be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036591 Mar 26 21:07:36.282693 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2340/4419] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:36.683898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:36.685205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:36.687545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:36.693591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.694059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.694890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.695337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.696963 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef5611bf-8ec2-4e63-92bf-f1453331cec9 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1591 microversion: 2.1 time: 1.034749 Mar 26 21:07:36.708005 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2080/4420] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:35 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1591 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:36.718515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:36.719314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:36.726907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.727360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.728558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:36.729005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:36.734309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lazy-loading 'flavor' on Instance uuid ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:07:37.101210 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab9c8cca-334d-4bc9-b90f-0497ac120a9f tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.392005 Mar 26 21:07:37.101804 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2081/4421] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:07:36 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64/os-interface => generated 285 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:37.106746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:37.107709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:37.112483 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f5620a8-7798-4fa2-86e5-9b56392b68f2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/action" status: 202 len: 0 microversion: 2.20 time: 0.433884 Mar 26 21:07:37.116154 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2341/4422] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:07:36 2022] POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:07:37.125091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:37.125809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:37.128266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.128719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.129492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.136774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.138153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.138624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.139416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.139872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.417554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:37.429779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:37.432356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:37.434191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-912a01df-1cec-48bd-af8d-4cc3d874bad1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.313408 Mar 26 21:07:37.447071 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2342/4423] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:37 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:37.453704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:37.455277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:37.464249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.465079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.466164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.466851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.617342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:37.632249 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f16ec6cb-83b0-4066-82d6-6fe374abd8e4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1272 microversion: 2.1 time: 0.183668 Mar 26 21:07:37.655538 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2343/4424] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:37 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:37.838086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:37.850981 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c29451d4-8052-4548-8dfb-b45ad08a70b7 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1500 microversion: 2.1 time: 0.747914 Mar 26 21:07:37.851843 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2082/4425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:37 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1500 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:37.870359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:37.870934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:37.886071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.886630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.889930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:37.890603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:37.943828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:07:38.070707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1def35e-0ce4-40dc-a6aa-17378801c3c9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "DELETE /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 204 len: 0 microversion: 2.1 time: 0.205720 Mar 26 21:07:38.071890 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2344/4426] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:07:37 2022] DELETE /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:07:38.081309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:38.082508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:38.091063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.091830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.092820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.093431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.460720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:38.461444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:38.469399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.469927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.470805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.471259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.718118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:38.727729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:38.730356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:38.732051 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ca384ac-6f48-40fc-a856-cdefdbf37503 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.281659 Mar 26 21:07:38.743585 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2345/4427] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:38 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:38.748680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:38.749417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:38.755897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.756599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.757498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.758326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:38.962767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:38.973036 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcc002e4-6677-4a46-85fe-765782c8a550 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1506 microversion: 2.1 time: 0.896134 Mar 26 21:07:38.974403 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2083/4428] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:38 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1506 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:38.979801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-94842fed-68a7-48a6-8281-a93511b022df req-55e88f45-cd4b-4054-b783-7c527fc4aefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15da470f-7f3d-4558-9cb1-7829e4952b5c", "tag": "36c88967-8618-45d8-aaf7-44c5948e28e6"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:38.988856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-94842fed-68a7-48a6-8281-a93511b022df req-55e88f45-cd4b-4054-b783-7c527fc4aefc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:38.989364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-94842fed-68a7-48a6-8281-a93511b022df req-55e88f45-cd4b-4054-b783-7c527fc4aefc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:39.012434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-94842fed-68a7-48a6-8281-a93511b022df req-55e88f45-cd4b-4054-b783-7c527fc4aefc service nova] Creating event network-changed:36c88967-8618-45d8-aaf7-44c5948e28e6 for instance 15da470f-7f3d-4558-9cb1-7829e4952b5c on nch1-master-1 Mar 26 21:07:39.019825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-94842fed-68a7-48a6-8281-a93511b022df req-55e88f45-cd4b-4054-b783-7c527fc4aefc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043619 Mar 26 21:07:39.021026 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2084/4429] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:39.137755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:39.164260 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8191f53f-894c-4e6d-bf30-c5745068cb9c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.419257 Mar 26 21:07:39.164866 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2346/4430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:38 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:39.752711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:39.753690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:39.760939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:39.761391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:39.762175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:39.762615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:39.991516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:39.992461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:39.998493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:39.999115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.000070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.000753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.293923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:40.314094 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-200acff0-b149-485a-9025-87f4c3e607f9 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1506 microversion: 2.1 time: 0.327070 Mar 26 21:07:40.315113 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2347/4431] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:39 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:40.333907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:40.334871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:40.344386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.351540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.353086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.355493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.514219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:40.530502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:40.532077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:40.533263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9c89e97-aeb5-4092-8e3c-946ddd5dd4de tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.786476 Mar 26 21:07:40.546008 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2085/4432] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:39 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:40.666395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:40.667373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:40.682573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.684889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.686301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.687005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.736756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:40.745002 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ee1bc62e-f08e-419c-861a-cd6871f19066 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.416910 Mar 26 21:07:40.749311 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2348/4433] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:40 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:40.757287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b2f0047c-5c87-4a0a-aec0-271ae3a97c34 req-f5d3378e-1549-4d78-9d64-d3f9a0f992e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331ad8cf-be35-4131-b01e-789202973f64", "tag": "4f2b792e-b9a0-468f-817b-6cfaf02808f7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:40.776492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b2f0047c-5c87-4a0a-aec0-271ae3a97c34 req-f5d3378e-1549-4d78-9d64-d3f9a0f992e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:40.779446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b2f0047c-5c87-4a0a-aec0-271ae3a97c34 req-f5d3378e-1549-4d78-9d64-d3f9a0f992e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:40.805580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b2f0047c-5c87-4a0a-aec0-271ae3a97c34 req-f5d3378e-1549-4d78-9d64-d3f9a0f992e1 service nova] Creating event network-changed:4f2b792e-b9a0-468f-817b-6cfaf02808f7 for instance 331ad8cf-be35-4131-b01e-789202973f64 on nch1-master-1 Mar 26 21:07:40.821042 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b2f0047c-5c87-4a0a-aec0-271ae3a97c34 req-f5d3378e-1549-4d78-9d64-d3f9a0f992e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069633 Mar 26 21:07:40.822380 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2349/4434] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:41.334522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:41.335987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:41.357667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.358383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.359395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.360423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.602630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:41.611974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-caf7be9f-3069-46db-a940-bb23bf21d396 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1506 microversion: 2.1 time: 0.283718 Mar 26 21:07:41.614626 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2350/4435] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:41 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:41.620594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:41.621475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:41.638712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.639967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.642137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.642606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.739613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:41.750364 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d15c8d4-8337-430b-ba70-a71b41af0f7b tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1591 microversion: 2.1 time: 1.089813 Mar 26 21:07:41.757937 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2086/4436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:40 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1591 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:41.770794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:41.771746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:41.786952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.788425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.792980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:41.793964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:41.863753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:41.874619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:41.876489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:41.877877 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cdb5bd13-efbc-48a0-bebf-3fdb083086ef tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.261430 Mar 26 21:07:41.879119 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2351/4437] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:41 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:42.454912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:42.476293 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a9ed582-9db5-43d5-874c-6506bbad397d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.710217 Mar 26 21:07:42.486335 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2087/4438] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:41 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:42.633459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:42.634772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:42.642811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:42.643411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:42.646083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:42.646643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:42.737541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:42.738330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:42.739565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lazy-loading 'fault' on Instance uuid 20b8a479-6555-46fa-ab78-583e753a2e59 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:07:42.908793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:42.913913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bfee91285f94b2eba5cd89004babf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:42.917930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:42.933713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88202958-9008-41d9-b901-331566165306 tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 200 len: 1304 microversion: 2.1 time: 0.305697 Mar 26 21:07:42.937792 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2352/4439] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:42 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 1304 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:42.944325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:42.944325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:42.944325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:42.944843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:43.090010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-957f1a4d-5ee1-45e2-9caf-4797e610c93e req-ce0c2907-2bb8-4c1a-a930-e0aa9896c79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b8a479-6555-46fa-ab78-583e753a2e59", "name": "network-vif-deleted", "tag": "7b0e0d6e-5f8a-42bc-be87-013dd0823c50"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:43.104025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-957f1a4d-5ee1-45e2-9caf-4797e610c93e req-ce0c2907-2bb8-4c1a-a930-e0aa9896c79e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:43.110622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-957f1a4d-5ee1-45e2-9caf-4797e610c93e req-ce0c2907-2bb8-4c1a-a930-e0aa9896c79e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:43.142567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-957f1a4d-5ee1-45e2-9caf-4797e610c93e req-ce0c2907-2bb8-4c1a-a930-e0aa9896c79e service nova] Creating event network-vif-deleted:7b0e0d6e-5f8a-42bc-be87-013dd0823c50 for instance 20b8a479-6555-46fa-ab78-583e753a2e59 on nch2-master-1 Mar 26 21:07:43.150745 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-957f1a4d-5ee1-45e2-9caf-4797e610c93e req-ce0c2907-2bb8-4c1a-a930-e0aa9896c79e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064579 Mar 26 21:07:43.152746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2353/4440] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:43.173794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:43.182345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:43.183872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:43.185075 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13ebb698-6490-45d4-8946-8b4d9bc28bd3 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.289747 Mar 26 21:07:43.195991 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2088/4441] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:42 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:43.494850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:43.495590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:43.507420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:43.507859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:43.509230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:43.509680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:43.688972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:43.698856 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e28c1c0-f910-408c-aa45-a2b4d452332f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.209115 Mar 26 21:07:43.709572 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2354/4442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:43 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:43.955572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:43.956918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] [instance: 20b8a479-6555-46fa-ab78-583e753a2e59] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:43.963580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:43.964055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:43.964828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:43.966478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:44.001747 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] HTTP exception thrown: Instance 20b8a479-6555-46fa-ab78-583e753a2e59 could not be found. Mar 26 21:07:44.004365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] Returning 404 to user: Instance 20b8a479-6555-46fa-ab78-583e753a2e59 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:07:44.006424 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48426610-f284-45bc-b2a5-ece7eb4bc31d tempest-TestServerAdvancedOps-269645215 tempest-TestServerAdvancedOps-269645215-project] 10.222.0.16 "GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59" status: 404 len: 111 microversion: 2.1 time: 0.055782 Mar 26 21:07:44.008344 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2089/4443] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:43 2022] GET /compute/v2.1/servers/20b8a479-6555-46fa-ab78-583e753a2e59 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:07:44.207485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:44.208956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:44.216561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:44.218882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:44.220828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:44.221826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:44.589143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:44.600496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:44.603883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:44.609530 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e5ce281-664b-4bc8-a261-a2891985d93b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.410501 Mar 26 21:07:44.610719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2355/4444] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:44 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:44.717555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:44.718181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:44.727705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:44.729449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:44.731625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:44.733321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.319622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:45.335143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-413f39a2-cb4f-4add-83d9-6fca995bee78 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.619974 Mar 26 21:07:45.336701 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2090/4445] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:44 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:45.414124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:45.414670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:45.432376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.433024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.433868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.434318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.474739 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] HTTP exception thrown: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. Mar 26 21:07:45.475763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Returning 404 to user: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:07:45.477082 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0698ec7-23c0-4add-a80e-7cc885a7bef5 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 404 len: 111 microversion: 2.32 time: 0.071987 Mar 26 21:07:45.478448 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2356/4446] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:07:45 2022] DELETE /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:07:45.486788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:45.487684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] [instance: 90ce1f69-3633-4bcc-9f04-63d34647c925] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:45.496693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.497983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.498934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.499380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.517041 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] HTTP exception thrown: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. Mar 26 21:07:45.517925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] Returning 404 to user: Instance 90ce1f69-3633-4bcc-9f04-63d34647c925 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:07:45.519327 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9dfdfeb1-5f31-4076-9ce0-d22800304939 tempest-TaggedBootDevicesTest-1972550485 tempest-TaggedBootDevicesTest-1972550485-project] 10.222.0.16 "GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925" status: 404 len: 111 microversion: 2.32 time: 0.036842 Mar 26 21:07:45.521007 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2091/4447] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:45 2022] GET /compute/v2.1/servers/90ce1f69-3633-4bcc-9f04-63d34647c925 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:07:45.628988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:45.630148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:45.638583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.639602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.641005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:45.641838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:45.924718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:45.947472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:45.950383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:45.956114 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-604a4f29-f066-4c47-abff-1c069b0d8e05 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.332052 Mar 26 21:07:45.959653 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2357/4448] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:45 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:46.353969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:46.354652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:46.372882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:46.372882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:46.373966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:46.374507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:46.411525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-206407f3-1c0b-41c3-83b0-e6f7b9277040 req-00a7c8c4-d0f6-4306-9d89-9cca9dd60dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15da470f-7f3d-4558-9cb1-7829e4952b5c", "name": "network-vif-plugged", "status": "completed", "tag": "36c88967-8618-45d8-aaf7-44c5948e28e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:46.429214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-206407f3-1c0b-41c3-83b0-e6f7b9277040 req-00a7c8c4-d0f6-4306-9d89-9cca9dd60dc4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:46.429860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-206407f3-1c0b-41c3-83b0-e6f7b9277040 req-00a7c8c4-d0f6-4306-9d89-9cca9dd60dc4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:46.467188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-206407f3-1c0b-41c3-83b0-e6f7b9277040 req-00a7c8c4-d0f6-4306-9d89-9cca9dd60dc4 service nova] Creating event network-vif-plugged:36c88967-8618-45d8-aaf7-44c5948e28e6 for instance 15da470f-7f3d-4558-9cb1-7829e4952b5c on nch1-master-1 Mar 26 21:07:46.494631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-206407f3-1c0b-41c3-83b0-e6f7b9277040 req-00a7c8c4-d0f6-4306-9d89-9cca9dd60dc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087179 Mar 26 21:07:46.495461 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2358/4449] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:07:46.709570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:46.743675 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-978cafe4-c6c1-4828-b940-7d828e875913 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.388610 Mar 26 21:07:46.747883 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2092/4450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:46 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:07:46.975725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:46.978449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:46.985234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:46.985951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:46.987088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:46.987749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:47.180538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:47.190191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:47.192762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:47.194435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e61cd21e-658f-4495-aa20-aa4fff3e01d7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.223630 Mar 26 21:07:47.195043 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2359/4451] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:46 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:47.775091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:47.778749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:47.786740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:47.787516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:47.788876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:47.789340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:48.014024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:48.026165 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f5fc835e-0a14-4ddc-b737-829b6abc0e9e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1314 microversion: 2.1 time: 0.259257 Mar 26 21:07:48.028007 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2093/4452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:47 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:48.215433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:48.216875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:48.227633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:48.228268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:48.229663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:48.230283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:48.502660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:48.514729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:48.516370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:48.517741 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-172867e3-f602-47ff-bb8d-091a076fb545 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.307149 Mar 26 21:07:48.519734 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2360/4453] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:48 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:49.048263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:49.049238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:49.056597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.057118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.057889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.058330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.216447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:49.225904 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-856d18ff-d32e-4a47-898c-136bd14f4d0f tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1500 microversion: 2.1 time: 0.181554 Mar 26 21:07:49.226492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2094/4454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:49 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:49.244133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-746b9fa7-2637-4476-9a00-13cb20dfa836 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:49.257638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746b9fa7-2637-4476-9a00-13cb20dfa836 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.258307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-746b9fa7-2637-4476-9a00-13cb20dfa836 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.281809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-746b9fa7-2637-4476-9a00-13cb20dfa836 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:07:49.338778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-746b9fa7-2637-4476-9a00-13cb20dfa836 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.099262 Mar 26 21:07:49.340026 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2361/4455] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:07:49 2022] POST /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:07:49.353969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:49.355701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:49.374111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.377515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.379132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.379849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.538826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:49.539692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:49.546063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.546721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.547871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:49.548489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:49.570755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:49.580446 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df417cd6-cd3a-4c0a-9e9d-da4bd57093de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.234097 Mar 26 21:07:49.593366 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2095/4456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:49 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:49.737693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:49.746952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:49.749086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:49.750518 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a4f6d4ee-4b04-4014-be13-0cac04607f67 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.216726 Mar 26 21:07:49.751701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2362/4457] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:49 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:50.605421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:50.606040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:50.617784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:50.618589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:50.620938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:50.628162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:50.770856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:50.771532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:50.783048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:50.783514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:50.787196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:50.787670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:50.946428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:50.954835 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3469032d-24e6-46aa-9ad1-44ee610ee22b tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.360213 Mar 26 21:07:50.955960 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2096/4458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:50 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:50.977051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:50.992281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:50.993906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:50.995161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54632cea-7f31-47e0-8e7f-e887ee0fcc31 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.228931 Mar 26 21:07:51.001193 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2363/4459] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:50 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:51.037413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:51.038192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:51.044883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:51.048592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:51.049732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:51.050335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:51.093320 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9d3f169e-f541-4a9c-b8a2-cf3603bf3b4c tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/ips" status: 200 len: 146 microversion: 2.1 time: 0.060300 Mar 26 21:07:51.095052 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2097/4460] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:07:51 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:51.979141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:51.979770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:51.991368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:51.991828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:51.992693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:51.993320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:52.034414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:52.036955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:52.075802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:52.087498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:52.088450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:52.088909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:52.486323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:52.498715 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-017355b8-cc06-4fba-8fe4-d28adf96d602 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.526191 Mar 26 21:07:52.503522 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2364/4461] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:51 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:52.679409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:52.689973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:52.694441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:52.696443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5402bdf1-8f0b-4b0b-8191-33ffec265a6a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.682343 Mar 26 21:07:52.697893 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2098/4462] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:52 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:52.767025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f610a18f-caa9-441d-a864-6de8abe1f502"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:52.768824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:52.778274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:52.778728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:52.779840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:52.780409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:53.184341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e922b8c-065d-4028-ac43-fb93c8e7252d tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420924 Mar 26 21:07:53.190940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2365/4463] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:07:52 2022] POST /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:53.524469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:53.524824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:53.543764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:53.544269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:53.555106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:53.556031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:53.720128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:53.721910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:53.735057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:53.736150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:53.737704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:53.738392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:53.877880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:53.895140 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac5e83e7-bf54-4fcd-91b6-8a7beaebc927 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.377844 Mar 26 21:07:53.907071 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2099/4464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:53 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:54.076103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:54.085613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:54.087494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:54.088910 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48a8b856-e6c8-4d75-9b45-c007971a5ae7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1745 microversion: 2.20 time: 0.376971 Mar 26 21:07:54.101716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2366/4465] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:53 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1745 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:54.922139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:54.924731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:54.934971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:54.937249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:54.941472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:54.942972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:55.111181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:55.112389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:55.128275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:55.130079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:55.132974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:55.137154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:55.503120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:55.518362 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53229284-1913-4de9-b9bb-ef22cd699291 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.608251 Mar 26 21:07:55.519760 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2100/4466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:54 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:55.756593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:55.775799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:55.786771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:55.788485 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-143381f8-647c-402d-be74-c41a75ad5e3a tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.683250 Mar 26 21:07:55.789714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2367/4467] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:55 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:07:56.537299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:56.537921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:56.548057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:56.557126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:56.563344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:56.564303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:56.807413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:56.808076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:56.822457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:56.822925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:56.823738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:56.824214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:57.448715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:57.470412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:57.484224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:57.486155 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-38e043b8-bda4-4be0-9a63-455d15039eca tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.682900 Mar 26 21:07:57.511148 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2368/4468] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:56 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:57.520536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:57.521540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:57.555536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:57.556279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:57.566424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:57.567160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:57.632743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4ace790c-3b68-40c0-b551-f823b2dd817b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120368 Mar 26 21:07:57.634087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2369/4469] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:07:57 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:57.650145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:57.650964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:57.661247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:57.662236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:57.663385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:57.664028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:57.694994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:57.703762 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8ca42d8-0732-4438-933e-9f52ca85ed1c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 1.170761 Mar 26 21:07:57.706738 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2101/4470] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:56 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:57.727711 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fdebcfe5-dab3-40bb-9037-dd54cab88b4f tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502" status: 200 len: 194 microversion: 2.1 time: 0.084090 Mar 26 21:07:57.747401 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2370/4471] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Mar 26 21:07:57 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:58.071497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e8ad9b81-ba96-43d1-958a-5a74e0c753b7 req-c3f9c23b-0085-4097-a632-86aa32cf0da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-plugged", "status": "completed", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:58.095511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e8ad9b81-ba96-43d1-958a-5a74e0c753b7 req-c3f9c23b-0085-4097-a632-86aa32cf0da5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:58.100945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e8ad9b81-ba96-43d1-958a-5a74e0c753b7 req-c3f9c23b-0085-4097-a632-86aa32cf0da5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:58.124440 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e8ad9b81-ba96-43d1-958a-5a74e0c753b7 req-c3f9c23b-0085-4097-a632-86aa32cf0da5 service nova] Creating event network-vif-plugged:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:07:58.143613 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e8ad9b81-ba96-43d1-958a-5a74e0c753b7 req-c3f9c23b-0085-4097-a632-86aa32cf0da5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084532 Mar 26 21:07:58.149290 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2102/4472] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:07:58.513226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:58.515091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:58.534370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:58.534976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:58.536398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:58.536848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:58.728488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:07:58.729269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:58.747447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:58.748236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:58.750720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:58.751445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:59.186946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:59.196989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:59.208445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:59.213053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-51ab7379-26e1-4bfc-8f52-5d65e8d3ec2b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.704288 Mar 26 21:07:59.213670 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2371/4473] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:07:58 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:07:59.320979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ae8f0ee-e556-44ed-afeb-a79fcba7ce64"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:07:59.325799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:07:59.333437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:59.335063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:59.336173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:07:59.336796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:07:59.489633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:07:59.511988 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9510c7b6-3fc5-4b9a-b022-6d85cd61ece7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.788063 Mar 26 21:07:59.539552 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2103/4474] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:07:58 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:07:59.977432 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f20d7f4b-b014-4b8d-8de3-60621df302c0 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "POST /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670351 Mar 26 21:08:00.002916 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2372/4475] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:07:59 2022] POST /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:00.235539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:00.236966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:00.249755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:00.251346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:00.256467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:00.267162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:00.558362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:00.559373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:00.575677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:00.576380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:00.577880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:00.579542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:00.609820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:00.619074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:00.643571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:00.646776 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0d46f15-fd41-4418-88e5-068ac8574e01 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.419906 Mar 26 21:08:00.652493 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2104/4476] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:00 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:01.077399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:01.098684 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c37d88ff-6a05-4c6d-a61f-acbe3d918ba0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.534648 Mar 26 21:08:01.110018 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2373/4477] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:00 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:01.669590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:01.670214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:01.681471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:01.691135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:01.694576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:01.695760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:02.116490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:02.117119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:02.132701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:02.142539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:02.143538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:02.148287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:02.161722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:02.177972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:02.181616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:02.186982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-311da4ae-c597-4571-b5c9-4156672095ab tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.521941 Mar 26 21:08:02.195270 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2105/4478] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:01 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:02.591311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:02.612753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e10299fc-e91e-4609-8ee6-df749b27fca4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.500726 Mar 26 21:08:02.614144 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2374/4479] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:02 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:03.213837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:03.215092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:03.235612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.236897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.238978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.242800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.564245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:03.576460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:03.578626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:03.581518 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2aac6ed2-68fa-4b2d-9bf1-1f5e8fc125f5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.371372 Mar 26 21:08:03.595248 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2106/4480] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:03 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:03.630882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:03.632207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:03.656926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.658872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.669055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.670401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.715660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:03.716672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:03.733742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.734204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.735344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.735957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.806576 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25f2d578-9c43-4b00-b0e3-27da560e68a9 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.095555 Mar 26 21:08:03.814787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2107/4481] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:08:03 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:03.974301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:03.974805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:03.989374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.989825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:03.992798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:03.993404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:04.051777 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc2630dd-c6f9-4b7e-b692-2b9c68009a25 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502" status: 200 len: 194 microversion: 2.1 time: 0.081431 Mar 26 21:08:04.054065 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2108/4482] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Mar 26 21:08:03 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:08:04.065586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:04.066778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:04.075598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:04.076426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:04.080613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:04.083293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:04.256805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:04.267649 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-509474e2-4077-408c-ba1b-f6bee35cd2b0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.641215 Mar 26 21:08:04.281300 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2375/4483] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:03 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:04.336252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lazy-loading 'services' on Instance uuid 71d82499-c9cd-481a-bbec-a2822b0786f6 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:08:04.493455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-082b6e82-6352-4448-b065-0b06995d7a24 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502" status: 202 len: 0 microversion: 2.1 time: 0.432689 Mar 26 21:08:04.494737 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2109/4484] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:08:04 2022] DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/f610a18f-caa9-441d-a864-6de8abe1f502 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:08:04.603943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:04.605221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:04.623562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:04.625800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:04.629672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:04.633923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.286813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:05.287527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:05.300517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.301014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.301811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.302254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.680901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:05.705452 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f939064f-37c7-4ad7-8f6b-3554195b94f0 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.419467 Mar 26 21:08:05.706197 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2110/4485] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:05 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:05.727560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:05.728282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:05.735094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.735876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.736933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.739550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.749223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:05.764165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:05.766202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:05.770843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c641625-099c-4ed0-80d1-5b089a4cc819 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 1.171894 Mar 26 21:08:05.771743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2376/4486] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:04 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:05.791401 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8b33d4e1-662a-4e6d-a763-fe1deefba7bc tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/0ae8f0ee-e556-44ed-afeb-a79fcba7ce64" status: 200 len: 194 microversion: 2.1 time: 0.068154 Mar 26 21:08:05.802991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:05.803891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:05.807028 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2111/4487] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Mar 26 21:08:05 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/0ae8f0ee-e556-44ed-afeb-a79fcba7ce64 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:05.811119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.811908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.812886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:05.813507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:05.957402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lazy-loading 'services' on Instance uuid 71d82499-c9cd-481a-bbec-a2822b0786f6 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:08:06.147172 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d11ce34-5a65-4ba1-8df4-76968924ef2a tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/0ae8f0ee-e556-44ed-afeb-a79fcba7ce64" status: 202 len: 0 microversion: 2.1 time: 0.348346 Mar 26 21:08:06.152677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2377/4488] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:08:05 2022] DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments/0ae8f0ee-e556-44ed-afeb-a79fcba7ce64 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:08:06.723494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:06.724299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:06.735935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:06.739587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:06.740578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:06.740963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:06.797753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:06.799124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:06.817304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:06.817956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:06.818959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:06.819560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.103883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:07.118004 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da0ec67a-6933-4b4b-bf7a-8a0ea4062aa1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.399261 Mar 26 21:08:07.123803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2112/4489] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:06 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:07.253535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:07.261900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:07.277932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:07.279381 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f09f613-e48a-48ee-9a60-25c93a42a090 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.493410 Mar 26 21:08:07.292016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2378/4490] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:06 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:07.497724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:07.498707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:07.509781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.509781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.513707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.514269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.563878 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-241ab121-12ff-469d-9917-dfef54495fe2 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070064 Mar 26 21:08:07.565473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2113/4491] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:08:07 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:08:07.727934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:07.729005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:07.735435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.736167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.736953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.737402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.773818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4ad4fd55-a6fa-44a4-a0b4-2a6ca848285e tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047779 Mar 26 21:08:07.776930 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2379/4492] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:08:07 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:08:07.866150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:07.866786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:07.877469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.877934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.878844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:07.879218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:07.924621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:08.107696 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b32eae9-4282-4002-b182-5759fdf92dc4 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 204 len: 0 microversion: 2.1 time: 0.245976 Mar 26 21:08:08.109699 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2380/4493] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:07 2022] DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:08.125034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:08.131628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:08.152325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.154997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.157361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.158750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.210553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cd9ee47-2b0f-4f37-b250-3123ab97b117 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-944459532", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:08.212547 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5cd9ee47-2b0f-4f37-b250-3123ab97b117 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] HTTP exception thrown: min_count must be <= max_count Mar 26 21:08:08.213733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cd9ee47-2b0f-4f37-b250-3123ab97b117 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Returning 400 to user: min_count must be <= max_count {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:08.214633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cd9ee47-2b0f-4f37-b250-3123ab97b117 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.433771 Mar 26 21:08:08.217953 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2114/4494] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:07 2022] POST /compute/v2.1/servers => generated 74 bytes in 438 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:08.228654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:08.229285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:08.243779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.247247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.249883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.250510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.460843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:08.469661 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32bb6756-5333-4490-88ae-767d2f52b26b tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1674 microversion: 2.1 time: 0.355583 Mar 26 21:08:08.471087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2381/4495] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:08 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1674 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:08.486722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-227c774c-f451-4868-b882-55ce0f0122db tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2066341516", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "max_count": 0}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:08.491046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-227c774c-f451-4868-b882-55ce0f0122db tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:08.493116 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-227c774c-f451-4868-b882-55ce0f0122db tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020885 Mar 26 21:08:08.494327 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2382/4496] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:08:08.509538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:08.510170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:08.536806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.537267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.539538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:08.540032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:08.707491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:08.733335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67431f6e-4667-4f71-a0a0-26364c00229e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.512363 Mar 26 21:08:08.734611 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2115/4497] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:08 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:08.762037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cff4c0d0-8065-4e14-9a0f-4f1f8aba7ef3 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1662838074", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "max_count": 2.5}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:08.767370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cff4c0d0-8065-4e14-9a0f-4f1f8aba7ef3 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:08.771356 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cff4c0d0-8065-4e14-9a0f-4f1f8aba7ef3 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020899 Mar 26 21:08:08.782690 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2116/4498] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:08:08.910961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:08.923787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:08.926413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:08.928470 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99a3556e-46b4-4d52-b867-d20f2461f7a7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.431102 Mar 26 21:08:08.940916 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2383/4499] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:08 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:08.974553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e84f2cc0-ad08-46b1-8a87-a0f5fd527b24 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1387077492", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 0}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:08.975890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e84f2cc0-ad08-46b1-8a87-a0f5fd527b24 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:08.976712 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e84f2cc0-ad08-46b1-8a87-a0f5fd527b24 tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007499 Mar 26 21:08:08.977226 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2117/4500] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:08:09.091812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-121b85c4-1835-442d-9e56-82fad4e803fb tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1686931229", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "min_count": 2.5}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:09.093855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-121b85c4-1835-442d-9e56-82fad4e803fb tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:09.094879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-121b85c4-1835-442d-9e56-82fad4e803fb tempest-MultipleCreateNegativeTestJSON-1450644153 tempest-MultipleCreateNegativeTestJSON-1450644153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008521 Mar 26 21:08:09.095630 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2384/4501] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:09 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:08:09.487775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:09.488957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:09.502506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:09.505961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:09.507840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:09.510806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:09.751019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:09.751651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:09.764628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:09.765076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:09.765933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:09.766359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:10.139399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:10.153178 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9115289-a8bc-4bd4-96fa-d66fed3f3eee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1674 microversion: 2.1 time: 0.669495 Mar 26 21:08:10.161823 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2118/4502] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:09 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1674 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:10.182417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:10.189260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:10.226044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:10.240770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a191c666-d3da-439b-8d41-709170ca89a1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.493670 Mar 26 21:08:10.246308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:10.246839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:10.254972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:10.258204 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2385/4503] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:09 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:10.258844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:10.793349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:10.812671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:10.819397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:10.829157 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-42ecc44f-4cc7-4206-a7ad-00e7ac49e6a6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.666227 Mar 26 21:08:10.829909 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2119/4504] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:10 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:11.180045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:11.181793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:11.212152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:11.226644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:11.229775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:11.230427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:11.274080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:11.274737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:11.289055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:11.305045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:11.315248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:11.316756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:11.883703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:11.894733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b4f23ed-c159-4d5f-990a-ee454aaad5f8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1674 microversion: 2.1 time: 0.719926 Mar 26 21:08:11.904400 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2386/4505] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:11 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1674 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:12.328407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:12.346889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90431e0c-140d-4512-80bf-96bbc6501c5e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 1.069997 Mar 26 21:08:12.352761 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2120/4506] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:11 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:12.439358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:12.441008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:12.464458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:12.464957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:12.468216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:12.471233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:12.923808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:12.929334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:12.949331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:12.952197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:12.959186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:12.959962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:13.058411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:13.080108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:13.081705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:13.100499 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f57fa816-1d20-4ffc-a08e-7bffd188f777 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 1.194470 Mar 26 21:08:13.101110 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2387/4507] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:11 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:13.125973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-79288eae-8b69-497b-8435-c4a0639db50b req-0e694332-686e-4755-bf72-b2f8c6077ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d82499-c9cd-481a-bbec-a2822b0786f6", "name": "network-vif-deleted", "tag": "3e1be3af-c4f0-434c-aa0e-29156495a7bb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:13.138056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-79288eae-8b69-497b-8435-c4a0639db50b req-0e694332-686e-4755-bf72-b2f8c6077ee2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:13.138542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-79288eae-8b69-497b-8435-c4a0639db50b req-0e694332-686e-4755-bf72-b2f8c6077ee2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:13.170118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-79288eae-8b69-497b-8435-c4a0639db50b req-0e694332-686e-4755-bf72-b2f8c6077ee2 service nova] Creating event network-vif-deleted:3e1be3af-c4f0-434c-aa0e-29156495a7bb for instance 71d82499-c9cd-481a-bbec-a2822b0786f6 on nch1-master-1 Mar 26 21:08:13.180365 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-79288eae-8b69-497b-8435-c4a0639db50b req-0e694332-686e-4755-bf72-b2f8c6077ee2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077885 Mar 26 21:08:13.186397 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2388/4508] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:13.202791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cab4cf432764bb487de9abc0f283898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32df8b04107445c89edb0d809d87d6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:13.213699 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8556d85b-edf0-488a-990e-0eedf0874984 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 200 len: 1322 microversion: 2.1 time: 0.293701 Mar 26 21:08:13.214600 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2121/4509] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:12 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:13.373199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:13.374312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:13.386302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:13.392095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:13.393346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:13.394935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:13.954008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:13.962842 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2479c99-5b2b-4b55-be47-c78abd1f67de tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.595727 Mar 26 21:08:13.963445 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2389/4510] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:13 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:14.120027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.120652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:14.140436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.141139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.143717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.144603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.399617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-964562462", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": "none"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:14.451517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.462368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:08:14.463108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:08:14.463731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:08:14.464253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.465783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.467353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:08:14.468029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:08:14.471678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66838c9a-4f2f-4f34-a830-66a13ce3a1b1 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.355462 Mar 26 21:08:14.474049 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2390/4511] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:14 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:14.483265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.494209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:14.494409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.495164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.496223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.496847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.518188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Getting quotas for project bdbeae943588491d9f3a6c18c9671a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:08:14.520978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.521457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.524388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Getting quotas for user 722acaff4a96454285de3e32aab91466 and project bdbeae943588491d9f3a6c18c9671a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:08:14.524915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.525382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.541766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:08:14.544819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:08:14.566343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. Mar 26 21:08:14.566963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:14.567836 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-30684a21-b8a7-40b5-bcc6-d1633bf7b736 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 404 len: 111 microversion: 2.1 time: 0.092658 Mar 26 21:08:14.568502 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2391/4512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:14 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:14.581775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1942b62-3dc7-444d-accd-2bc8d5acaabb tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '.version_select at 0x7f6e5ed53820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.619884 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1942b62-3dc7-444d-accd-2bc8d5acaabb tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022620646" status: 202 len: 0 microversion: 2.1 time: 0.046740 Mar 26 21:08:14.621050 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2392/4513] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022620646 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:08:14.652037 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0109ec9-6edd-4bb9-9aeb-36e03e1e3d71 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.677836 Mar 26 21:08:14.665192 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2122/4514] 10.222.0.16 () {62 vars in 1187 bytes} [Sat Mar 26 21:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 26 21:08:14.671400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.672079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:14.785543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.792459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.795032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Searching by: {'deleted': False, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:08:14.820549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.825720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.826934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.828623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:14.832641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:14.843388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.853142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:14.858627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-580ed4bb-dff8-464a-b147-bb4ea7260fa5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1280 microversion: 2.47 time: 0.192022 Mar 26 21:08:14.862474 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2393/4515] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:14 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:14.927560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:08:14.987152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:14.988472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:15.011291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.020823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.021891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.028736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.034354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d64e21f-b3ff-44d1-9545-b0aa5bdc0018 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.253500 Mar 26 21:08:15.038247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2123/4516] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 21:08:14 2022] GET /compute/v2.1/servers => generated 340 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:15.053146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:15.070316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.071111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Searching by: {'deleted': False, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:08:15.089088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.089753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.091225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.091822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.160880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:08:15.258361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.277683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.278390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.347958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.358488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14cc94b7-8c33-4fd0-999e-89e6e18a05c3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 0.377999 Mar 26 21:08:15.359612 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2394/4517] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:14 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:15.491165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:15.491683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:15.511665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.515188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.517436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.519138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.923260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.932928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.940563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:15.942069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-953069e9-99f1-45e0-ab1e-fc672351cac6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.455494 Mar 26 21:08:15.949252 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2395/4518] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:15 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:08:15.955110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:15.960062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:15.982697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.984954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:15.985930 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:15.986527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.158019 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ad8d7b1-b209-4509-bdce-1254e4877fea tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 1.113769 Mar 26 21:08:16.158589 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2124/4519] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:08:15 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:16.178349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9952c767-4e18-46c7-a93e-e11e52795976 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:16.198099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9952c767-4e18-46c7-a93e-e11e52795976 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021349 Mar 26 21:08:16.200223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2125/4520] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:08:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:08:16.265225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:16.283527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:16.298400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:16.305874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4f069ed-1648-4ac6-a72e-dac273afcb67 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1276 microversion: 2.47 time: 0.349130 Mar 26 21:08:16.306589 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2396/4521] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:15 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:16.377625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:16.378389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:16.390882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.393532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.396250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.398121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.554257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:16.555233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:16.589964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.590649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.591767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.593398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.682238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:16.923725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d682dbb7-1ef2-48a5-845b-2a93564c9b43 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "DELETE /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 204 len: 0 microversion: 2.1 time: 0.379334 Mar 26 21:08:16.924922 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2397/4522] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:16 2022] DELETE /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:16.939275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:16.941742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:16.956047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.957305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:16.958392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:16.959585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:17.618897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:17.629002 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eeb7471e-6cc0-4682-8504-c2b88c2071c5 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1716 microversion: 2.1 time: 0.698458 Mar 26 21:08:17.631846 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2398/4523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:16 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1716 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:17.637206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:17.642600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:17.661634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:17.662106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:17.662918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:17.663367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:17.734454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:17.750020 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbfc10b7-b28a-47e3-a082-ebf3c223c1ce tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 1.376366 Mar 26 21:08:17.754405 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2126/4524] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:16 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:17.792639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:17.793371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:17.810454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:17.813785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:17.819315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:17.820165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:18.115846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.134171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.140277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.151353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.153681 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2a6a709f-b3e0-4609-8f3d-a9f922c18f03 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1338 microversion: 2.47 time: 0.383354 Mar 26 21:08:18.155315 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2127/4525] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:17 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1338 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:18.172232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.173823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:18.174971 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-322c5ed3-c796-4466-8e66-7bd3b73dd818 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.541993 Mar 26 21:08:18.183185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2399/4526] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:17 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:18.650349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:18.652341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:18.678924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:18.679375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:18.682749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:18.690204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:18.772952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:18.775720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:18.793613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:18.795720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:18.797067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:18.799021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.558436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:19.577843 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf732244-f3a8-4a08-8f4e-6ca39f468940 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1716 microversion: 2.1 time: 0.932605 Mar 26 21:08:19.590886 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2128/4527] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:18 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1716 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:19.625182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:19.626157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:19.644767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.645731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.649521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.651721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.769870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:19.789963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:19.794083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:19.797772 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2a6a31d-f152-47a2-a76f-d856c1b59ceb tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1359 microversion: 2.47 time: 0.204189 Mar 26 21:08:19.804279 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2129/4528] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:19 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:19.809742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:19.811248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:19.835192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.836586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.838479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.840016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.890777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:19.903758 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b11a554-21e0-4a20-bc68-c21ad52d1d08 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1510 microversion: 2.1 time: 1.134961 Mar 26 21:08:19.904447 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2400/4529] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:18 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1510 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:19.928574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1213773262"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:19.930204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:19.938241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.938766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:19.940499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:19.941294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.254924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:20.271590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:20.273922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:20.277095 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15b9240b-d57e-4de2-8a62-c607ef000443 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1740 microversion: 2.20 time: 0.471196 Mar 26 21:08:20.278585 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2130/4530] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:19 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:20.394640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0d52a5a-1ba4-47a4-95e9-51c6ff99593e tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "POST /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01/action" status: 202 len: 52 microversion: 2.47 time: 0.487472 Mar 26 21:08:20.395686 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2401/4531] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:08:19 2022] POST /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01/action => generated 52 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Mar 26 21:08:20.411028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:20.412656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:20.428397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.428960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.429822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.430470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.465008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:20.477162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:20.478002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:20.486846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.487580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.491126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.491748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.508977 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. Mar 26 21:08:20.509820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:20.511389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7c84d6a9-4bf5-452f-9c84-15e003161ae8 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 404 len: 111 microversion: 2.1 time: 0.040249 Mar 26 21:08:20.513072 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2402/4532] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:20 2022] DELETE /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:08:20.522857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:20.524630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: 71d82499-c9cd-481a-bbec-a2822b0786f6] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:20.536565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.542293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.555718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.557596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.602207 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. Mar 26 21:08:20.605288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance 71d82499-c9cd-481a-bbec-a2822b0786f6 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:20.606412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bccf9cbf-48c0-40c0-8597-d9c3c19dd305 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6" status: 404 len: 111 microversion: 2.1 time: 0.089220 Mar 26 21:08:20.626886 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2403/4533] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:20 2022] GET /compute/v2.1/servers/71d82499-c9cd-481a-bbec-a2822b0786f6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:20.646088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:20.647379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:20.671283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.671760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.675786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c077b508-a22d-4cc5-89d7-11d141a34430 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "DELETE /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 204 len: 0 microversion: 2.47 time: 0.273410 Mar 26 21:08:20.677487 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2131/4534] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:08:20 2022] DELETE /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:08:20.679624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.680922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.694082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:20.695289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:20.734857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.737790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:20.742086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:20.747606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.031069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.039674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.041352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.042627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81406ba7-106c-4c7b-a28f-c0e77eb525c5 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1365 microversion: 2.47 time: 0.360367 Mar 26 21:08:21.043750 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2132/4535] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:20 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:21.049918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f103eebc-5b25-4593-a7c9-c09db64c0354 req-d0915c86-857e-4a0a-9ad7-d42c50fb9152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331ad8cf-be35-4131-b01e-789202973f64", "name": "network-vif-deleted", "tag": "4f2b792e-b9a0-468f-817b-6cfaf02808f7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:21.062026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f103eebc-5b25-4593-a7c9-c09db64c0354 req-d0915c86-857e-4a0a-9ad7-d42c50fb9152 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.062721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f103eebc-5b25-4593-a7c9-c09db64c0354 req-d0915c86-857e-4a0a-9ad7-d42c50fb9152 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.067334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87af7ce66f048e3942c2846edb30c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c58247395bea4447bc23f219d3c1cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.079434 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-20e14177-8718-481d-9c7a-e0be948e1174 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 200 len: 1648 microversion: 2.1 time: 0.450135 Mar 26 21:08:21.080114 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2404/4536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:20 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 1648 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:21.088290 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f103eebc-5b25-4593-a7c9-c09db64c0354 req-d0915c86-857e-4a0a-9ad7-d42c50fb9152 service nova] Creating event network-vif-deleted:4f2b792e-b9a0-468f-817b-6cfaf02808f7 for instance 331ad8cf-be35-4131-b01e-789202973f64 on nch1-master-1 Mar 26 21:08:21.092229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f103eebc-5b25-4593-a7c9-c09db64c0354 req-d0915c86-857e-4a0a-9ad7-d42c50fb9152 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046524 Mar 26 21:08:21.093451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2133/4537] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:21.118784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:21.119416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:21.137436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.137917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.141019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.143017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.303889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:21.304853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:21.331022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.333573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.338051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.338911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.811816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.821547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ac2dfee-7f97-4676-a594-41a2ab591306 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1487 microversion: 2.1 time: 0.740270 Mar 26 21:08:21.822144 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2405/4538] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:21 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1487 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:21.844733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:21.848611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:21.867493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.868382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.869424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:21.870013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:21.872466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.911864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.914806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:21.915061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:21.922092 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7fb255e9-58a1-4915-824d-9c3f5d373bc4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1722 microversion: 2.20 time: 0.623751 Mar 26 21:08:21.923078 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2134/4539] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:21 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1722 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:22.036816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.037346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.053327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3a20e35-ccea-4dcc-a9b5-35f7c112eb06 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 204 len: 0 microversion: 2.1 time: 0.213048 Mar 26 21:08:22.054862 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2406/4540] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:21 2022] DELETE /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:22.068622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.069750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.070568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.073096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.073851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.074572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.088321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.092162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.093227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.094741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.104125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. Mar 26 21:08:22.107498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:22.109320 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23adf090-675d-4b7c-b224-9823225246ee tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 404 len: 111 microversion: 2.1 time: 0.077157 Mar 26 21:08:22.110046 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2135/4541] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:22 2022] DELETE /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:08:22.117012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.117633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.132212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.133135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.134103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.134722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.208888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:22.218020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:22.220042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:22.221562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d0f6845-9671-4c37-859f-b3874d26e2ba tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1365 microversion: 2.47 time: 0.110604 Mar 26 21:08:22.222334 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2136/4542] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:22 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:22.227839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.228722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] [instance: 331ad8cf-be35-4131-b01e-789202973f64] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.235280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.236012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.236969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.238132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.252603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] HTTP exception thrown: Instance 331ad8cf-be35-4131-b01e-789202973f64 could not be found. Mar 26 21:08:22.254020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Returning 404 to user: Instance 331ad8cf-be35-4131-b01e-789202973f64 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:22.255206 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29addada-310b-40d5-b7ca-fae2d525a117 tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64" status: 404 len: 111 microversion: 2.1 time: 0.030907 Mar 26 21:08:22.255978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2137/4543] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:22 2022] GET /compute/v2.1/servers/331ad8cf-be35-4131-b01e-789202973f64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:22.260967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.261940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] [instance: d4c0441e-1bda-47d4-a6d1-9139adecc0b5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.268286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.269020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.269952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.270537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.288679 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] HTTP exception thrown: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. Mar 26 21:08:22.289450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] Returning 404 to user: Instance d4c0441e-1bda-47d4-a6d1-9139adecc0b5 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:22.290901 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85d626ef-8e60-424c-8ebd-521c10bfb292 tempest-AttachVolumeTestJSON-297536414 tempest-AttachVolumeTestJSON-297536414-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5" status: 404 len: 111 microversion: 2.1 time: 0.033693 Mar 26 21:08:22.292208 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2138/4544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:22 2022] GET /compute/v2.1/servers/d4c0441e-1bda-47d4-a6d1-9139adecc0b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:22.297355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3672406d-f06e-40c2-88e7-fb470b420c9d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] Calling method '.version_select at 0x7f6e5862dd30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.324348 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3672406d-f06e-40c2-88e7-fb470b420c9d tempest-ServersTestManualDisk-969335467 tempest-ServersTestManualDisk-969335467-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588791818" status: 202 len: 0 microversion: 2.1 time: 0.029776 Mar 26 21:08:22.326239 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2139/4545] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:08:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588791818 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:08:22.448212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:22.457172 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c64b8afa-7275-40b7-8304-895b46373323 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1493 microversion: 2.1 time: 0.396506 Mar 26 21:08:22.464603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2407/4546] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:22 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1493 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:22.942912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:22.943684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:22.952731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.958265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:22.959421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:22.960105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:23.241814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:23.242618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:23.252913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:23.253466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:23.256767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:23.257302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:23.338281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.346414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.348011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.349183 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5436bc8d-a29c-4eec-8a0c-9e88cfc6fa43 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1722 microversion: 2.20 time: 0.410895 Mar 26 21:08:23.349740 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2140/4547] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:22 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:23.377726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.389376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.391472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '722acaff4a96454285de3e32aab91466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbeae943588491d9f3a6c18c9671a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:23.408217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab34ae36-b3b8-4f32-ac9d-612ae9498b83 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 200 len: 1365 microversion: 2.47 time: 0.168259 Mar 26 21:08:23.421565 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2408/4548] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:23 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:23.484942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:23.486066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:23.501042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:23.501774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:23.505369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:23.506065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:23.977029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f3944816-c06f-491e-be68-b8a47f930d7a req-bae8254c-eaf2-486b-89bb-779f84d343c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-unplugged", "status": "completed", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:24.005869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f3944816-c06f-491e-be68-b8a47f930d7a req-bae8254c-eaf2-486b-89bb-779f84d343c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.009055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f3944816-c06f-491e-be68-b8a47f930d7a req-bae8254c-eaf2-486b-89bb-779f84d343c6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.041011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f3944816-c06f-491e-be68-b8a47f930d7a req-bae8254c-eaf2-486b-89bb-779f84d343c6 service nova] Creating event network-vif-unplugged:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:08:24.051822 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f3944816-c06f-491e-be68-b8a47f930d7a req-bae8254c-eaf2-486b-89bb-779f84d343c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077514 Mar 26 21:08:24.053278 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2409/4549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:08:24.368569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:24.370519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:24.378349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.379089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.380540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.381211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.396227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:24.417328 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1adf5e3b-bff9-4025-b3ae-5cb791acbe4e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1493 microversion: 2.1 time: 0.937403 Mar 26 21:08:24.419598 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2141/4550] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:23 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1493 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:24.428302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:24.429145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] [instance: 592d8a01-600a-4275-968b-802bf5fcad01] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:24.436220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.437166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.438126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.439499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.458383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] HTTP exception thrown: Instance 592d8a01-600a-4275-968b-802bf5fcad01 could not be found. Mar 26 21:08:24.459072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] Returning 404 to user: Instance 592d8a01-600a-4275-968b-802bf5fcad01 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:24.460006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c480e21-29f1-41f0-a279-593dfa929d09 tempest-ServersAaction247Test-324469187 tempest-ServersAaction247Test-324469187-project] 10.222.0.16 "GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01" status: 404 len: 111 microversion: 2.47 time: 0.036225 Mar 26 21:08:24.460647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2142/4551] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:24 2022] GET /compute/v2.1/servers/592d8a01-600a-4275-968b-802bf5fcad01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:08:24.817593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:24.833452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:24.837684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:24.841252 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a41656ce-3b72-4ef0-a486-2a19a45e07a5 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1665 microversion: 2.20 time: 0.476422 Mar 26 21:08:24.843241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2410/4552] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:24 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1665 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:08:24.860453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50c9d877-37d7-4744-84b6-2d9f0034a94d"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:24.861809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:24.871687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.874315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:24.875350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:24.875968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.241667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a9ffea19-a432-412f-bc03-b1924b22d7a6 req-b34d5947-4fa0-44a1-ad01-ce5a84c61e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15da470f-7f3d-4558-9cb1-7829e4952b5c", "name": "network-vif-deleted", "tag": "36c88967-8618-45d8-aaf7-44c5948e28e6"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:25.264201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a9ffea19-a432-412f-bc03-b1924b22d7a6 req-b34d5947-4fa0-44a1-ad01-ce5a84c61e92 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.264726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a9ffea19-a432-412f-bc03-b1924b22d7a6 req-b34d5947-4fa0-44a1-ad01-ce5a84c61e92 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.315008 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a9ffea19-a432-412f-bc03-b1924b22d7a6 req-b34d5947-4fa0-44a1-ad01-ce5a84c61e92 service nova] Creating event network-vif-deleted:36c88967-8618-45d8-aaf7-44c5948e28e6 for instance 15da470f-7f3d-4558-9cb1-7829e4952b5c on nch1-master-1 Mar 26 21:08:25.324312 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a9ffea19-a432-412f-bc03-b1924b22d7a6 req-b34d5947-4fa0-44a1-ad01-ce5a84c61e92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086834 Mar 26 21:08:25.325611 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2411/4553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:08:25.412336 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3d052011-dabe-4c4b-a200-40f027b0d10d tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.556910 Mar 26 21:08:25.413001 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2143/4554] 10.222.0.16 () {62 vars in 1363 bytes} [Sat Mar 26 21:08:24 2022] POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments => generated 188 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:08:25.442180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:25.443725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:25.449799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.450546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.451624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.452382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.504395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.505153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.505509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'fault' on Instance uuid 15da470f-7f3d-4558-9cb1-7829e4952b5c {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:08:25.607177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:25.607177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:25.608788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:25.617121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.617964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.619552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:25.620318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:25.625074 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-218fed3c-692d-4309-9a30-18ef66ec7a28 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 200 len: 1304 microversion: 2.1 time: 0.192432 Mar 26 21:08:25.626049 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2412/4555] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:25 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:25.978279 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e11bf0d-5b6d-49e6-b7d8-39310ddf37d6 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments/50c9d877-37d7-4744-84b6-2d9f0034a94d" status: 202 len: 0 microversion: 2.20 time: 0.381406 Mar 26 21:08:25.979999 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2144/4556] 10.222.0.16 () {60 vars in 1456 bytes} [Sat Mar 26 21:08:25 2022] DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments/50c9d877-37d7-4744-84b6-2d9f0034a94d => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:26.044905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:26.046716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:26.054643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.056629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.058833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.059311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.235818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5c48a7da-2789-4b06-87c4-c6520e3dc475 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/action" status: 202 len: 0 microversion: 2.20 time: 0.196222 Mar 26 21:08:26.245090 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2413/4557] 10.222.0.16 () {62 vars in 1318 bytes} [Sat Mar 26 21:08:26 2022] POST /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:26.252931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:26.253736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:26.274892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.275608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.276863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.277600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.552120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:26.563087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:26.566885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:26.568475 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3d93b0a-7b43-40fc-9baf-e8c86e4b92dd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1673 microversion: 2.20 time: 0.319438 Mar 26 21:08:26.569798 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2145/4558] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:26 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1673 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:26.656057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:26.657568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:26.666213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.666975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.667984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:26.668731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:26.712053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. Mar 26 21:08:26.712972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:26.714210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d049535d-1aab-4df9-a8ee-cbc50ffd78a7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 404 len: 111 microversion: 2.1 time: 0.073238 Mar 26 21:08:26.715415 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2414/4559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:26 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:26.917771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1046746935", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "058c0cff-2ce5-49c8-bc87-c1563c1f0f97"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:27.025307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] validate_networks() for [('058c0cff-2ce5-49c8-bc87-c1563c1f0f97', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:08:27.593631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:27.604023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:27.624935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:27.626661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:27.628704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:27.635141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:27.966563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:08:27.967546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:08:27.968240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:08:27.968877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:08:27.969482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:08:27.985233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:27.985695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:27.987317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:27.987778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:28.016989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:08:28.028665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Getting quotas for user f265820a8b974837949e9e3f36b58858 and project 614df0ac05da469a932c527c1d5c0a12. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:08:28.060415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:08:28.062779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:08:28.177016 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3690e9a-24d2-4470-8a22-564de69ceaec tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266807 Mar 26 21:08:28.183961 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2146/4560] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:08:28.195513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5258522-2d2c-4eed-b885-df4c199e73dd tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:28.198961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a5258522-2d2c-4eed-b885-df4c199e73dd tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:28.322356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:28.355135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:28.364511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:28.369195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-716437d6-7cbf-4a35-aaa9-ef1d05bf57cd tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1673 microversion: 2.20 time: 0.785962 Mar 26 21:08:28.369797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2415/4561] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:27 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1673 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:28.400984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a5258522-2d2c-4eed-b885-df4c199e73dd tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:28.411776 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a5258522-2d2c-4eed-b885-df4c199e73dd tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1215 microversion: 2.1 time: 0.224411 Mar 26 21:08:28.423367 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2147/4562] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:28 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:29.388455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:29.389703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:29.402317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:29.408571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:29.409779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:29.415114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:29.432506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:29.433735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:29.453113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:29.453595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:29.454425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:29.455100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:30.315253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:30.326338 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3a6b3281-a92d-4eea-b123-91167185ced1 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1267 microversion: 2.1 time: 0.898236 Mar 26 21:08:30.328879 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2148/4563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:29 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1267 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:30.384920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:30.393950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:30.395489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:30.396719 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0071ba0-0432-4569-bd22-85b0872ae606 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 1.012417 Mar 26 21:08:30.397288 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2416/4564] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:29 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:31.346171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:31.347372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:31.354344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:31.362406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:31.363503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:31.364085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:31.415318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:31.416070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:31.424265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:31.427433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:31.439957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:31.440928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:31.484046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:31.497702 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b77c44a-0b2d-4f20-9a27-246e0fc3a22d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1273 microversion: 2.1 time: 0.155685 Mar 26 21:08:31.510156 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2149/4565] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:31 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:32.197815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:32.214096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:32.220156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:32.222770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b771356e-2fcf-444a-9024-9f712ad44dbb tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.811504 Mar 26 21:08:32.224836 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2417/4566] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:31 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:08:32.517495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:32.518093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:32.526795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:32.536817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:32.537703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:32.538164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:32.679810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1827547175", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "2422d2c1-af27-48a4-b82c-f1470d972df6"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:32.819374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] validate_networks() for [('2422d2c1-af27-48a4-b82c-f1470d972df6', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:08:34.053293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:34.062479 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9fda735-8514-4d52-949d-7448fe46ae27 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 1.548853 Mar 26 21:08:34.075126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2418/4567] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:32 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:34.084812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:34.088804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:34.112866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:34.113663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:34.118359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:34.119621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:34.410325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:08:34.410894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:08:34.411234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:08:34.411791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:08:34.412267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:08:34.424016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:34.428686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:34.431072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:34.433971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:34.477756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Getting quotas for project cc51d0de03ed49c08738d431ef274427. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:08:34.487789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Getting quotas for user d5cbc0bf9ae44ad08d706bb23f7c979a and project cc51d0de03ed49c08738d431ef274427. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:08:34.504776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:08:34.508091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:08:34.622222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2659d7f9-7ee1-454e-b1f4-2270b215c367 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.412276 Mar 26 21:08:34.628346 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2150/4568] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:08:34.633448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-eb52a866-822a-433d-a386-08b7740a6bbf req-c6a07aff-6bb6-4029-8c9c-1bf9ad7a8acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d05436c-d4ad-4f1a-beb9-8970a738dd5f", "tag": "5c6394e9-e4a1-4d84-89ae-3dc1086e37b1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:34.656278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-eb52a866-822a-433d-a386-08b7740a6bbf req-c6a07aff-6bb6-4029-8c9c-1bf9ad7a8acf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:34.656830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-eb52a866-822a-433d-a386-08b7740a6bbf req-c6a07aff-6bb6-4029-8c9c-1bf9ad7a8acf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:34.680184 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-eb52a866-822a-433d-a386-08b7740a6bbf req-c6a07aff-6bb6-4029-8c9c-1bf9ad7a8acf service nova] Creating event network-changed:5c6394e9-e4a1-4d84-89ae-3dc1086e37b1 for instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f on nch2-master-1 Mar 26 21:08:34.693755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-eb52a866-822a-433d-a386-08b7740a6bbf req-c6a07aff-6bb6-4029-8c9c-1bf9ad7a8acf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063835 Mar 26 21:08:34.694893 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2151/4569] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:34.711945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d37e784e-43b3-4c64-ba5c-be82a917276f tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:34.712996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d37e784e-43b3-4c64-ba5c-be82a917276f tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:34.901093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d37e784e-43b3-4c64-ba5c-be82a917276f tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:34.912193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d37e784e-43b3-4c64-ba5c-be82a917276f tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1225 microversion: 2.1 time: 0.215652 Mar 26 21:08:34.913016 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2152/4570] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:34 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1225 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:35.081095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:35.081702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:35.089839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:35.090309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:35.091101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:35.091564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:35.247271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:35.257217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:35.274102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:35.274780 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a7c29fc-6a95-4706-bb2e-aa5afe86cd29 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 1.198587 Mar 26 21:08:35.275357 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2419/4571] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:34 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:35.889763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:35.904593 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84936e25-1143-4260-81aa-cb62d17a82fc tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 0.827084 Mar 26 21:08:35.905264 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2153/4572] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:35 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:35.932712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:35.933582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:35.948576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:35.949229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:35.950209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:35.950850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:36.277233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:36.290099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2bca820d-90b8-458a-93b6-6b2af0553baf tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1229 microversion: 2.1 time: 0.362664 Mar 26 21:08:36.296692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:36.297562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:36.299867 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2420/4573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:35 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1229 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:36.310086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:36.310671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:36.313178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:36.316528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:36.922455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:36.923543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:36.944221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:36.946748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:36.949935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:36.953984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:37.585260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:37.598115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:37.600042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:37.608855 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69dd17ba-f382-4dfb-bb2d-d66e00787d0e tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 1.316479 Mar 26 21:08:37.616321 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2154/4574] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:36 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:37.630816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:37.656159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:37.691713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:37.705453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:37.707156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:37.713347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:37.978793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:37.989240 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9dd5311a-0d73-4c8b-8e61-8bcda08679e9 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 1.070669 Mar 26 21:08:37.995616 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2421/4575] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:36 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:38.248354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:38.261200 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf529cb3-c4b5-4b57-ba06-440a83272d4c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1283 microversion: 2.1 time: 0.642874 Mar 26 21:08:38.262930 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2155/4576] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:37 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1283 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:38.634131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:38.635224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:38.673096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:38.680571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:38.681658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:38.683663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:39.012202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:39.012728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:39.029720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:39.030196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:39.031039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:39.031492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:39.361548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:39.378553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:39.391011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:39.392419 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abebde38-a9a8-4497-a9da-5673be2af1c4 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.762634 Mar 26 21:08:39.399126 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2422/4577] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:38 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:39.404190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:39.404819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:39.420824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:39.432825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:39.433911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:39.435190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:39.436004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:39.436128 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7487304-bc6f-462e-beb0-a10e14eacb86 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 0.426435 Mar 26 21:08:39.438997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2156/4578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:39 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:39.543173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:39.564095 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-97d15cab-aa4a-4d3d-bc3c-591f0ab4146c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1283 microversion: 2.1 time: 0.163655 Mar 26 21:08:39.568502 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2423/4579] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:39 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1283 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:40.157080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-51cab09f-35cf-4177-ae6e-2e092ede2b78 req-115022de-531f-41b0-ac9d-4686995cbcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d05436c-d4ad-4f1a-beb9-8970a738dd5f", "name": "network-vif-plugged", "status": "completed", "tag": "5c6394e9-e4a1-4d84-89ae-3dc1086e37b1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:40.178158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51cab09f-35cf-4177-ae6e-2e092ede2b78 req-115022de-531f-41b0-ac9d-4686995cbcfb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.178898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51cab09f-35cf-4177-ae6e-2e092ede2b78 req-115022de-531f-41b0-ac9d-4686995cbcfb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.217442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-51cab09f-35cf-4177-ae6e-2e092ede2b78 req-115022de-531f-41b0-ac9d-4686995cbcfb service nova] Creating event network-vif-plugged:5c6394e9-e4a1-4d84-89ae-3dc1086e37b1 for instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f on nch2-master-1 Mar 26 21:08:40.226160 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-51cab09f-35cf-4177-ae6e-2e092ede2b78 req-115022de-531f-41b0-ac9d-4686995cbcfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072562 Mar 26 21:08:40.228801 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2157/4580] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:40.418512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:40.420687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:40.442342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.447740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.448825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.456000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:40.456959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:40.460738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.475329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.480480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.484906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.489356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.847884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:40.855818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6081beb2-705c-42bb-8e53-02c0f163bb7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 0.404738 Mar 26 21:08:40.856971 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2158/4581] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:40 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:40.861739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:40.862545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:40.871432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.872167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:40.873274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:40.873862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:41.126878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:41.140631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-813a5e02-6032-4150-ad98-ab6d6e27084d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.281406 Mar 26 21:08:41.141568 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2159/4582] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:40 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:41.880961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:41.883857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:41.917146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:41.922473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:41.923488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:41.924330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:42.073543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:42.083669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:42.091264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:42.093575 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79a62862-cca3-454b-8341-07de7f06293b tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 1.679532 Mar 26 21:08:42.095716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2424/4583] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:40 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:42.159461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:42.160766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:42.167275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:42.176682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:42.177864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:42.178514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:42.576785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:42.581552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:42.585712 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3eceb6c7-804d-408e-8f6b-292c355941d2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.430853 Mar 26 21:08:42.588258 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2425/4584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:42 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:42.603496 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-19dd43a0-5464-48bf-99ca-296833b0d5d3 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1315 microversion: 2.1 time: 0.726632 Mar 26 21:08:42.607256 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2160/4585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:41 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:43.112692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:43.113321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:43.122331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.122801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.123612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.124097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.300280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bd229664-121e-4831-b350-5fc120d39ffc req-418f26b2-16cb-4096-b152-5f12bc179f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9575474-be72-4ff3-a764-39684c16ac98", "tag": "6da94dd1-eb5c-4021-b21f-a6152d93e370"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:43.324723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bd229664-121e-4831-b350-5fc120d39ffc req-418f26b2-16cb-4096-b152-5f12bc179f67 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.325531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bd229664-121e-4831-b350-5fc120d39ffc req-418f26b2-16cb-4096-b152-5f12bc179f67 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.348611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bd229664-121e-4831-b350-5fc120d39ffc req-418f26b2-16cb-4096-b152-5f12bc179f67 service nova] Creating event network-changed:6da94dd1-eb5c-4021-b21f-a6152d93e370 for instance c9575474-be72-4ff3-a764-39684c16ac98 on nch1-master-1 Mar 26 21:08:43.367441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bd229664-121e-4831-b350-5fc120d39ffc req-418f26b2-16cb-4096-b152-5f12bc179f67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072076 Mar 26 21:08:43.372425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2161/4586] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:43.603218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:43.603982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:43.622908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.623679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.626290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.629302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.859447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:43.873007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:43.875254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:43.889641 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d94564c9-c6ec-47ec-9873-528fe6309832 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.780843 Mar 26 21:08:43.892727 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2426/4587] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:43 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:43.902191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:43.909136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:43.923741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.925208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.926215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:43.930216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:43.943777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:43.955848 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d651471c-44a1-4255-8f46-40f99da1de2c tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.356693 Mar 26 21:08:43.956877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2162/4588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:43 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:44.287666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:44.299376 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e08bb64-26e5-4881-9ef0-d7f39bd54bcb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1502 microversion: 2.1 time: 0.404756 Mar 26 21:08:44.300260 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2427/4589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:43 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:44.318582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:44.319316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:44.327947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.328709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.329664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.330136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.335829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1192397077", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:44.359459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lazy-loading 'flavor' on Instance uuid 2d05436c-d4ad-4f1a-beb9-8970a738dd5f {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:08:44.409903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] validate_networks() for [('ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:08:44.496192 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-649ea4a4-60b7-45ae-9e59-bc7d59dd2ade tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "POST /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f/action" status: 202 len: 0 microversion: 2.1 time: 0.183817 Mar 26 21:08:44.497163 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2428/4590] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:08:44 2022] POST /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:08:44.512555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:44.520353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:44.540044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.540889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.542910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.546139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.846941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:44.853899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:08:44.854652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:08:44.855027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c5e8835b-f13e-4c06-a508-21c82265ace7 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1510 microversion: 2.1 time: 0.353689 Mar 26 21:08:44.855872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:08:44.856677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:08:44.857314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:08:44.858477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2429/4591] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:44 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:44.871595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.872435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.873468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.874120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.895156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Getting quotas for project 5b7d84d914bd48ddbd9e2801f8a9c616. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:08:44.901525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Getting quotas for user 102a4f93d75c4f219861f8e3e119fd82 and project 5b7d84d914bd48ddbd9e2801f8a9c616. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:08:44.913293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:44.913917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:44.916512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:08:44.919282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:08:44.922426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.925183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:44.925998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:44.926452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:45.006274 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5289f529-9643-4eb9-90fa-fd04e64e1e99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047934 Mar 26 21:08:45.012264 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2163/4592] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:08:45.021321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:45.022432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:45.035868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:45.036979 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:45.038010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:45.038727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:45.228179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:45.243076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:45.245612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:45.246857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-06de0363-6c86-4b16-bd52-e48e84b726dc tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.337776 Mar 26 21:08:45.247438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2430/4593] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:44 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:45.258894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:45.265721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17cc7eae-7b9f-4ef0-b9b5-925e2ba7ee80 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:45.266349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17cc7eae-7b9f-4ef0-b9b5-925e2ba7ee80 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:45.275390 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d550ef03-3745-4188-87a2-a19fc6e3bb74 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.261699 Mar 26 21:08:45.277432 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2164/4594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:45 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:45.328737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-17cc7eae-7b9f-4ef0-b9b5-925e2ba7ee80 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:45.337736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17cc7eae-7b9f-4ef0-b9b5-925e2ba7ee80 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1217 microversion: 2.1 time: 0.089188 Mar 26 21:08:45.339982 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2431/4595] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:45 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:45.874770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:45.875359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:45.882934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:45.883365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:45.884240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:45.884690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.085801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.094200 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9c4b30b-6eb7-4a7a-ba19-03a1b1df1a53 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1493 microversion: 2.1 time: 0.225282 Mar 26 21:08:46.096409 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2165/4596] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:45 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1493 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:46.114964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:46.115493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:46.139152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.140333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.141607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.142237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.212812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:46.267157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:46.267847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:46.280388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.281534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.283551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.284212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.379991 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ad8c0dc-319c-4e93-a58a-a24e594b49bf tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 204 len: 0 microversion: 2.1 time: 0.271047 Mar 26 21:08:46.380908 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2432/4597] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:46 2022] DELETE /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:46.386166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:46.386883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:46.398931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.399403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.400238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.400683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.668624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.682671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.683169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.687819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.689847 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9e4589f0-2ce5-4ea6-a3b6-959baba96b45 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.428485 Mar 26 21:08:46.691063 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bac14786-58c4-43bc-bb4d-d4b5195fca4d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.308956 Mar 26 21:08:46.695301 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2433/4598] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:46 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:46.702653 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2166/4599] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:46 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:46.704213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:46.704835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:46.712510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:46.713749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:46.718443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.719194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.720261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.721399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.725825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.726651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.727840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:46.729869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:46.901020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.913453 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1f2fa18d-b563-447c-85b3-7708d7ea029a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1275 microversion: 2.1 time: 0.216838 Mar 26 21:08:46.915815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2434/4600] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:46 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:46.981677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:46.996351 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bcb33522-70c5-40a3-9701-bafa9e92cb97 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1499 microversion: 2.1 time: 0.291959 Mar 26 21:08:46.998217 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2167/4601] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:46 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:47.712479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:47.713772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:47.714022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:47.714939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:47.722942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:47.723477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:47.723993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:47.725529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:47.725938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:47.726473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:47.728214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:47.729200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.042582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:48.051672 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ee285f5-4c8a-4f21-9ecd-2b66218155b6 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.343300 Mar 26 21:08:48.055066 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2168/4602] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:47 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:48.062130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:48.066901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:48.080993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:48.082980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.088301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:48.089078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.179600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:48.193318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:48.197392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:48.206500 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f683cf6b-2846-4387-a9a1-4a2e070bbe32 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.497116 Mar 26 21:08:48.207512 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2435/4603] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:47 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:48.217591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:48.218498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:48.238753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:48.239257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.240123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:48.240743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.708153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:48.715814 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-019c5159-98a7-4c89-93c2-d61889d99dd9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.659437 Mar 26 21:08:48.716440 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2169/4604] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:48 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:48.729281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-86b933e3-9d4e-4226-9946-c5ba51ccb1e4 req-18f50df4-f90f-4aac-8f95-8d650d01d899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-plugged", "status": "completed", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:48.747167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-86b933e3-9d4e-4226-9946-c5ba51ccb1e4 req-18f50df4-f90f-4aac-8f95-8d650d01d899 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:48.753828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-86b933e3-9d4e-4226-9946-c5ba51ccb1e4 req-18f50df4-f90f-4aac-8f95-8d650d01d899 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:48.774706 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-86b933e3-9d4e-4226-9946-c5ba51ccb1e4 req-18f50df4-f90f-4aac-8f95-8d650d01d899 service nova] Creating event network-vif-plugged:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:08:48.792352 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-86b933e3-9d4e-4226-9946-c5ba51ccb1e4 req-18f50df4-f90f-4aac-8f95-8d650d01d899 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066557 Mar 26 21:08:48.795287 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2170/4605] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:49.070905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:49.071625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:49.090098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.093686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.094945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.096108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.178791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f265820a8b974837949e9e3f36b58858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614df0ac05da469a932c527c1d5c0a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:49.186559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ce636150-c053-45b2-9dda-3a5aa53496bb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 200 len: 1499 microversion: 2.1 time: 0.977599 Mar 26 21:08:49.188880 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2436/4606] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:48 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 1499 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:49.200936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-41c396d9-2d7e-4a12-ab47-8c4d05a00a16 req-9290ffc3-b7d5-49e0-ba5b-ac87cf2b9deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d05436c-d4ad-4f1a-beb9-8970a738dd5f", "name": "network-vif-deleted", "tag": "5c6394e9-e4a1-4d84-89ae-3dc1086e37b1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:49.216901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-41c396d9-2d7e-4a12-ab47-8c4d05a00a16 req-9290ffc3-b7d5-49e0-ba5b-ac87cf2b9deb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.217343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-41c396d9-2d7e-4a12-ab47-8c4d05a00a16 req-9290ffc3-b7d5-49e0-ba5b-ac87cf2b9deb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.229647 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-41c396d9-2d7e-4a12-ab47-8c4d05a00a16 req-9290ffc3-b7d5-49e0-ba5b-ac87cf2b9deb service nova] Creating event network-vif-deleted:5c6394e9-e4a1-4d84-89ae-3dc1086e37b1 for instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f on nch2-master-1 Mar 26 21:08:49.235667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-41c396d9-2d7e-4a12-ab47-8c4d05a00a16 req-9290ffc3-b7d5-49e0-ba5b-ac87cf2b9deb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044786 Mar 26 21:08:49.237300 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2437/4607] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:49.243326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:49.244999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:49.254452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.255266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.256776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.257409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.366750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:49.375271 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1189c238-6647-49c2-82ab-11c61c649df2 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.308528 Mar 26 21:08:49.377027 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2171/4608] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:49 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:49.470625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b0e24ab3-04e1-48db-99d3-5b6de6a1cd58 req-d386a715-fc4f-4da5-853f-45f197a67d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:49.486915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b0e24ab3-04e1-48db-99d3-5b6de6a1cd58 req-d386a715-fc4f-4da5-853f-45f197a67d2d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.487728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b0e24ab3-04e1-48db-99d3-5b6de6a1cd58 req-d386a715-fc4f-4da5-853f-45f197a67d2d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.500882 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b0e24ab3-04e1-48db-99d3-5b6de6a1cd58 req-d386a715-fc4f-4da5-853f-45f197a67d2d service nova] Creating event network-changed:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:08:49.508415 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b0e24ab3-04e1-48db-99d3-5b6de6a1cd58 req-d386a715-fc4f-4da5-853f-45f197a67d2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050205 Mar 26 21:08:49.511432 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2172/4609] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:08:49.745233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:49.748336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:49.758677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:49.778451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:49.786331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.787288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.788148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:49.788595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:49.789275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:49.794260 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bb2975e8-253a-45a7-838d-8a478bdee255 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.552045 Mar 26 21:08:49.795856 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2438/4610] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:49 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:50.098529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:50.108788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bdce7e00-a68a-455b-8b6d-a6fbebb12790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.375539 Mar 26 21:08:50.109375 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2173/4611] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:50.210415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.211329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.232933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.233887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.238463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.239412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.265894 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. Mar 26 21:08:50.266659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.268195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33b2d6a6-f5bb-41b4-8d08-632c7de45ea4 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 404 len: 111 microversion: 2.1 time: 0.064777 Mar 26 21:08:50.269753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2439/4612] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.281413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.282068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.294757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.295539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.296896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.298131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.335697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. Mar 26 21:08:50.336677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.337595 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-78e01102-1031-40af-bcae-a1e72f3c6669 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 404 len: 111 microversion: 2.1 time: 0.062289 Mar 26 21:08:50.338691 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2174/4613] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:50 2022] DELETE /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.348265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.348891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2d05436c-d4ad-4f1a-beb9-8970a738dd5f] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.356667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.357168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.358199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.358833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.381805 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. Mar 26 21:08:50.382647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.383676 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b62637fc-566e-433d-ac8c-eafca0f20a1a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f" status: 404 len: 111 microversion: 2.1 time: 0.041285 Mar 26 21:08:50.388518 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2440/4614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/2d05436c-d4ad-4f1a-beb9-8970a738dd5f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.393839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.394520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.395027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.396330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.405386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.406110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.407193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.407892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.408034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.408562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.409507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.411158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.449374 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. Mar 26 21:08:50.451691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.454515 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-180f8688-541f-4713-8c00-c8563977081e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 404 len: 111 microversion: 2.1 time: 0.064311 Mar 26 21:08:50.458720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2175/4615] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:50 2022] DELETE /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.471812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.472845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 15da470f-7f3d-4558-9cb1-7829e4952b5c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.487157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.488390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.490145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.490961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.514219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. Mar 26 21:08:50.515730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 15da470f-7f3d-4558-9cb1-7829e4952b5c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.517351 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e439d74-ec5f-4ed5-83fc-5a32e3e85675 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c" status: 404 len: 111 microversion: 2.1 time: 0.054157 Mar 26 21:08:50.518968 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2176/4616] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/15da470f-7f3d-4558-9cb1-7829e4952b5c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.532930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.533752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.548786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.549517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.557445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.560348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.597071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. Mar 26 21:08:50.597688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.598629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8da4a7d-12d8-4fa5-9e73-79fd05a6de7a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 404 len: 111 microversion: 2.1 time: 0.075468 Mar 26 21:08:50.602440 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2177/4617] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:50 2022] DELETE /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.613960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.619098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.635866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.637952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.639638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.641171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.671280 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. Mar 26 21:08:50.680227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.681550 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31499757-c1ed-4b73-a0eb-b33a8e32f37d tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6" status: 404 len: 111 microversion: 2.1 time: 0.078272 Mar 26 21:08:50.684102 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2178/4618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/ba2924c6-4c28-488c-a5e6-fb6dbfc7f7f6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.701307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.702118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.712175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.717550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.720263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.721835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.751217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. Mar 26 21:08:50.754023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.755098 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb6748b4-f749-4524-9d58-52ce42ff31fb tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 404 len: 111 microversion: 2.1 time: 0.064273 Mar 26 21:08:50.755848 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2179/4619] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:50 2022] DELETE /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.765965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.767416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.774844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.776488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.777632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.778210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.795400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. Mar 26 21:08:50.796130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.798055 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60ef3c96-882b-4abb-ab4b-ccacbfcd58da tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3" status: 404 len: 111 microversion: 2.1 time: 0.036812 Mar 26 21:08:50.799966 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2180/4620] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/b56fef70-6b7c-498a-b2d4-4dc41d5a5cc3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.810041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.811798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.819197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.819660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.820456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.821526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.848339 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. Mar 26 21:08:50.849180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:50.850518 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b42e8e8-bd60-4f56-98ef-6571889d788a tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040" status: 404 len: 111 microversion: 2.1 time: 0.045521 Mar 26 21:08:50.852076 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2181/4621] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:50 2022] DELETE /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:08:50.860216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:50.860836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:50.883822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.895008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:50.896128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:50.896412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.154847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:51.168520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31b315a1-9ce1-41a6-b686-d87d9f3cf1f8 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.778011 Mar 26 21:08:51.169253 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2441/4622] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:51.179635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d62ab6be-ab5a-409e-9ea9-c5688c831955 req-d20e3872-1aef-4fc0-a64e-77679bb2dc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d05436c-d4ad-4f1a-beb9-8970a738dd5f", "name": "network-vif-unplugged", "status": "completed", "tag": "5c6394e9-e4a1-4d84-89ae-3dc1086e37b1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:51.203194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:51.204353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d62ab6be-ab5a-409e-9ea9-c5688c831955 req-d20e3872-1aef-4fc0-a64e-77679bb2dc11 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:51.204865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d62ab6be-ab5a-409e-9ea9-c5688c831955 req-d20e3872-1aef-4fc0-a64e-77679bb2dc11 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.216546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:51.220233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:51.222830 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d62ab6be-ab5a-409e-9ea9-c5688c831955 req-d20e3872-1aef-4fc0-a64e-77679bb2dc11 service nova] Creating event network-vif-unplugged:5c6394e9-e4a1-4d84-89ae-3dc1086e37b1 for instance 2d05436c-d4ad-4f1a-beb9-8970a738dd5f on nch2-master-1 Mar 26 21:08:51.223793 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-338646fd-fb1f-459e-9b5c-0f2504f529ae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1731 microversion: 2.20 time: 0.369392 Mar 26 21:08:51.225161 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2182/4623] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:50 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1731 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:08:51.230708 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d62ab6be-ab5a-409e-9ea9-c5688c831955 req-d20e3872-1aef-4fc0-a64e-77679bb2dc11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059401 Mar 26 21:08:51.231520 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2442/4624] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:51.239175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:51.240469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:51.241063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:51.241852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 2bacac7c-0083-43a8-938e-b6f900094040] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:51.248807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:51.250161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.251265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:51.252431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.258124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:51.259736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.260591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:51.262619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:51.291524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. Mar 26 21:08:51.300366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 2bacac7c-0083-43a8-938e-b6f900094040 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:51.302472 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-871cd428-d16a-44f9-b41d-05c23e717b14 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040" status: 404 len: 111 microversion: 2.1 time: 0.075933 Mar 26 21:08:51.317266 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2183/4625] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:51 2022] GET /compute/v2.1/servers/2bacac7c-0083-43a8-938e-b6f900094040 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:51.673244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:51.684443 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5471f8c0-1996-4f93-9813-fa9ae430dd57 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.451291 Mar 26 21:08:51.685042 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2443/4626] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:52.185873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.186736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.194590 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.195254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.196085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.196530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.241703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.242319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.249406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.249872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.250785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.251197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.365728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:52.375089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0963d1d3-1435-452e-afc3-4846e3ca18bc tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.193184 Mar 26 21:08:52.376275 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2184/4627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:52 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:52.431576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:52.442920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:52.444814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:52.446061 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9b8713d-ac9c-413b-ad64-863ab6189cc2 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1718 microversion: 2.20 time: 0.208457 Mar 26 21:08:52.447168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2444/4628] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:08:52 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1718 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:08:52.527269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.527549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.536892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.537357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.538139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.538579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.556822 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. Mar 26 21:08:52.557466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:52.558481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e5a0167-aac7-4ebf-be88-969cbf5d7559 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 404 len: 111 microversion: 2.1 time: 0.036617 Mar 26 21:08:52.562109 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2185/4629] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:52 2022] DELETE /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:52.569815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.570556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: e291b53c-8620-4e94-915b-ef3c614c12ac] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.577916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.579602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.581253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.581920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.603709 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. Mar 26 21:08:52.604440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance e291b53c-8620-4e94-915b-ef3c614c12ac could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:52.605368 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d80003c-4650-4d93-9072-a4ff950b340e tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac" status: 404 len: 111 microversion: 2.1 time: 0.041810 Mar 26 21:08:52.605922 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2445/4630] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:52 2022] GET /compute/v2.1/servers/e291b53c-8620-4e94-915b-ef3c614c12ac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:52.614728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.615363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.621566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.622126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.622928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.623368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.638719 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. Mar 26 21:08:52.639330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:52.640858 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3bbcddd-4ebd-47a5-be06-8e546db15a52 tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "DELETE /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 404 len: 111 microversion: 2.1 time: 0.029504 Mar 26 21:08:52.641259 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2186/4631] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:52 2022] DELETE /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:52.656790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.658007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] [instance: 02351463-2580-4d69-b96b-3d067d01c53b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.666757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.667215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.668099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.668545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.683187 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] HTTP exception thrown: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. Mar 26 21:08:52.684150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] Returning 404 to user: Instance 02351463-2580-4d69-b96b-3d067d01c53b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:52.685211 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01204a24-32e5-4aca-984f-122609faec7c tempest-DeleteServersTestJSON-1584739936 tempest-DeleteServersTestJSON-1584739936-project] 10.222.0.16 "GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b" status: 404 len: 111 microversion: 2.1 time: 0.039355 Mar 26 21:08:52.687968 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2446/4632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:52 2022] GET /compute/v2.1/servers/02351463-2580-4d69-b96b-3d067d01c53b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:52.710511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:52.711189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:52.718674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.719317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.720292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:52.720973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:52.961493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:52.969285 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b2224fb-d612-4b45-9b75-23a6b66f7e59 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.270494 Mar 26 21:08:52.970344 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2187/4633] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:52 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:53.248900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d67893ee-60c2-46ec-8159-7189e2bcd49e req-8642e98b-71e3-4c34-8673-6f51165d4849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9575474-be72-4ff3-a764-39684c16ac98", "name": "network-vif-plugged", "status": "completed", "tag": "6da94dd1-eb5c-4021-b21f-a6152d93e370"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:53.267099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d67893ee-60c2-46ec-8159-7189e2bcd49e req-8642e98b-71e3-4c34-8673-6f51165d4849 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:53.268402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d67893ee-60c2-46ec-8159-7189e2bcd49e req-8642e98b-71e3-4c34-8673-6f51165d4849 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:53.294019 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d67893ee-60c2-46ec-8159-7189e2bcd49e req-8642e98b-71e3-4c34-8673-6f51165d4849 service nova] Creating event network-vif-plugged:6da94dd1-eb5c-4021-b21f-a6152d93e370 for instance c9575474-be72-4ff3-a764-39684c16ac98 on nch1-master-1 Mar 26 21:08:53.305730 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d67893ee-60c2-46ec-8159-7189e2bcd49e req-8642e98b-71e3-4c34-8673-6f51165d4849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058909 Mar 26 21:08:53.308103 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2447/4634] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:53.391817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:53.392488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:53.403618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:53.404214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:53.414367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:53.414831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:53.632859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:53.641149 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4569bca0-b646-4bfd-abb8-eee9b509d721 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.252535 Mar 26 21:08:53.642051 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2188/4635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:53 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:53.989500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:53.991304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:53.999983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:54.000774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:54.002296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:54.003044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:54.243725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:54.254940 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7b99fabe-8509-4531-a660-cf68025e8453 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.271199 Mar 26 21:08:54.256494 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2448/4636] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:53 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:54.658842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:54.659550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:54.668726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:54.669521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:54.670625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:54.671174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:54.882116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:54.890542 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f012cd8b-925f-4ca1-bbf1-c7c5ff323448 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1325 microversion: 2.1 time: 0.235781 Mar 26 21:08:54.896053 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2189/4637] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:54 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:55.274311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:55.276046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:55.284893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:55.285531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:55.286450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:55.287115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:55.457307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:55.464973 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c4a784c1-689a-4de1-b702-387434d39f73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.195637 Mar 26 21:08:55.465552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2449/4638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:55 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:55.912373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:55.913125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:55.924193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:55.924774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:55.925696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:55.926259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.482657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:56.483518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:56.506875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.507200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.508226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.508933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.583852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:56.600871 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-374e875a-1759-4669-a224-cd23981735f1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1523 microversion: 2.1 time: 0.684246 Mar 26 21:08:56.601531 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2190/4639] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:55 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1523 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:56.622071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:56.622630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:56.632985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.635345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.636267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.636740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.670469 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] HTTP exception thrown: Instance is not a member of specified network Mar 26 21:08:56.671097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Returning 404 to user: Instance is not a member of specified network {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:56.671983 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31c3651a-8027-409e-9698-bfe8f32c8e3e tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.054696 Mar 26 21:08:56.672544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2191/4640] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 21:08:56 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98/ips/invalid => generated 91 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 21:08:56.687408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4384c83-35d9-49f3-8d54-c33fbb7eba49 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:56.688235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4384c83-35d9-49f3-8d54-c33fbb7eba49 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Failed to fetch instance by id 999 {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 21:08:56.689373 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c4384c83-35d9-49f3-8d54-c33fbb7eba49 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] HTTP exception thrown: Instance 999 could not be found. Mar 26 21:08:56.691769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4384c83-35d9-49f3-8d54-c33fbb7eba49 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Returning 404 to user: Instance 999 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:08:56.693315 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4384c83-35d9-49f3-8d54-c33fbb7eba49 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012005 Mar 26 21:08:56.701815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2192/4641] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 21:08:56 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:08:56.707727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:56.708570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:56.716406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.718375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.719445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.721200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.740504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:56.757430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:08:56.760691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8f09ffc-69bf-4da0-b8c4-187b3fe836f7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.281949 Mar 26 21:08:56.762664 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2450/4642] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:56 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:56.878841 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-916a6249-43e8-4c6e-b461-2d38536848b5 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 204 len: 0 microversion: 2.1 time: 0.174939 Mar 26 21:08:56.884719 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2193/4643] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:08:56 2022] DELETE /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:08:56.891437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:56.900097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:56.917358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7960f14d-3b35-4572-be61-9646ead15406 req-21a6e704-f274-4741-adb5-adb577c650b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "name": "network-vif-plugged", "status": "completed", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:56.917889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.922501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.925565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.926349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.938365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7960f14d-3b35-4572-be61-9646ead15406 req-21a6e704-f274-4741-adb5-adb577c650b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:56.941469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7960f14d-3b35-4572-be61-9646ead15406 req-21a6e704-f274-4741-adb5-adb577c650b6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:56.969211 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7960f14d-3b35-4572-be61-9646ead15406 req-21a6e704-f274-4741-adb5-adb577c650b6 service nova] Creating event network-vif-plugged:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:08:56.981731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7960f14d-3b35-4572-be61-9646ead15406 req-21a6e704-f274-4741-adb5-adb577c650b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073783 Mar 26 21:08:56.985057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2194/4644] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:08:57.386280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:57.397507 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8ef3498f-2914-4e18-98c8-994244d9131d tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1529 microversion: 2.1 time: 0.510715 Mar 26 21:08:57.407325 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2451/4645] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:56 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1529 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:57.780572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:57.781555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:57.795833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:57.796508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:57.799660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:57.801681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:58.054582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:58.062390 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-042c777b-3f1f-449a-bd55-393ab4ef5e22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1317 microversion: 2.1 time: 0.287364 Mar 26 21:08:58.063184 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2195/4646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:08:58.417271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:58.418653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:58.429603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:58.430457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:58.439779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:58.440583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:59.082366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:08:59.083080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:08:59.090059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:59.090614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:59.091494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:08:59.094674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:08:59.335224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:59.344841 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8a550c2f-97ae-4be9-873a-9fd1d26ef895 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.268895 Mar 26 21:08:59.347475 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2196/4647] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:59 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:08:59.622687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-145517029", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:08:59.779474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] validate_networks() for [('ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:08:59.785733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:08:59.797337 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9211ecaf-36f0-4ca9-b4e7-e44be777b6ec tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1529 microversion: 2.1 time: 1.385251 Mar 26 21:08:59.798176 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2452/4648] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:08:58 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1529 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:00.777195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:09:00.778501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:09:00.779314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:09:00.780212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:09:00.780833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:09:00.816782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:00.817400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:00.823612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:00.832774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:00.833921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:00.838157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:00.838319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:00.838750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:00.839554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:00.840024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:00.880510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Getting quotas for project 5b7d84d914bd48ddbd9e2801f8a9c616. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:00.886951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Getting quotas for user 102a4f93d75c4f219861f8e3e119fd82 and project 5b7d84d914bd48ddbd9e2801f8a9c616. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:00.902054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:09:00.904865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:09:00.979071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b320d7a-08b1-40ef-b0b9-b9c0922dfc9a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359915 Mar 26 21:09:00.980205 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2197/4649] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:09:01.010131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3820dbb5-9e1d-48c0-b3d8-0f6ae4a273b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:01.018394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3820dbb5-9e1d-48c0-b3d8-0f6ae4a273b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:01.114564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3820dbb5-9e1d-48c0-b3d8-0f6ae4a273b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:01.127030 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3820dbb5-9e1d-48c0-b3d8-0f6ae4a273b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1216 microversion: 2.1 time: 0.127564 Mar 26 21:09:01.131762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2198/4650] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:00 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:01.538373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-939aa907-50ac-43b4-b779-4e7d80e26718 req-7cb7bdb6-b250-43e2-a48a-b2bfcac2ea47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9575474-be72-4ff3-a764-39684c16ac98", "name": "network-vif-deleted", "tag": "6da94dd1-eb5c-4021-b21f-a6152d93e370"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:01.562010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-939aa907-50ac-43b4-b779-4e7d80e26718 req-7cb7bdb6-b250-43e2-a48a-b2bfcac2ea47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:01.563077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-939aa907-50ac-43b4-b779-4e7d80e26718 req-7cb7bdb6-b250-43e2-a48a-b2bfcac2ea47 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:01.643622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cbc0bf9ae44ad08d706bb23f7c979a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51d0de03ed49c08738d431ef274427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:01.648542 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-939aa907-50ac-43b4-b779-4e7d80e26718 req-7cb7bdb6-b250-43e2-a48a-b2bfcac2ea47 service nova] Creating event network-vif-deleted:6da94dd1-eb5c-4021-b21f-a6152d93e370 for instance c9575474-be72-4ff3-a764-39684c16ac98 on nch1-master-1 Mar 26 21:09:01.660568 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e982a78e-58cd-4990-9a3f-be16b4747984 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 200 len: 1529 microversion: 2.1 time: 0.841487 Mar 26 21:09:01.661485 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2453/4651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:00 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 1529 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:01.678397 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-939aa907-50ac-43b4-b779-4e7d80e26718 req-7cb7bdb6-b250-43e2-a48a-b2bfcac2ea47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142892 Mar 26 21:09:01.684242 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2199/4652] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:02.145324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:02.146115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:02.158662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:02.159140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:02.162060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:02.162522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:02.306426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:02.315267 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da0ba649-e6eb-421c-9c30-be34f69ca2d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1268 microversion: 2.1 time: 0.174444 Mar 26 21:09:02.328037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2454/4653] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:02 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:02.680686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:02.681926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] [instance: c9575474-be72-4ff3-a764-39684c16ac98] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:02.701614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:02.703347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:02.707744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:02.711466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:02.742334 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] HTTP exception thrown: Instance c9575474-be72-4ff3-a764-39684c16ac98 could not be found. Mar 26 21:09:02.744480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] Returning 404 to user: Instance c9575474-be72-4ff3-a764-39684c16ac98 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:02.745671 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-420f2729-ffc9-49da-ba47-cfc909a60fc1 tempest-ServerAddressesNegativeTestJSON-1161705102 tempest-ServerAddressesNegativeTestJSON-1161705102-project] 10.222.0.16 "GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98" status: 404 len: 111 microversion: 2.1 time: 0.071044 Mar 26 21:09:02.748951 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2200/4654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:02 2022] GET /compute/v2.1/servers/c9575474-be72-4ff3-a764-39684c16ac98 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:03.336651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:03.337334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:03.348576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:03.349408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:03.350455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:03.351366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:03.434158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:03.448210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9958de29-26ef-4849-9428-9df2ddd7c7d8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1274 microversion: 2.1 time: 0.115985 Mar 26 21:09:03.460159 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2455/4655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:03 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:04.465804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:04.466987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:04.483231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:04.484007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:04.487309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:04.488022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:04.687398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:04.705734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-053e3c20-4730-462b-9580-ae05fff388f9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1274 microversion: 2.1 time: 0.242155 Mar 26 21:09:04.706330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2201/4656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:04 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:05.725706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:05.726273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:05.741602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:05.743966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:05.745309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:05.746123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:06.079139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:06.092824 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8c789aed-4cfb-42bd-ac8f-c93789e96f40 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 0.370964 Mar 26 21:09:06.096533 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2456/4657] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:05 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:07.111894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:07.112539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:07.124189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:07.124644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:07.125794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:07.126421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:07.490802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:07.502199 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63b96168-9c2f-45d8-9fae-64b0ffa08be5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 0.395170 Mar 26 21:09:07.504082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2202/4658] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:07 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:08.198323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a7445898-d8e9-4f20-ac0f-4ff5f3a8986f req-b8cdf933-f006-4b26-aa5e-a8144ba8d0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883a6d07-9fc6-4614-a2fe-795b2f3fa451", "tag": "e082a83b-bda4-4ba5-911d-3d655808b500"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:08.216942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a7445898-d8e9-4f20-ac0f-4ff5f3a8986f req-b8cdf933-f006-4b26-aa5e-a8144ba8d0a5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:08.218813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a7445898-d8e9-4f20-ac0f-4ff5f3a8986f req-b8cdf933-f006-4b26-aa5e-a8144ba8d0a5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:08.251873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a7445898-d8e9-4f20-ac0f-4ff5f3a8986f req-b8cdf933-f006-4b26-aa5e-a8144ba8d0a5 service nova] Creating event network-changed:e082a83b-bda4-4ba5-911d-3d655808b500 for instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 on nch2-master-1 Mar 26 21:09:08.262857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a7445898-d8e9-4f20-ac0f-4ff5f3a8986f req-b8cdf933-f006-4b26-aa5e-a8144ba8d0a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069042 Mar 26 21:09:08.266810 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2457/4659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:08.525702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:08.528173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:08.546508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:08.553038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:08.557581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:08.559218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:08.908391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:08.918220 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f974e466-6562-4fe4-b48e-dc89fd9b1a8f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 0.401658 Mar 26 21:09:08.920362 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2203/4660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:08 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:09.661815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Action: 'create', calling method: .version_select at 0x7f6e596f6550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:09.709399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Getting quotas for project 0aee9d7189834141b6881cd81ddb821c. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:09.727989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Getting quotas for user b402a590241e48759a2d0db329b0359e and project 0aee9d7189834141b6881cd81ddb821c. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:09.830760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Getting quotas for project 0aee9d7189834141b6881cd81ddb821c. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:09.841610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Getting quotas for user b402a590241e48759a2d0db329b0359e and project 0aee9d7189834141b6881cd81ddb821c. Resources: {'server_groups'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:09.869389 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b95a9a04-0365-4fc5-a854-0fa20d620b67 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.997395 Mar 26 21:09:09.878869 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2458/4661] 10.222.0.16 () {62 vars in 1213 bytes} [Sat Mar 26 21:09:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:09:09.884481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9cef4d2-d230-41f6-9d1e-e60c15eed3f1 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:09.919703 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9cef4d2-d230-41f6-9d1e-e60c15eed3f1 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030020 Mar 26 21:09:09.926675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2204/4662] 10.222.0.16 () {60 vars in 1192 bytes} [Sat Mar 26 21:09:09 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:09:09.933156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f655e89-6e00-4cea-865e-6f67203fcc42 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:09.952033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:09.953313 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f655e89-6e00-4cea-865e-6f67203fcc42 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e" status: 200 len: 235 microversion: 2.64 time: 0.024843 Mar 26 21:09:09.957374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:09.964524 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2459/4663] 10.222.0.16 () {60 vars in 1303 bytes} [Sat Mar 26 21:09:09 2022] GET /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e => generated 235 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:09:09.980922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2d76f5d8-d42c-4566-93e1-867ab2425717 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:09.982134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:09.983988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:09.987232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:09.987900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:10.060826 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2d76f5d8-d42c-4566-93e1-867ab2425717 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e" status: 204 len: 0 microversion: 2.64 time: 0.094899 Mar 26 21:09:10.066418 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2460/4664] 10.222.0.16 () {60 vars in 1306 bytes} [Sat Mar 26 21:09:09 2022] DELETE /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:09:10.074231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fbeefda-264f-411e-82ff-3e21dfce6517 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:10.099111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5fbeefda-264f-411e-82ff-3e21dfce6517 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] HTTP exception thrown: Instance group 51b06d1b-016a-47a1-adee-828000c0638e could not be found. Mar 26 21:09:10.100615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5fbeefda-264f-411e-82ff-3e21dfce6517 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] Returning 404 to user: Instance group 51b06d1b-016a-47a1-adee-828000c0638e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:10.105587 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5fbeefda-264f-411e-82ff-3e21dfce6517 tempest-ServerGroup264TestJSON-1802267985 tempest-ServerGroup264TestJSON-1802267985-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e" status: 404 len: 117 microversion: 2.64 time: 0.037834 Mar 26 21:09:10.118913 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2461/4665] 10.222.0.16 () {60 vars in 1306 bytes} [Sat Mar 26 21:09:10 2022] DELETE /compute/v2.1/os-server-groups/51b06d1b-016a-47a1-adee-828000c0638e => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:11.230180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:11.237943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3e5d0f8-5a1e-4dd2-8648-92000f06ca51 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 1.304800 Mar 26 21:09:11.255417 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2205/4666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:09 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:12.257112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:12.257953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:12.277705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:12.278480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:12.279549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:12.281378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:13.700639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:13.711710 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01a2eefa-3c76-43dd-8c83-0783df7a40c5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 1.460917 Mar 26 21:09:13.714795 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2462/4667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:12 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:14.228723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4c935def-73c8-45b6-9ae6-9856e1824b3c req-a5fe0fcc-5e68-463b-9289-3e6a6f72e137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883a6d07-9fc6-4614-a2fe-795b2f3fa451", "name": "network-vif-plugged", "status": "completed", "tag": "e082a83b-bda4-4ba5-911d-3d655808b500"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:14.250626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4c935def-73c8-45b6-9ae6-9856e1824b3c req-a5fe0fcc-5e68-463b-9289-3e6a6f72e137 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:14.253325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4c935def-73c8-45b6-9ae6-9856e1824b3c req-a5fe0fcc-5e68-463b-9289-3e6a6f72e137 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:14.289286 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4c935def-73c8-45b6-9ae6-9856e1824b3c req-a5fe0fcc-5e68-463b-9289-3e6a6f72e137 service nova] Creating event network-vif-plugged:e082a83b-bda4-4ba5-911d-3d655808b500 for instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 on nch2-master-1 Mar 26 21:09:14.305852 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4c935def-73c8-45b6-9ae6-9856e1824b3c req-a5fe0fcc-5e68-463b-9289-3e6a6f72e137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084623 Mar 26 21:09:14.318389 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2206/4668] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:14.732513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:14.740398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:14.748558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:14.749227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:14.750169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:14.752669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:15.081704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:15.102141 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-42397284-e046-4f17-aed0-54f5f98c8fe0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1316 microversion: 2.1 time: 0.373508 Mar 26 21:09:15.113354 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2463/4669] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:14 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:16.119431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:16.120081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:16.130188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:16.130654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:16.131455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:16.131899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:16.796690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:16.805249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3072bae4-21dd-42bb-bbc1-2c5460a7d3b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1505 microversion: 2.1 time: 0.690222 Mar 26 21:09:16.809601 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2207/4670] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:16 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:16.827077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:16.828149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:16.847644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:16.849060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:16.850535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:16.851811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:16.904261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:09:17.061236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b41b295b-b6ca-4573-95aa-fd4024af3040 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 204 len: 0 microversion: 2.1 time: 0.237771 Mar 26 21:09:17.062941 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2464/4671] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:09:16 2022] DELETE /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:09:17.071642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:17.074388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:17.094028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:17.094627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:17.096642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:17.097417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:17.373540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:17.390866 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c3304fd-c88a-44e9-82f7-67ea52989d52 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1511 microversion: 2.1 time: 0.323192 Mar 26 21:09:17.393907 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2208/4672] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:17 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:18.418072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:18.420002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:18.439138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:18.439705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:18.443199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:18.443782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:19.163567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:19.173664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62dfa5ee-1c04-40eb-a3f5-34cfb1390dde tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1511 microversion: 2.1 time: 0.766294 Mar 26 21:09:19.188638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2465/4673] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:18 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1511 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:20.200368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:20.201008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:20.223394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:20.223975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:20.229000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:20.229544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:20.409113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7c6771fb-b7fe-45d7-aff4-1fe8d4f6baeb req-660d8b98-aa4c-4363-a841-29e12b1a18ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883a6d07-9fc6-4614-a2fe-795b2f3fa451", "name": "network-vif-deleted", "tag": "e082a83b-bda4-4ba5-911d-3d655808b500"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:20.468996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7c6771fb-b7fe-45d7-aff4-1fe8d4f6baeb req-660d8b98-aa4c-4363-a841-29e12b1a18ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:20.469584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7c6771fb-b7fe-45d7-aff4-1fe8d4f6baeb req-660d8b98-aa4c-4363-a841-29e12b1a18ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:20.521555 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7c6771fb-b7fe-45d7-aff4-1fe8d4f6baeb req-660d8b98-aa4c-4363-a841-29e12b1a18ea service nova] Creating event network-vif-deleted:e082a83b-bda4-4ba5-911d-3d655808b500 for instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 on nch2-master-1 Mar 26 21:09:20.533235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7c6771fb-b7fe-45d7-aff4-1fe8d4f6baeb req-660d8b98-aa4c-4363-a841-29e12b1a18ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128833 Mar 26 21:09:20.535181 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2466/4674] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:20.628831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:20.642517 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ae4bd2d-a8cc-4199-9053-72d174311d73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 200 len: 1469 microversion: 2.1 time: 0.446924 Mar 26 21:09:20.647547 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2209/4675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:20 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:21.664181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:21.664923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:21.684779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:21.687775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:21.691032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:21.692279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:21.746076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. Mar 26 21:09:21.770585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:21.775209 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17c50d36-2702-4723-9a71-e098b71121dc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 404 len: 111 microversion: 2.1 time: 0.113320 Mar 26 21:09:21.777265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2467/4676] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:21 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:21.790931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:21.792077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:21.814426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:21.814879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:21.819334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:21.819839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:22.153997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:22.163057 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae00125c-e0be-4167-8ddc-f1810975a424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.376666 Mar 26 21:09:22.164326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2210/4677] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:21 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:22.569253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24d2b973-af48-49df-b2f8-d4972b2425b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:22.570467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24d2b973-af48-49df-b2f8-d4972b2425b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:22.571294 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24d2b973-af48-49df-b2f8-d4972b2425b6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006382 Mar 26 21:09:22.571821 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2468/4678] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:09:22.580801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:22.581645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:22.588439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:22.589121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:22.590328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:22.594248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:22.853807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:22.869545 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61a4ffbf-16a5-428c-98ae-e37fafacdb25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.292835 Mar 26 21:09:22.870699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2211/4679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:22 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:22.897436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:22.898956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:22.922874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:22.945283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:22.946358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:22.946844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:23.495886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:23.504808 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-80904206-93fd-4093-8e8f-982c8292b753 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.617890 Mar 26 21:09:23.511859 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2469/4680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:22 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:24.449538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1904114544", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:24.564313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] validate_networks() for [('80821142-5907-4abd-9c14-6a6046396839', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:09:24.584021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-789404601", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "e5f51125-5858-46df-946d-60ea76425690"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:24.694169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] validate_networks() for [('e5f51125-5858-46df-946d-60ea76425690', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:09:25.371736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:09:25.372374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:09:25.372952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:09:25.373553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:09:25.374400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:09:25.401473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.403140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.404082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.404527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.451641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Getting quotas for project 97d8cf03facb404b81a31014cf74f93c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:25.467272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Getting quotas for user 4e069c88bde243a39d59ee5a170f5094 and project 97d8cf03facb404b81a31014cf74f93c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:25.502452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:09:25.509328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:09:25.635260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-82b4f17f-e850-4bb4-a583-d0662600ce45 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.485833 Mar 26 21:09:25.635970 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2212/4681] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:09:25.654382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:25.659139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:25.681423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:09:25.682048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:09:25.682648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:09:25.683166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:09:25.683897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.684329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:09:25.685435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.686392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.687151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.728883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.740443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5546862-0ffd-4eb5-b03e-a8e0cae7c904 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.098566 Mar 26 21:09:25.741728 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2213/4682] 10.222.0.16 () {60 vars in 1342 bytes} [Sat Mar 26 21:09:25 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:25.747262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc79764a-e8e4-484a-baaf-497ad1bac387 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:25.748250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc79764a-e8e4-484a-baaf-497ad1bac387 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:25.751802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.757772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:25.758410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:25.863193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Getting quotas for project 7b6be6f8159f4491b83d9658d643464c. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:25.885489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc79764a-e8e4-484a-baaf-497ad1bac387 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:25.897278 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc79764a-e8e4-484a-baaf-497ad1bac387 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1223 microversion: 2.1 time: 0.152230 Mar 26 21:09:25.900958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Getting quotas for user da090da7f121431abd13c9d9f0c71bb8 and project 7b6be6f8159f4491b83d9658d643464c. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:25.901979 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2214/4683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:25 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:25.929250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8724c097-7eef-415a-b25a-32210ada9bea tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-289815678", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "389ea347-fc4f-48d0-8559-7d60cce8e5b8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:25.976948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:09:25.990544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:09:26.122809 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3f6d5f74-8931-4ac9-8ec0-16541acb8f8f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.540238 Mar 26 21:09:26.133352 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-8724c097-7eef-415a-b25a-32210ada9bea tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Block Device 389ea347-fc4f-48d0-8559-7d60cce8e5b8 is not bootable. Mar 26 21:09:26.133876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8724c097-7eef-415a-b25a-32210ada9bea tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Block Device 389ea347-fc4f-48d0-8559-7d60cce8e5b8 is not bootable. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:26.135089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8724c097-7eef-415a-b25a-32210ada9bea tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.231913 Mar 26 21:09:26.135653 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2215/4684] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:25 2022] POST /compute/v2.1/servers => generated 110 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:26.142173 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2470/4685] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:09:26.143608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:26.144166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:26.167637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-92018629-019a-4de0-9619-1f704bbb63bf tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:26.176208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-92018629-019a-4de0-9619-1f704bbb63bf tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:26.206896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.209089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.211033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.222510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.298720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-92018629-019a-4de0-9619-1f704bbb63bf tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:26.310886 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-92018629-019a-4de0-9619-1f704bbb63bf tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1213 microversion: 2.1 time: 0.167240 Mar 26 21:09:26.315072 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2471/4686] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:26 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:26.330411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:09:26.331614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:26.332301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:26.350739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.351263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.354562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.356598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.519455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab48ef59-7797-4537-b173-064545a36075 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 204 len: 0 microversion: 2.20 time: 0.380915 Mar 26 21:09:26.523433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2216/4687] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:09:26 2022] DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:09:26.540682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:26.555149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:26.588851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.591780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.596235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.604182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.793844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:26.812281 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c4664765-e51d-4591-961d-600aced039e4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.493929 Mar 26 21:09:26.815316 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2472/4688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:26 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:26.845631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:26.848697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:26.882091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.882803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:26.884191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:26.886639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:27.269305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.281327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.286850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.288147 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e8e8c93-0ec3-475f-a6d6-29d070a09bae tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 0.754390 Mar 26 21:09:27.291343 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2217/4689] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:26 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:27.336823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:27.337747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:27.340739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.346888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:27.347814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:27.349171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:27.350013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:27.356531 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a5221d4-e928-49f2-b3ce-d2af559069ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.516022 Mar 26 21:09:27.358455 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2473/4690] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:26 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:27.400753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:27.406190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:27.483712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:27.484404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:27.487492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:27.488303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:27.504513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.517872 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2292695b-a76f-4d2b-9324-9f7457ca5d0f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1219 microversion: 2.1 time: 0.199779 Mar 26 21:09:27.519692 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2218/4691] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:27 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:27.641508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:27.653118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-719f34cb-22ef-43f3-b647-baf2aad97eee tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1217 microversion: 2.1 time: 0.281994 Mar 26 21:09:27.665005 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2474/4692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:27 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:28.309466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:28.310239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:28.324825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:28.329403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:28.330627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:28.331603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:28.535846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:28.536846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:28.545541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:28.545995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:28.546977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:28.567410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:28.987771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:28.999798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f55718a-9557-416a-b433-b90278382e0d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1293 microversion: 2.1 time: 0.469067 Mar 26 21:09:29.017059 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2475/4693] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:28 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1293 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:29.024319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:29.025475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:29.045100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:29.045617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:29.046475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:29.052781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:29.271572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:29.281754 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22d1d7dd-8a3c-4cfa-8867-6e4fec8fcbfc tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1271 microversion: 2.1 time: 0.262774 Mar 26 21:09:29.282857 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2476/4694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:29 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:29.444123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e08eb8b-66c8-4ed5-bbb7-4b996da0e76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1346674408", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "destination_type": "local"}, {"source_type": "volume", "uuid": "51b2c383-2ecd-4c2f-86be-29563fe98cfe", "destination_type": "invalid"}], "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:29.446097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e08eb8b-66c8-4ed5-bbb7-4b996da0e76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:29.447087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e08eb8b-66c8-4ed5-bbb7-4b996da0e76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.007654 Mar 26 21:09:29.447492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2477/4695] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:29 2022] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:09:29.487083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:29.490411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:29.519586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:29.520395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:29.524414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:29.525441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:29.993013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:30.016161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:30.031299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:30.039747 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c66873d9-486b-466e-83a3-b587b54fd007 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1724 microversion: 2.20 time: 1.734223 Mar 26 21:09:30.042378 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2219/4696] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:28 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1724 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:30.057406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:30.058431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:30.075969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.076546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.078045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.082672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.577377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:30.589815 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-263652da-1c5f-4bb3-b457-dc7f940b45b8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 1.136620 Mar 26 21:09:30.591564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2478/4697] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:29 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:30.624138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:30.625178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:30.636981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.637443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.638248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.643808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.785602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:30.805231 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-917d6bde-708c-453f-a82e-7e917cef2594 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1271 microversion: 2.1 time: 0.183980 Mar 26 21:09:30.819037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2479/4698] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:30 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:30.825869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-983c3569-82c3-4b0b-9c68-4b70862054fe req-6668958a-cc40-4a55-a34d-92f66f947532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-unplugged", "status": "completed", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:30.852754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-983c3569-82c3-4b0b-9c68-4b70862054fe req-6668958a-cc40-4a55-a34d-92f66f947532 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.853501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-983c3569-82c3-4b0b-9c68-4b70862054fe req-6668958a-cc40-4a55-a34d-92f66f947532 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.883148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-983c3569-82c3-4b0b-9c68-4b70862054fe req-6668958a-cc40-4a55-a34d-92f66f947532 service nova] Creating event network-vif-unplugged:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:09:30.904575 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-983c3569-82c3-4b0b-9c68-4b70862054fe req-6668958a-cc40-4a55-a34d-92f66f947532 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083092 Mar 26 21:09:30.908196 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2480/4699] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:30.924357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:30.924810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:30.934453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.940219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:30.941424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:30.941983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.178626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:31.192164 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38bd1080-7370-45b5-a9c9-a995864d7ec2 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 1.148166 Mar 26 21:09:31.193020 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2220/4700] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:30 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:31.204764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:31.205643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:31.222270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.231053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.233140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.234196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.420928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:31.449775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:31.452091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:31.453621 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a74e5250-90c0-417e-b043-260a34bbc916 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1656 microversion: 2.20 time: 0.259144 Mar 26 21:09:31.454481 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2221/4701] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:31 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1656 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:31.501785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:31.523305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d2022b7-c69a-4ecc-9411-f1ae4e8b91f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.613109 Mar 26 21:09:31.524668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2481/4702] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:30 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:31.695128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f8c3d1a-c66b-4a25-8559-1ac6036a0516 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1556352954", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:31.697564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f8c3d1a-c66b-4a25-8559-1ac6036a0516 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:31.700383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f8c3d1a-c66b-4a25-8559-1ac6036a0516 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009453 Mar 26 21:09:31.701204 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2222/4703] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:31.709829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:31.711217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:31.721522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.722466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.723457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.724160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.824567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:31.825195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:31.836902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.837363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:31.843050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:31.844846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.108325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.116702 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f5a40fb3-2fcd-4385-b085-cef3cbd32f1f tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1271 microversion: 2.1 time: 0.296197 Mar 26 21:09:32.118535 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2223/4704] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:31 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:32.211428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:32.212100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:32.220737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.221221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.222018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.222472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.242804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.258451 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da04c93c-a11c-4d72-b7f0-64df285f502c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.551719 Mar 26 21:09:32.260068 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2482/4705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:31 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:32.294168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a2f43311-6b60-4e46-b2e5-1119adc24c42 req-f2904d7e-059b-4f86-8ad4-108f4d2ed05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:32.303169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a2f43311-6b60-4e46-b2e5-1119adc24c42 req-f2904d7e-059b-4f86-8ad4-108f4d2ed05e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.303626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a2f43311-6b60-4e46-b2e5-1119adc24c42 req-f2904d7e-059b-4f86-8ad4-108f4d2ed05e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.316165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a2f43311-6b60-4e46-b2e5-1119adc24c42 req-f2904d7e-059b-4f86-8ad4-108f4d2ed05e service nova] Creating event network-changed:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:09:32.323740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a2f43311-6b60-4e46-b2e5-1119adc24c42 req-f2904d7e-059b-4f86-8ad4-108f4d2ed05e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041786 Mar 26 21:09:32.324609 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2483/4706] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:32.330458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:32.331354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:32.337840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.338700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.339870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.341321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.639223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.656107 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2d8d678-074b-4dd4-89d2-c6450694097e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.330028 Mar 26 21:09:32.657222 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2484/4707] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:32 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:32.663714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:32.664373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:32.671339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.672680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.689304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.691083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.815152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.829530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.833294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '321431f1b82447d28c58e7d03fd20515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a748aa42d5c4f55bd7d2d86838ff112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:32.837132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79bffeac-7045-4933-bdaf-7070def35965 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 200 len: 1656 microversion: 2.20 time: 0.178675 Mar 26 21:09:32.840603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2485/4708] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:32 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 1656 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:32.856990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0939ef0-b2a1-41f6-8e0f-ce9ed4faf29f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:32.859071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0939ef0-b2a1-41f6-8e0f-ce9ed4faf29f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:32.860465 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a0939ef0-b2a1-41f6-8e0f-ce9ed4faf29f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.007922 Mar 26 21:09:32.864375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2486/4709] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:32.869039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:32.869664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:32.877302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.877787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:32.878566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:32.879338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:33.265689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:33.274887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c34c006a-bbc5-4823-933c-4743f3f6b299 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.409444 Mar 26 21:09:33.279372 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2487/4710] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:32 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:33.291910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:33.292877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:33.306507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:33.307230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:33.308203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:33.310628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:33.361747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:33.393376 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b92cfb00-cfd9-4ce7-a70d-ef384a9b2801 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 1.182648 Mar 26 21:09:33.393989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2224/4711] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:32 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:33.415890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:33.420398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:33.461310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:33.463376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:33.464428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:33.466751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.017870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:34.030236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78fc8f10-f264-4e9b-a415-4ba07f34a0ea tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.747266 Mar 26 21:09:34.032277 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2488/4712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:33 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:34.045529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e85897b5-0eea-4fc4-8e89-eae5815fb015 req-55929bfb-3a2b-4716-8f79-5bf3660ede05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3", "name": "network-vif-deleted", "tag": "634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:34.064152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e85897b5-0eea-4fc4-8e89-eae5815fb015 req-55929bfb-3a2b-4716-8f79-5bf3660ede05 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.068767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e85897b5-0eea-4fc4-8e89-eae5815fb015 req-55929bfb-3a2b-4716-8f79-5bf3660ede05 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.091668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:34.101600 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0b0796a-85ac-4cd6-b154-4e34cc78b43d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.704916 Mar 26 21:09:34.113387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e85897b5-0eea-4fc4-8e89-eae5815fb015 req-55929bfb-3a2b-4716-8f79-5bf3660ede05 service nova] Creating event network-vif-deleted:634e2d65-ffcb-4a1c-a34b-9e6e5e035ff3 for instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 on nch2-master-1 Mar 26 21:09:34.117670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2225/4713] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:33 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:34.128636 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e85897b5-0eea-4fc4-8e89-eae5815fb015 req-55929bfb-3a2b-4716-8f79-5bf3660ede05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093377 Mar 26 21:09:34.129457 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2489/4714] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:34.133309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:34.133946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:34.162721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.165526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.169054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.169734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.210667 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. Mar 26 21:09:34.214035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:34.216715 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b5e9642c-0d72-45af-a3ff-745d24b1c889 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 404 len: 111 microversion: 2.20 time: 0.096408 Mar 26 21:09:34.220535 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2226/4715] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:34 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:34.229731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-005dd680-5bd9-4267-87a9-cf3936cd2632 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '.version_select at 0x7f6e5952daf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:34.263648 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-005dd680-5bd9-4267-87a9-cf3936cd2632 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683392406" status: 204 len: 0 microversion: 2.20 time: 0.038522 Mar 26 21:09:34.264285 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2490/4716] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Mar 26 21:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683392406 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:09:34.312444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e92c9968-6005-4b35-bc0c-5f22ddc8f80c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1567315249", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": -1, "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:34.345477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e92c9968-6005-4b35-bc0c-5f22ddc8f80c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Flavor -1 could not be found. Mar 26 21:09:34.349638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e92c9968-6005-4b35-bc0c-5f22ddc8f80c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:34.353994 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e92c9968-6005-4b35-bc0c-5f22ddc8f80c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.046314 Mar 26 21:09:34.355684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2227/4717] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:34.365081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:34.366229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:34.381349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.381965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.382775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.383226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.413953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:34.416023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:34.438688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.440682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.441566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.444317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.841538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:34.858799 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3976589c-8b94-4372-ae08-0ddac1ec3d0a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.498315 Mar 26 21:09:34.871713 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2491/4718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:34 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:34.877978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:34.878913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:34.886309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.887346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:34.888458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:34.889346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:35.336511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:35.346450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0b231409-4eed-4e40-a982-15588113f035 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.938675 Mar 26 21:09:35.350986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2228/4719] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:34 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:35.370862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:35.371500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:35.389607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:35.394153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:35.398090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:35.400998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:35.401471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:35.407837 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f795ad86-b6b0-47ff-8994-fe3dc00e8424 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.534677 Mar 26 21:09:35.412462 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2492/4720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:34 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:35.642759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc4ea11b-26f2-4a66-beb0-6f0c654279e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1933646604", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:35.644474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc4ea11b-26f2-4a66-beb0-6f0c654279e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:35.645970 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc4ea11b-26f2-4a66-beb0-6f0c654279e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008853 Mar 26 21:09:35.647478 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2493/4721] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:35 2022] POST /compute/v2.1/servers => generated 145 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:35.684701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:35.686469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:35.719681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:35.720991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:35.723238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:35.724536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.070454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:36.098038 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0bdbd366-a07f-4df2-bc41-4f34c66ebe33 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.425256 Mar 26 21:09:36.111005 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2494/4722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:35 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:36.122729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:36.123403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:36.136166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.140264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.141359 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.141990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.494470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:36.505167 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-289689cc-8092-4087-9a6e-a8e6e5fa2953 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 1.147858 Mar 26 21:09:36.513782 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2229/4723] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:35 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:36.520713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0548cfe8-75f0-44d8-bca1-dc20099e8365 req-fbec4f70-58c2-4fcb-bb67-bbedf20fcd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab73749-55ca-4384-afe9-24e0335cf4bb", "tag": "84a12c26-186e-4dc5-b76e-261f807260e1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:36.530764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:36.542494 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-829136a8-b969-42ed-ae01-bfb098ecb0b4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.428883 Mar 26 21:09:36.546595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0548cfe8-75f0-44d8-bca1-dc20099e8365 req-fbec4f70-58c2-4fcb-bb67-bbedf20fcd00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.548188 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2495/4724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:36 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:36.553609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0548cfe8-75f0-44d8-bca1-dc20099e8365 req-fbec4f70-58c2-4fcb-bb67-bbedf20fcd00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.555350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:36.557785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:36.597140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.597519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.603286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.604650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0548cfe8-75f0-44d8-bca1-dc20099e8365 req-fbec4f70-58c2-4fcb-bb67-bbedf20fcd00 service nova] Creating event network-changed:84a12c26-186e-4dc5-b76e-261f807260e1 for instance 4ab73749-55ca-4384-afe9-24e0335cf4bb on nch1-master-1 Mar 26 21:09:36.606984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.612460 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0548cfe8-75f0-44d8-bca1-dc20099e8365 req-fbec4f70-58c2-4fcb-bb67-bbedf20fcd00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096863 Mar 26 21:09:36.614309 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2230/4725] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:36.784729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab4ab117-7f9a-4bd8-930b-5dae3cb09820 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1145891928", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:36.793694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ab4ab117-7f9a-4bd8-930b-5dae3cb09820 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Mar 26 21:09:36.798005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab4ab117-7f9a-4bd8-930b-5dae3cb09820 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:36.801513 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab4ab117-7f9a-4bd8-930b-5dae3cb09820 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.031266 Mar 26 21:09:36.822028 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2231/4726] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:36.843384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:36.845978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:36.857637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.870464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.876578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:36.877455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:36.913747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:36.935380 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f44e5168-c73b-4c68-ac5c-f1109f3e16f7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.383700 Mar 26 21:09:36.939800 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2496/4727] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:36 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:37.485955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:37.514383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-663664ad-172c-4b9a-a131-2c5492189bff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.689482 Mar 26 21:09:37.532620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:37.533088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2232/4728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:36 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:37.533308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:37.542587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.543075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:37.543839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.552624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:37.578059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:37.578967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:37.589696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.590344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:37.591900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.592522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:37.886378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:37.905733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a3e44610-bf98-47ee-ba1b-75345417306b tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.377056 Mar 26 21:09:37.908220 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2497/4729] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:37 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:37.956223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:37.956845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:37.965999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.968967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:37.970101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:37.970707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.277069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:38.285629 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcd4c190-0c83-4557-96bc-f1016bd15286 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.333221 Mar 26 21:09:38.290157 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2498/4730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:37 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:38.305086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:38.305769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:38.352271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.354343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.355953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.357087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.388778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. Mar 26 21:09:38.392433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:38.394040 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ecff6d9-75ec-4571-b43f-c97a9f735dc7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 404 len: 111 microversion: 2.20 time: 0.103933 Mar 26 21:09:38.395255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2499/4731] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:09:38 2022] DELETE /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:38.403472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:38.405260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:38.414374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.415138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.416142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.416923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.439322 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. Mar 26 21:09:38.440058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:38.441017 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6a98eaf-dc43-44fb-a9cf-c8b300f698c7 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3" status: 404 len: 111 microversion: 2.20 time: 0.042177 Mar 26 21:09:38.441661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2500/4732] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:38 2022] GET /compute/v2.1/servers/ae16c8f1-e7f1-4ebf-a287-a92d0a5050f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:09:38.472827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:38.488637 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b901ce16-9e4b-456e-aa2c-612fbd33ebff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.953424 Mar 26 21:09:38.492589 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2233/4733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:37 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:38.768707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e024f897-bb26-464f-8756-2cadb74c40d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-343698670", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "key_name": "tempest-key-457448055", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:38.873265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-e024f897-bb26-464f-8756-2cadb74c40d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] validate_networks() for [('ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:09:38.926656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:38.927314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:38.944108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.945793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:38.950898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:38.951820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.334479 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e024f897-bb26-464f-8756-2cadb74c40d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Invalid key_name provided. Mar 26 21:09:39.336468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e024f897-bb26-464f-8756-2cadb74c40d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid key_name provided. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:39.340031 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e024f897-bb26-464f-8756-2cadb74c40d9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.574556 Mar 26 21:09:39.340875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2501/4734] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 577 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:39.358756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:39.361021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:39.378890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.381616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.384601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.385635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.423767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:39.433349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5d34005-96dc-40e9-bc58-1cc8c4a22da8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.511222 Mar 26 21:09:39.443394 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2234/4735] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:38 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:39.449064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:39.450324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:39.459374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.460300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.461454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.462240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.729480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:39.740694 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5984ae00-677b-4a05-bea7-753b46c1026d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.293190 Mar 26 21:09:39.741398 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2235/4736] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:39 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:39.756805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:39.757330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:39.766215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.766683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.767479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.780059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.808363 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. Mar 26 21:09:39.809357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:39.811068 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d724d350-789c-4e34-bb70-a3455efc6291 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 404 len: 111 microversion: 2.20 time: 0.068721 Mar 26 21:09:39.812195 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2236/4737] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:09:39 2022] DELETE /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:39.817767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:39.819204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:39.827074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.828016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.830103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.831677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.882862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:39.892862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-193e0dae-d1b8-4e51-8f98-c17d8a3dff15 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.546253 Mar 26 21:09:39.894888 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2502/4738] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:39 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:39.904457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:39.905314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] [instance: 39b61f71-6468-4d03-87ff-51120f2911c4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:39.917771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.923255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.924671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:39.925643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:39.942439 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] HTTP exception thrown: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. Mar 26 21:09:39.944076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] Returning 404 to user: Instance 39b61f71-6468-4d03-87ff-51120f2911c4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:39.945287 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e68be658-590f-4bf8-bf86-b172a9a51315 tempest-AttachVolumeShelveTestJSON-1677154310 tempest-AttachVolumeShelveTestJSON-1677154310-project] 10.222.0.16 "GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4" status: 404 len: 111 microversion: 2.20 time: 0.048999 Mar 26 21:09:39.946330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2503/4739] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:39 2022] GET /compute/v2.1/servers/39b61f71-6468-4d03-87ff-51120f2911c4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:40.194390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:40.216650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69b8b3a0-92d6-4c41-918e-3c89f4a9b3da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.402769 Mar 26 21:09:40.239232 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2237/4740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:39 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:40.450041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:40.450895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:40.465171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.465809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:40.470045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.473266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:40.584999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef5f12e5-649b-4090-86f4-79a9574294e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2073056648", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:40.854450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:40.865189 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-171a58ae-1ac7-48db-b793-686501810c58 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.418794 Mar 26 21:09:40.867143 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2504/4741] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:40 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:40.913800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:40.916079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:40.926112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.926956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:40.928023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.928845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:40.930959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.security_group_api [None req-ef5f12e5-649b-4090-86f4-79a9574294e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Neutron security group does_not_exist not found {{(pid=141580) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Mar 26 21:09:40.931555 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ef5f12e5-649b-4090-86f4-79a9574294e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Mar 26 21:09:40.932198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef5f12e5-649b-4090-86f4-79a9574294e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:40.933101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef5f12e5-649b-4090-86f4-79a9574294e3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.352887 Mar 26 21:09:40.933946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2238/4742] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:40 2022] POST /compute/v2.1/servers => generated 106 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:40.942699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:40.943545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:40.957732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.958667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:40.959019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:40.959471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:41.229917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:41.244167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ff275d7-fcc2-4213-b557-884aa71e9363 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.336961 Mar 26 21:09:41.252594 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2505/4743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:40 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:41.471368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7b744684-66ed-4c52-8156-557c1d351c9f req-61073e80-049c-4e5a-a91a-6ac7f8333e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "name": "network-vif-plugged", "status": "completed", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:41.485815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b744684-66ed-4c52-8156-557c1d351c9f req-61073e80-049c-4e5a-a91a-6ac7f8333e1f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:41.489221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b744684-66ed-4c52-8156-557c1d351c9f req-61073e80-049c-4e5a-a91a-6ac7f8333e1f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:41.522137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:41.534431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7b744684-66ed-4c52-8156-557c1d351c9f req-61073e80-049c-4e5a-a91a-6ac7f8333e1f service nova] Creating event network-vif-plugged:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:09:41.539000 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f862cec9-4a3b-4ca5-aa6d-16537fcc69c7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.600816 Mar 26 21:09:41.539614 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2239/4744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:40 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:41.552163 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7b744684-66ed-4c52-8156-557c1d351c9f req-61073e80-049c-4e5a-a91a-6ac7f8333e1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082235 Mar 26 21:09:41.552446 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2506/4745] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:09:41.561552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:41.562454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:41.569980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:41.570680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:41.571764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:41.572441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:41.580314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Action: 'create', calling method: .version_select at 0x7f6e582b15e0>, body: {"keypair": {"name": "tempest-keypair-1539819829"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:41.642801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:41.655388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for user dd05073d7e52411c92d7b9def363dd50 and project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:42.033153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:42.042216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for user dd05073d7e52411c92d7b9def363dd50 and project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:42.060224 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00798c51-1ae7-4ce0-99b1-0515a39ae027 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.506228 Mar 26 21:09:42.061405 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2507/4746] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Mar 26 21:09:41 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 508 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:09:42.067880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:42.068801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:42.076033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.076722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.078015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.080680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.303866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:42.317201 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-16e7a116-7421-498d-be90-e11c74d68cf0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.760003 Mar 26 21:09:42.318628 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2240/4747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:41 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:42.326410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:42.329951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:42.338290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.339150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.340486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.341600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.388407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:42.402523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a041837a-e01e-47bc-be3a-3c70741f898e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.338806 Mar 26 21:09:42.404599 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2508/4748] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:42 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:42.413299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbd738fd-3769-4538-b5f5-1c9d14d4f256 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:42.414358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bbd738fd-3769-4538-b5f5-1c9d14d4f256 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 8b910536-c017-4358-83ea-8389c5c7e6e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:42.423245 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-bbd738fd-3769-4538-b5f5-1c9d14d4f256 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 8b910536-c017-4358-83ea-8389c5c7e6e8 could not be found. Mar 26 21:09:42.424607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbd738fd-3769-4538-b5f5-1c9d14d4f256 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 8b910536-c017-4358-83ea-8389c5c7e6e8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:42.425875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bbd738fd-3769-4538-b5f5-1c9d14d4f256 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b910536-c017-4358-83ea-8389c5c7e6e8" status: 404 len: 111 microversion: 2.1 time: 0.019580 Mar 26 21:09:42.427058 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2509/4749] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:09:42 2022] DELETE /compute/v2.1/servers/8b910536-c017-4358-83ea-8389c5c7e6e8 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:42.437124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:42.438592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:42.450542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.451885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.453238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.454575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.706215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:42.722617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:42.723683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c87d1a1a-1602-48ae-b02e-9e01cce593a0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1323 microversion: 2.1 time: 0.402663 Mar 26 21:09:42.724319 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2241/4750] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:42 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:42.731660 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27769ee7-1206-43d9-9f13-0e3dd5d7e264 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.300417 Mar 26 21:09:42.733086 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2510/4751] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:42 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:42.754263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:42.755279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:42.762945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.763669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:42.766047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:42.766942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.102288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:43.110138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-42e4db1c-eed7-44a4-8ac5-460b8946eb73 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.359757 Mar 26 21:09:43.110672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2242/4752] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:42 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:43.137256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f27126a2-c764-43b7-aa6f-024881074bbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:43.145717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f27126a2-c764-43b7-aa6f-024881074bbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Failed to fetch instance by id 9223372036854775808 {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 21:09:43.147901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f27126a2-c764-43b7-aa6f-024881074bbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Mar 26 21:09:43.149173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f27126a2-c764-43b7-aa6f-024881074bbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:43.155462 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f27126a2-c764-43b7-aa6f-024881074bbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.028227 Mar 26 21:09:43.167548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:43.170628 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2511/4753] 10.222.0.16 () {58 vars in 1187 bytes} [Sat Mar 26 21:09:43 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:09:43.171010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:43.187236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.190523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.193434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.196018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.423280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:43.424149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:43.445569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.447294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.448441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.449033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.632875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:43.643432 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-337ff67e-0925-4e8e-acd5-0cf06a422ca2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.482708 Mar 26 21:09:43.648646 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2243/4754] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:43 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:43.655147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-11e97495-6e62-46ee-9573-d55fb4248884 req-bd2223e3-9884-4816-8816-df2eb6dd8c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab73749-55ca-4384-afe9-24e0335cf4bb", "name": "network-vif-plugged", "status": "completed", "tag": "84a12c26-186e-4dc5-b76e-261f807260e1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:43.665931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-11e97495-6e62-46ee-9573-d55fb4248884 req-bd2223e3-9884-4816-8816-df2eb6dd8c87 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.666712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-11e97495-6e62-46ee-9573-d55fb4248884 req-bd2223e3-9884-4816-8816-df2eb6dd8c87 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.694744 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-11e97495-6e62-46ee-9573-d55fb4248884 req-bd2223e3-9884-4816-8816-df2eb6dd8c87 service nova] Creating event network-vif-plugged:84a12c26-186e-4dc5-b76e-261f807260e1 for instance 4ab73749-55ca-4384-afe9-24e0335cf4bb on nch1-master-1 Mar 26 21:09:43.702084 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-11e97495-6e62-46ee-9573-d55fb4248884 req-bd2223e3-9884-4816-8816-df2eb6dd8c87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051090 Mar 26 21:09:43.707721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2244/4755] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:43.730685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:43.731942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:43.742601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.743587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.744685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.745541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.834878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:43.847213 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54cd1054-cdba-4f3f-a033-7b1d23c6af76 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.429565 Mar 26 21:09:43.859035 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2512/4756] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:43 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:43.894468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:43.900474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:43.919775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.920650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:43.936515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:43.938479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.126248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:44.137661 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c46b52a8-6a47-43ad-9176-766d09934da8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.426717 Mar 26 21:09:44.138652 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2245/4757] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:43 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:44.159188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79890cc6-b865-4bc0-86e4-baa7313ebf7e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:44.159692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-79890cc6-b865-4bc0-86e4-baa7313ebf7e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Failed to fetch instance by id -1 {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 26 21:09:44.160283 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-79890cc6-b865-4bc0-86e4-baa7313ebf7e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance -1 could not be found. Mar 26 21:09:44.161149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79890cc6-b865-4bc0-86e4-baa7313ebf7e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance -1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:44.162143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-79890cc6-b865-4bc0-86e4-baa7313ebf7e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012186 Mar 26 21:09:44.166775 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2246/4758] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:09:44 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 26 21:09:44.172836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:44.173701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:44.180875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.181513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.182478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.183152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.320150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:44.336722 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c2a3ccf-b37c-4b9d-b048-0fa0f59c94dc tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1517 microversion: 2.1 time: 0.454514 Mar 26 21:09:44.338258 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2513/4759] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:43 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:44.361408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:44.365085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:44.375161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.375827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.376815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.377369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.420272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lazy-loading 'flavor' on Instance uuid c845f296-4458-4f09-8fe7-570578d42bea {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:09:44.546790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:44.555077 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d6cb8cf4-4da3-4d18-be50-2ea3337d6f8e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action" status: 200 len: 32 microversion: 2.1 time: 0.196159 Mar 26 21:09:44.555077 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2514/4760] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:44 2022] POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:09:44.564820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-83236656-9039-45b8-81b5-f2f3b9a2e91a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.396528 Mar 26 21:09:44.580176 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2247/4761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:44 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:44.584477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:44.587316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:44.588650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:44.590592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:44.607811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.611838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.613283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.614097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.617015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.617601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.619097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.621408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.907457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:44.923194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b2c0a60-7772-4e5a-8a93-23b1ded6370d tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.360910 Mar 26 21:09:44.924621 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2515/4762] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:44 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:44.930048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:44.930975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:44.941657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.942337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:44.943474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:44.944447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:45.050618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:45.064932 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fdc70f7c-d0ec-421b-b6c3-f23018d2f624 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.481465 Mar 26 21:09:45.066134 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2248/4763] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:44 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:45.086684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab7a8ae9-37f7-459e-b92f-a53a8e5de5da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:45.087358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab7a8ae9-37f7-459e-b92f-a53a8e5de5da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 5c9482c4-87d5-4b30-a75d-4c3d6ce0128e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:45.093937 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ab7a8ae9-37f7-459e-b92f-a53a8e5de5da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 5c9482c4-87d5-4b30-a75d-4c3d6ce0128e could not be found. Mar 26 21:09:45.094733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab7a8ae9-37f7-459e-b92f-a53a8e5de5da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 5c9482c4-87d5-4b30-a75d-4c3d6ce0128e could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:45.095833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab7a8ae9-37f7-459e-b92f-a53a8e5de5da tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/5c9482c4-87d5-4b30-a75d-4c3d6ce0128e/action" status: 404 len: 111 microversion: 2.1 time: 0.015776 Mar 26 21:09:45.096679 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2249/4764] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:45 2022] POST /compute/v2.1/servers/5c9482c4-87d5-4b30-a75d-4c3d6ce0128e/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:45.107076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:45.107708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:45.144647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:45.145107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:45.147605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:45.152627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:45.335445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:45.350717 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65315a65-fc9c-4352-85d1-788bb4757684 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1313 microversion: 2.1 time: 0.423347 Mar 26 21:09:45.353993 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2516/4765] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:44 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:45.469602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1805434394", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0104976f-c364-4864-ad5f-8b4958c8e560"}, {"port": "9067d489-90c2-49f5-9304-a67efb091ee3", "tag": "port-1"}, {"port": "9d882432-9513-4f42-8117-c2eae00858b5", "tag": "port-2"}, {"uuid": "3b12b2db-5c6b-4503-ae46-15abd6717aa6", "tag": "net-1"}, {"uuid": "3b12b2db-5c6b-4503-ae46-15abd6717aa6"}, {"uuid": "ca0a3e6d-5c40-4b98-b313-e950cc4ddf03", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ca0a3e6d-5c40-4b98-b313-e950cc4ddf03", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a1e0e1a5-edb3-48a8-a377-46a9f8b4f398", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "df7e01bd-f149-463d-a824-e4f7814184a8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6b44bb35-eb1c-47f9-a3cc-cf492d4eea16", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1476320056"}], "key_name": "tempest-keypair-1539819829", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:45.640312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] validate_networks() for [('0104976f-c364-4864-ad5f-8b4958c8e560', None, None, None, None, None), (None, None, '9067d489-90c2-49f5-9304-a67efb091ee3', None, None, None), (None, None, '9d882432-9513-4f42-8117-c2eae00858b5', None, None, None), ('3b12b2db-5c6b-4503-ae46-15abd6717aa6', None, None, None, None, None), ('3b12b2db-5c6b-4503-ae46-15abd6717aa6', None, None, None, None, None), ('ca0a3e6d-5c40-4b98-b313-e950cc4ddf03', '10.2.2.100', None, None, None, None), ('ca0a3e6d-5c40-4b98-b313-e950cc4ddf03', '10.2.2.200', None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:09:45.730269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:45.751948 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fbd6de30-e6a3-4264-85ee-21a885393a96 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.650095 Mar 26 21:09:45.754278 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2250/4766] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:45 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:45.771871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:45.772890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:45.785171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:45.787729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:45.789606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:45.790075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:46.512469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:46.522652 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11430bb5-20b6-4eaa-afa1-6f63b255d838 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.756148 Mar 26 21:09:46.523266 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2251/4767] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:45 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:46.540669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:46.541570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:46.561761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:46.563201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:46.564234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:46.564882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:46.840982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:46.853788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d66883e-43ba-4c2d-be3a-6d4983382c8a tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.316384 Mar 26 21:09:46.863505 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2252/4768] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:46 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:46.863505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:46.863505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:46.869389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:46.870104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:46.871153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:46.871676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:47.206556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:47.226922 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-54ed488c-e9f0-45c3-bf90-36002030ffef tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1498 microversion: 2.1 time: 0.369263 Mar 26 21:09:47.232653 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2253/4769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:46 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:47.241117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3589363a-ae34-41c6-8043-c7b7f6185d99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:47.244688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3589363a-ae34-41c6-8043-c7b7f6185d99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: ff07bd26-43f1-4b10-937b-03a60596985c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:47.256368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3589363a-ae34-41c6-8043-c7b7f6185d99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance ff07bd26-43f1-4b10-937b-03a60596985c could not be found. Mar 26 21:09:47.259501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3589363a-ae34-41c6-8043-c7b7f6185d99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance ff07bd26-43f1-4b10-937b-03a60596985c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:47.261181 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3589363a-ae34-41c6-8043-c7b7f6185d99 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/ff07bd26-43f1-4b10-937b-03a60596985c/action" status: 404 len: 111 microversion: 2.1 time: 0.031388 Mar 26 21:09:47.267281 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2254/4770] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:47 2022] POST /compute/v2.1/servers/ff07bd26-43f1-4b10-937b-03a60596985c/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:47.287021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:47.289066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:47.310067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:47.310885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:47.311732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:47.314080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:47.610268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:47.620212 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc3a9a9a-230b-451b-a9d3-6b864dc67e13 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.344907 Mar 26 21:09:47.622679 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2255/4771] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:47.675397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:47.676986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:47.699779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:47.706470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:47.707666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:47.708270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:47.955551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:47.978289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9db54f77-15ad-4a49-b7b8-25903bc97f65 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.342865 Mar 26 21:09:47.980877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2256/4772] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:48.011096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:48.011719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:48.018349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.019450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.020481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.021151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.363402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:48.373369 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3e4b3bf-f257-415e-9935-f27d76b056d1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.383048 Mar 26 21:09:48.375103 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2257/4773] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:47 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:48.393579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe5f097c-28f2-4167-b335-2fc80d24e0e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:48.394988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe5f097c-28f2-4167-b335-2fc80d24e0e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: d91c886b-5e3a-4998-8e90-e6e24ac5b939] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:48.401408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-fe5f097c-28f2-4167-b335-2fc80d24e0e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance d91c886b-5e3a-4998-8e90-e6e24ac5b939 could not be found. Mar 26 21:09:48.403580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe5f097c-28f2-4167-b335-2fc80d24e0e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance d91c886b-5e3a-4998-8e90-e6e24ac5b939 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:48.407243 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe5f097c-28f2-4167-b335-2fc80d24e0e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/d91c886b-5e3a-4998-8e90-e6e24ac5b939" status: 404 len: 111 microversion: 2.1 time: 0.021662 Mar 26 21:09:48.415483 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2258/4774] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:48 2022] GET /compute/v2.1/servers/d91c886b-5e3a-4998-8e90-e6e24ac5b939 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:48.422206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:48.426384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:48.444767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.445450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.447033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.447638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.479565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:09:48.604536 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d668023d-4fa8-4c15-8f77-7dbac7e1f8ba tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 204 len: 0 microversion: 2.1 time: 0.187116 Mar 26 21:09:48.605403 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2259/4775] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:09:48 2022] DELETE /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:09:48.616439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:48.620203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:48.628163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.628628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.629422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.629876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.923817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:48.940480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-72d9915d-3ca4-454b-a7c8-2ef84fe51fb4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.332954 Mar 26 21:09:48.942398 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2260/4776] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:48 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:48.947846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:48.948937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:48.959257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.960056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:48.961409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:48.962237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.140946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:09:49.141970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:09:49.142683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:09:49.143076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:09:49.143693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:09:49.154195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.154658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.155608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.156117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.176262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:49.181955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Getting quotas for user dd05073d7e52411c92d7b9def363dd50 and project a821ba46f3f5408ab82098a1d2d8a926. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:49.291388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.305582 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1c8b25d3-db58-4722-b5cb-e136b4081d49 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1504 microversion: 2.1 time: 0.361566 Mar 26 21:09:49.307335 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2261/4777] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:48 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:49.331878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:49.332618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:49.353227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.353945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.355169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.355953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.357741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:09:49.361024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a1e0e1a5-edb3-48a8-a377-46a9f8b4f398',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='df7e01bd-f149-463d-a824-e4f7814184a8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b44bb35-eb1c-47f9-a3cc-cf492d4eea16',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:09:49.586021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.596619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-549e4ef4-cddb-409f-9d7c-6d32fc6bf817 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.286630 Mar 26 21:09:49.597743 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2262/4778] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:49.603359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:49.604514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:49.610935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.611630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.613021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.613656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.796688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.806373 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c38f504f-6b0b-4176-9f87-08cc75475038 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.207180 Mar 26 21:09:49.807431 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2263/4779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:49 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:49.857680 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-30464410-b98e-433f-81e1-73d8e5024116 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.392903 Mar 26 21:09:49.861398 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2517/4780] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Mar 26 21:09:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 4398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 26 21:09:49.871846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:49.872513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:49.942709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.943022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5e3a97ae-1342-471a-9872-cb40e69b8209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109844566", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:49.944603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5e3a97ae-1342-471a-9872-cb40e69b8209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:49.945425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5e3a97ae-1342-471a-9872-cb40e69b8209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006746 Mar 26 21:09:49.945961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2518/4781] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:09:49.950184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.952060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:49.953508 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9204c070-faab-43bf-ade4-7f197a596ace tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1286 microversion: 2.42 time: 0.085441 Mar 26 21:09:49.964432 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2264/4782] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:49 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:49.964814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:49.964814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:49.964814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.964814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:49.964814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:49.965338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.133975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:50.143603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-524933ed-23a6-40ec-bc01-471c8d46e83e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.193161 Mar 26 21:09:50.145659 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2519/4783] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:50.169394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:50.170257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:50.184473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.189587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.192631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.193749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.324317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:50.324995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:50.331161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.331621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.332731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.333337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.487991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:50.499603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e8a115f3-11e1-4d98-a272-9b38bc0850f8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1504 microversion: 2.1 time: 0.178685 Mar 26 21:09:50.500582 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2520/4784] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:50 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:50.603956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:50.611961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf808bbf-6621-4f61-aa19-f03c096c952a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.448654 Mar 26 21:09:50.613090 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2265/4785] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:50 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:50.793841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab4ab1a1-79c9-4442-bc70-5504d670e777 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-576396021", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:50.796016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab4ab1a1-79c9-4442-bc70-5504d670e777 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:50.796953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab4ab1a1-79c9-4442-bc70-5504d670e777 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.007580 Mar 26 21:09:50.797812 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2521/4786] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:50 2022] POST /compute/v2.1/servers => generated 133 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:09:50.806891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:50.807677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:50.820686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.821579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.822507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.823847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.828535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:50.829387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:50.847082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.847829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:50.852256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:50.854147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.094964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.106148 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5412e070-07c3-47d7-a157-ec94516fb9f1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.284560 Mar 26 21:09:51.107385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2522/4787] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:50 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:51.139028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.151335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b08ffac-fb32-436b-9811-5981c0bba647 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.349003 Mar 26 21:09:51.163951 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2266/4788] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:50 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:51.163951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:51.163951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.231637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.238914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.241463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.242834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2d01f31-f2a2-4451-90b8-3cac151dfc68 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1286 microversion: 2.42 time: 0.089580 Mar 26 21:09:51.243607 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2267/4789] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:51 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:51.248447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:51.249069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.255495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.255953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.256757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.257209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.476929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.485991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a76fe8ce-33a8-4a34-bd0d-2cd6dc5293d4 req-0c2f4d04-042f-46cc-8020-f9da08a66e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab73749-55ca-4384-afe9-24e0335cf4bb", "name": "network-vif-deleted", "tag": "84a12c26-186e-4dc5-b76e-261f807260e1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:51.487665 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb3b71bd-c5c9-4704-b24d-f5a95e39e8c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.242802 Mar 26 21:09:51.499548 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2268/4790] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:51.502794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a76fe8ce-33a8-4a34-bd0d-2cd6dc5293d4 req-0c2f4d04-042f-46cc-8020-f9da08a66e49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.503467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a76fe8ce-33a8-4a34-bd0d-2cd6dc5293d4 req-0c2f4d04-042f-46cc-8020-f9da08a66e49 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.505968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cafddb87-9608-414c-8e1d-1f4fea5714f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:51.506349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cafddb87-9608-414c-8e1d-1f4fea5714f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: bd352111-2188-4d26-90d9-59f985b0ad20] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.513745 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-cafddb87-9608-414c-8e1d-1f4fea5714f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance bd352111-2188-4d26-90d9-59f985b0ad20 could not be found. Mar 26 21:09:51.515261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cafddb87-9608-414c-8e1d-1f4fea5714f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance bd352111-2188-4d26-90d9-59f985b0ad20 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:51.516196 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cafddb87-9608-414c-8e1d-1f4fea5714f5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/bd352111-2188-4d26-90d9-59f985b0ad20/action" status: 404 len: 111 microversion: 2.1 time: 0.014651 Mar 26 21:09:51.520494 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2269/4791] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:51 2022] POST /compute/v2.1/servers/bd352111-2188-4d26-90d9-59f985b0ad20/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:09:51.525532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:51.526238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.534176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.535272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.536385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.536510 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a76fe8ce-33a8-4a34-bd0d-2cd6dc5293d4 req-0c2f4d04-042f-46cc-8020-f9da08a66e49 service nova] Creating event network-vif-deleted:84a12c26-186e-4dc5-b76e-261f807260e1 for instance 4ab73749-55ca-4384-afe9-24e0335cf4bb on nch1-master-1 Mar 26 21:09:51.537194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.552220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a76fe8ce-33a8-4a34-bd0d-2cd6dc5293d4 req-0c2f4d04-042f-46cc-8020-f9da08a66e49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442825 Mar 26 21:09:51.553373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2523/4792] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:09:51.567120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:51.573694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.585679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.586500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.587600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lazy-loading 'fault' on Instance uuid 4ab73749-55ca-4384-afe9-24e0335cf4bb {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:09:51.592486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.594021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.595301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.596488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.644021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.651611 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2fa8ba8-4eb9-4302-a6de-fffc3a285525 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 200 len: 1303 microversion: 2.1 time: 0.129975 Mar 26 21:09:51.661797 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2270/4793] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:51 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:51.848138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:51.866912 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d28ad9cd-8125-4e82-93de-df82450aea22 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.310207 Mar 26 21:09:51.869919 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2524/4794] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:51.889738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:51.890380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:51.899064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.899718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:51.901329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:51.902035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.090059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.100321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4459dac-f151-4205-8f7d-8a045dc0d29e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.215614 Mar 26 21:09:52.101374 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2271/4795] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:52.120321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:52.121135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:52.128777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:52.132957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.133999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:52.134585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.135534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.138748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.147379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.148109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.159686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.160213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.319538 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3663d2a-7b5f-4622-a43a-0a4e34930cce tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.203110 Mar 26 21:09:52.326725 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2525/4796] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:52 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:09:52.338141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:52.342577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:52.357508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.358072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.363140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.363995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.427229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.436219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc3c4dd2-3c37-40d4-b5fe-5a088c2bee68 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.310991 Mar 26 21:09:52.446170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2272/4797] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:52 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:52.451379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:52.452288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:52.459652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.460627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.462985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.464392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.485741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.495204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.501110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.504338 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31b72479-e8e3-4ed6-98d7-0262e13da4da tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1584 microversion: 2.42 time: 0.173609 Mar 26 21:09:52.505013 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2526/4798] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:52 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1584 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:52.653776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:52.665695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86c31eae-06e0-418a-bf68-bfa20c34ba64 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1511 microversion: 2.1 time: 0.218117 Mar 26 21:09:52.666293 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2273/4799] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:52 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:52.668717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:52.669452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 4ab73749-55ca-4384-afe9-24e0335cf4bb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:52.679977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.680731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.681770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:52.682447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:52.710334 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] HTTP exception thrown: Instance 4ab73749-55ca-4384-afe9-24e0335cf4bb could not be found. Mar 26 21:09:52.711567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Returning 404 to user: Instance 4ab73749-55ca-4384-afe9-24e0335cf4bb could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:52.712666 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d6165293-be3d-4bc2-9796-fc612ba038a7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb" status: 404 len: 111 microversion: 2.1 time: 0.048052 Mar 26 21:09:52.713440 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2527/4800] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:52 2022] GET /compute/v2.1/servers/4ab73749-55ca-4384-afe9-24e0335cf4bb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:52.936861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674825176", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "e5f51125-5858-46df-946d-60ea76425690"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:53.042073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] validate_networks() for [('e5f51125-5858-46df-946d-60ea76425690', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:09:53.453331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:53.454257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:53.463449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:53.465904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:53.468139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:53.469975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:53.773157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:53.789306 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d893ef4-213f-44b1-9fae-a21fef77c3fe tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.339118 Mar 26 21:09:53.800661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2528/4801] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:53 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:53.808081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:53.828197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:53.845971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:53.848509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:53.851094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:53.852001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:53.997734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:09:53.998780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:09:54.001272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:09:54.001908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:09:54.002824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:09:54.036016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.036403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.041587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.042247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.086222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:54.086831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Getting quotas for project 7b6be6f8159f4491b83d9658d643464c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:09:54.100768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Getting quotas for user da090da7f121431abd13c9d9f0c71bb8 and project 7b6be6f8159f4491b83d9658d643464c. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:09:54.102578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:54.104917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:54.106803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9fef7dd-ac7c-4b3c-b5fd-a98ac35e5c77 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1594 microversion: 2.42 time: 0.304605 Mar 26 21:09:54.108610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2529/4802] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:53 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1594 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:54.126182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:54.126972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.138826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:09:54.142546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:09:54.145241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.146281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.149150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.150673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.221441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76cc9b2c-8ead-42f5-bdc1-1bc94e4694d7 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288438 Mar 26 21:09:54.226788 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2274/4803] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:09:54.235253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4fdfaa45-45eb-4e6a-9b9a-f827a8cf8818 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:54.238386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4fdfaa45-45eb-4e6a-9b9a-f827a8cf8818 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.377201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4fdfaa45-45eb-4e6a-9b9a-f827a8cf8818 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:54.405021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:54.409038 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4fdfaa45-45eb-4e6a-9b9a-f827a8cf8818 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1214 microversion: 2.1 time: 0.178228 Mar 26 21:09:54.412285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2275/4804] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:54 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:54.426743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2e70862c-cf12-4250-a5b2-e1bd3ff2e73e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1491 microversion: 2.1 time: 0.316113 Mar 26 21:09:54.427419 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2530/4805] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:54 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1491 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:54.454285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:54.455883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.471232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.471714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.473363 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.474186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.541405 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'pause' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state paused Mar 26 21:09:54.542048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'pause' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state paused {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:54.547619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2d68947-efb6-4d6f-a3bb-465f64e0a04a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 143 microversion: 2.1 time: 0.100158 Mar 26 21:09:54.548336 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2276/4806] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:54 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:09:54.557611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:54.558163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.571165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.571635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.572460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.572901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.721635 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf6be21d-09bd-4ae0-a749-313ed8603688 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.165922 Mar 26 21:09:54.724304 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2531/4807] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:54 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:09:54.731283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:54.732528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.744686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.745447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.746592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.747242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.807428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:54.808335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:54.823343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.829348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:54.832168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:54.837699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:55.224425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.232712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.239239 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c38adc5d-d921-4b84-9744-4742653f00e1 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.436810 Mar 26 21:09:55.240992 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2532/4808] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:54 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:55.244957 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10dcb912-ddc9-406c-b640-927d9e59e870 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1498 microversion: 2.1 time: 0.517530 Mar 26 21:09:55.245798 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2277/4809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:54 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:55.261068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:55.261713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:55.286953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:55.288749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:55.295102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:55.298251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:55.427817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:55.428529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:55.452462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:55.453044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:55.459368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:55.463031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:55.633029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.646329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.649458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.651044 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9362098-9c8f-49ad-94a5-645306a34fcb tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1662 microversion: 2.42 time: 0.408790 Mar 26 21:09:55.657536 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2533/4810] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:55 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1662 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:55.928748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:55.944569 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3db80a8-8bae-4345-87c7-85741f6b0d73 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1210 microversion: 2.1 time: 0.519395 Mar 26 21:09:55.948165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2278/4811] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:55 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1210 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:56.257037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:56.257738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:56.263057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:56.264402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:56.273928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.274425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.275336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.275784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.275901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.276307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.278174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.279243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.554333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:56.570447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00b50c05-39bf-4079-932c-74f6ee794578 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.317407 Mar 26 21:09:56.572933 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2534/4812] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:56 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:56.680073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:56.680970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:56.704302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.705779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.707788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.709459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.903822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:56.938307 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10351017-5ded-47c2-82ef-53b5e7e2a314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.678228 Mar 26 21:09:56.955973 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2279/4813] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:56 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:56.970643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:56.972476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:56.988147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:56.993089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:56.997502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.000497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.030078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.052705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.058755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.062793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b265ebe5-a844-484e-add5-abce1d28a409 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1709 microversion: 2.42 time: 0.394373 Mar 26 21:09:57.065376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2535/4814] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:56 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1709 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:09:57.076937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:57.078369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:57.096011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.097622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.099148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.100723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.150025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.166480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e672e31-2238-411a-b69f-5a7a7213f8f3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1272 microversion: 2.1 time: 0.201175 Mar 26 21:09:57.168704 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2280/4815] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:56 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:57.422651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.439091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4659a784-7a43-431f-bf67-26b494ef8f34 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.369889 Mar 26 21:09:57.448896 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2536/4816] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:57.459097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:57.460996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:57.476465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.477584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.478419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.479024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.506370 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. Mar 26 21:09:57.507156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:57.510586 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0908fc13-343f-4095-9339-959e396673b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451/action" status: 404 len: 111 microversion: 2.1 time: 0.054448 Mar 26 21:09:57.517092 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2281/4817] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:57 2022] POST /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:57.521453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:57.533122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:57.553674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.554461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.557057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.558373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.613687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:57.614728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:57.623684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.624808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.625870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.626917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.889770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:57.902271 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4765b062-362e-4e90-9160-8dec5d8329c8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.385504 Mar 26 21:09:57.905796 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2537/4818] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:57.929156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:57.930518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:57.946425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.953033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:57.955223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:57.956410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.137640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.150926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-656a0575-535f-4d01-b673-d8d6255eb976 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.562491 Mar 26 21:09:58.152082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2282/4819] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:57 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:58.157357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:58.158181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:58.166008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.166699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.167750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.168744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.257631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.265540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e7abbf3f-0734-4f2f-a340-2d4fb1c9f859 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.347765 Mar 26 21:09:58.268608 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2538/4820] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:58.273529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:58.274892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:58.289478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.291563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.294190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.294709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.656744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.666842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.674429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.677295 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db1f7771-5ce4-410a-b872-6e085fbbf91e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1697 microversion: 2.42 time: 0.523922 Mar 26 21:09:58.690165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2283/4821] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:58 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1697 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:09:58.697668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3310f7ea-8489-48b1-9a61-aa961e7878b0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:09:58.699013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3310f7ea-8489-48b1-9a61-aa961e7878b0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 45e88a4a-a600-406a-84c5-df4ae147be80] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:58.715702 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3310f7ea-8489-48b1-9a61-aa961e7878b0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 45e88a4a-a600-406a-84c5-df4ae147be80 could not be found. Mar 26 21:09:58.715702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3310f7ea-8489-48b1-9a61-aa961e7878b0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 45e88a4a-a600-406a-84c5-df4ae147be80 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:09:58.722530 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3310f7ea-8489-48b1-9a61-aa961e7878b0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/45e88a4a-a600-406a-84c5-df4ae147be80/action" status: 404 len: 111 microversion: 2.1 time: 0.029197 Mar 26 21:09:58.732808 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2284/4822] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:09:58 2022] POST /compute/v2.1/servers/45e88a4a-a600-406a-84c5-df4ae147be80/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:09:58.744374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:58.745075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:58.767278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.768903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.770882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:58.771636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:58.824791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:58.834062 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5954dcda-46f5-4a40-8397-9bf059c25236 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.564122 Mar 26 21:09:58.834656 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2539/4823] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:58 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:59.169582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:59.171343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:59.183004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.185172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.186153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.188251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.310940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:59.320197 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4a757f6a-cbc2-4127-9aaa-d75ef20655fd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.586236 Mar 26 21:09:59.321386 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2285/4824] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:58 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:59.339791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:59.340787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:59.348078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.349020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.350313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.350964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.418965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:59.433626 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35ba79c7-6775-431a-b7ce-482771b43f7b tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.268998 Mar 26 21:09:59.440700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2540/4825] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:59 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:09:59.699513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:59.700159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:59.706427 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.706892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.707675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.709194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.936709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:59.951786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7c9c89c7-67c0-48c9-b921-91e03748f41e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.616060 Mar 26 21:09:59.952674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2286/4826] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:59 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:09:59.957359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:09:59.963124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:09:59.981953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.982645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:09:59.984196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:09:59.988306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:09:59.998899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:00.000362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.008031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:00.009250 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcb2d647-f7b8-4e37-8c63-a4d5deb9a931 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1744 microversion: 2.42 time: 0.314574 Mar 26 21:10:00.011651 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2541/4827] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:09:59 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1744 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:00.040272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:00.043312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:00.057180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.069583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.085095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.085913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.128053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. Mar 26 21:10:00.129269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:00.130274 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-18749605-c352-4ee9-920a-8073b7ec60a4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451/action" status: 404 len: 111 microversion: 2.1 time: 0.117639 Mar 26 21:10:00.131855 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2542/4828] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:00 2022] POST /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:00.142959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:00.152785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:00.164360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.165076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.166066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.166667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.402021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:00.414336 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d905011-f2ed-4698-ab82-f786f63d3682 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.275553 Mar 26 21:10:00.420663 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2543/4829] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:00 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:00.439941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:00.441276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:00.456395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.457168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.458315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.459045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.769382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:00.782324 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef488898-e8c0-4e61-b452-f11a0e53756d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.348790 Mar 26 21:10:00.783460 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2544/4830] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:00 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:00.788837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:00.790078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:00.801025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.802093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.803423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:00.804294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:00.943258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:00.968429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90f823cd-342e-4dae-8a8c-d66e489e964c tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 1.014025 Mar 26 21:10:00.978844 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2287/4831] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:09:59 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:00.994061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f187890-2bfc-4de4-b0b9-2b203e9b13c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:01.011763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9f187890-2bfc-4de4-b0b9-2b203e9b13c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 1caffd48-02d8-40b0-a00f-c37b4db4b9a3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:01.039074 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9f187890-2bfc-4de4-b0b9-2b203e9b13c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 1caffd48-02d8-40b0-a00f-c37b4db4b9a3 could not be found. Mar 26 21:10:01.044253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:01.056884 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6649fd09-51d2-4849-ae14-80c7fd596b60 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.272019 Mar 26 21:10:01.066738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f187890-2bfc-4de4-b0b9-2b203e9b13c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 1caffd48-02d8-40b0-a00f-c37b4db4b9a3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:01.066738 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f187890-2bfc-4de4-b0b9-2b203e9b13c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/1caffd48-02d8-40b0-a00f-c37b4db4b9a3/action" status: 404 len: 111 microversion: 2.1 time: 0.078543 Mar 26 21:10:01.066738 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2288/4832] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:00 2022] POST /compute/v2.1/servers/1caffd48-02d8-40b0-a00f-c37b4db4b9a3/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:01.069932 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2545/4833] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:00 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:01.074231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6bd13c3a-fc64-4ed2-8da4-3535a3cadc2a req-c444c68d-dce8-4640-868e-8f76b4edce60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f96df0b-e511-4023-85ee-46dff0a647e5", "tag": "dded3166-95cc-4fc7-8eb8-795205dc5776"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:01.076573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:01.079354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:01.095695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.098813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.101373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.101535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bd13c3a-fc64-4ed2-8da4-3535a3cadc2a req-c444c68d-dce8-4640-868e-8f76b4edce60 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.102157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6bd13c3a-fc64-4ed2-8da4-3535a3cadc2a req-c444c68d-dce8-4640-868e-8f76b4edce60 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.103185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.116158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6bd13c3a-fc64-4ed2-8da4-3535a3cadc2a req-c444c68d-dce8-4640-868e-8f76b4edce60 service nova] Creating event network-changed:dded3166-95cc-4fc7-8eb8-795205dc5776 for instance 1f96df0b-e511-4023-85ee-46dff0a647e5 on nch2-master-1 Mar 26 21:10:01.125223 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6bd13c3a-fc64-4ed2-8da4-3535a3cadc2a req-c444c68d-dce8-4640-868e-8f76b4edce60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062847 Mar 26 21:10:01.125993 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2289/4834] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:01.137677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:01.141453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:01.154252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.154726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.158892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.159426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.382460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:01.394462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:01.396238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:01.397543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ac5abd5-7d20-4730-a109-917f2e0e257e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1791 microversion: 2.42 time: 0.333721 Mar 26 21:10:01.398441 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2546/4835] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:01 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1791 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:01.830367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:01.849790 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c59ed50-b6b0-485b-84fb-fc20644d2c90 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.718334 Mar 26 21:10:01.850445 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2290/4836] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:01 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:01.873434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:01.874070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:01.895781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.896564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.897832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:01.898462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:01.996493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:01.997545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:02.017660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.018139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.018954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.019411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.231139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:02.254020 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56de2eb4-be18-4937-b65e-29167098849a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.387192 Mar 26 21:10:02.259844 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2547/4837] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:01 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:02.266690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:02.267872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:02.276148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.277097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.278826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.279542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.412798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:02.421743 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3a09f8d-6449-4323-9a8e-c89448c52acd tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.430170 Mar 26 21:10:02.432259 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2291/4838] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:01 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:02.438689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0bc84b29-7d2e-4704-8653-c7e440f33404 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:02.439530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0bc84b29-7d2e-4704-8653-c7e440f33404 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 2e89eea6-b34d-4752-b038-4a8726ecb70d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:02.446255 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0bc84b29-7d2e-4704-8653-c7e440f33404 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 2e89eea6-b34d-4752-b038-4a8726ecb70d could not be found. Mar 26 21:10:02.447106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0bc84b29-7d2e-4704-8653-c7e440f33404 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 2e89eea6-b34d-4752-b038-4a8726ecb70d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:02.448199 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0bc84b29-7d2e-4704-8653-c7e440f33404 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/2e89eea6-b34d-4752-b038-4a8726ecb70d/action" status: 404 len: 111 microversion: 2.1 time: 0.014558 Mar 26 21:10:02.448972 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2292/4839] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:02 2022] POST /compute/v2.1/servers/2e89eea6-b34d-4752-b038-4a8726ecb70d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:02.458338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:02.459188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:02.467586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.468896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.469902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.470518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.639673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:02.681267 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d20a612-2f63-438b-a67e-6c1382f19109 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.419795 Mar 26 21:10:02.681984 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2548/4840] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:02 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:02.717589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:02.720184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:02.736173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.737021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:02.738065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:02.739132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.006696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.016495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.018052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.019292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-33d4ac70-97a2-4cd9-b345-e377406ec4d9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1791 microversion: 2.42 time: 0.564961 Mar 26 21:10:03.029852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.033044 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2293/4841] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:02 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1791 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:03.040610 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3fcb7368-322f-41db-9958-8daca497f0bc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.348522 Mar 26 21:10:03.042426 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2549/4842] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:02 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:03.060051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:03.061149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:03.072880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.073731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.075195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.075998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.440647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:03.441393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:03.449109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.449572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.451099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.451560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.565205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.597548 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-05c57d14-4b5d-4f70-bdb6-1b99a964e46d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.541669 Mar 26 21:10:03.598775 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2294/4843] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:03 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:03.617151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:03.618074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:03.627221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.628021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.629288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.629977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.690928 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'restore' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active Mar 26 21:10:03.693155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'restore' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:03.694640 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8d472dd-c4f4-48f9-b5e5-409f91fa7448 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 145 microversion: 2.1 time: 0.081625 Mar 26 21:10:03.705599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2295/4844] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:03 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:10:03.720539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:03.727393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:03.728438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:03.736335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.736525 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9e596354-761a-455e-8f7b-94cf26c5ffb8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.300529 Mar 26 21:10:03.737279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.737427 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2550/4845] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:03 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:10:03.738421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.739193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.752088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:03.752734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:03.765826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.767217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.768114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:03.768577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:03.993034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.000697 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f22a365-a6f4-4063-bb82-062b10d115c0 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.262050 Mar 26 21:10:04.013012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2551/4846] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:03 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:04.022070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:04.022706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:04.037062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.037528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.038338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.038788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.253835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.268794 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ecafd43-8ef4-4bba-b8e0-71db19b3664c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.561550 Mar 26 21:10:04.269403 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2296/4847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:03 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:04.276751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:04.279502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:04.306372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.307311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.308433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.313107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.328824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.340033 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64fae0a9-ed04-4c64-a63f-c5a4c119b7ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.321730 Mar 26 21:10:04.360555 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2552/4848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:04 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:04.371459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fab30401-748f-4fbb-9252-8aced1ea91aa tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:04.372082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fab30401-748f-4fbb-9252-8aced1ea91aa tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 42413b11-7093-4fda-943d-7a639c733d9a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:04.385488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-fab30401-748f-4fbb-9252-8aced1ea91aa tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 42413b11-7093-4fda-943d-7a639c733d9a could not be found. Mar 26 21:10:04.388590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fab30401-748f-4fbb-9252-8aced1ea91aa tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 42413b11-7093-4fda-943d-7a639c733d9a could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:04.389556 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fab30401-748f-4fbb-9252-8aced1ea91aa tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/42413b11-7093-4fda-943d-7a639c733d9a/action" status: 404 len: 111 microversion: 2.1 time: 0.022040 Mar 26 21:10:04.390745 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2553/4849] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:04 2022] POST /compute/v2.1/servers/42413b11-7093-4fda-943d-7a639c733d9a/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:10:04.407652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:04.408317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:04.425670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.426138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.430707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.431254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.880907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.888826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.898942 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-627c8402-c8d7-4d3c-952f-0f5aa78c8beb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.500696 Mar 26 21:10:04.910783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.918117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:04.928630 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2554/4850] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:04 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:04.935281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:04.935954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:04.951749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e88750a4-f30e-475c-a978-8fedcf9dda93 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1838 microversion: 2.42 time: 0.673846 Mar 26 21:10:04.955576 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2297/4851] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:04 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1838 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:04.968955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.969789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.970989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:04.971684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:04.984619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:04.987466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:05.010868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.011779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.012937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.013703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.368269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:05.378615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d135b57a-bbf6-4cd1-a495-d730b307fb97 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.448457 Mar 26 21:10:05.390875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2555/4852] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:04 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:05.414656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:05.415521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:05.432877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.433110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.433881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.434399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.672102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:05.681761 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c226af0c-fb9c-4cb0-9bad-c254f3fdc726 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.720906 Mar 26 21:10:05.683261 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2298/4853] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:04 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:05.690654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:05.703526 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59995314-9f83-4228-934f-fd9e6750abce tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.310184 Mar 26 21:10:05.704965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-003c9fcf-a38e-4f39-ae72-7b0a70cad4af req-b13eb854-abd6-4eeb-9532-b85307b7333e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "22b73853-ba48-4af3-b54b-5bc85d9fee52"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:05.711898 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2556/4854] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:05 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:05.720170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-003c9fcf-a38e-4f39-ae72-7b0a70cad4af req-b13eb854-abd6-4eeb-9532-b85307b7333e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.720973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-003c9fcf-a38e-4f39-ae72-7b0a70cad4af req-b13eb854-abd6-4eeb-9532-b85307b7333e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.722505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:05.723185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:05.735231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.736992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.739264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.740058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.744148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-003c9fcf-a38e-4f39-ae72-7b0a70cad4af req-b13eb854-abd6-4eeb-9532-b85307b7333e service nova] Creating event network-changed:22b73853-ba48-4af3-b54b-5bc85d9fee52 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:05.753739 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-003c9fcf-a38e-4f39-ae72-7b0a70cad4af req-b13eb854-abd6-4eeb-9532-b85307b7333e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068446 Mar 26 21:10:05.755722 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2299/4855] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:05.781760 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'resume' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active Mar 26 21:10:05.782771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'resume' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:05.784856 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07de7ed6-6dae-4f16-888e-bfbc514cf491 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 144 microversion: 2.1 time: 0.070990 Mar 26 21:10:05.785635 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2557/4856] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:05 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 144 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:10:05.796083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:05.797209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:05.804073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.805569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.806589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.807636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.984734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:05.986028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:05.993694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.994438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:05.995387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:05.996028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:06.351541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:06.363835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:06.373564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:06.375812 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da977f1e-d40a-4901-83b5-99dca5bc7489 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1838 microversion: 2.42 time: 0.404389 Mar 26 21:10:06.376448 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2558/4857] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:05 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1838 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:06.396558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:06.397186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:06.416295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:06.417042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:06.418089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:06.419094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:06.676096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:06.701125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-951b3c0c-5f9f-4994-a4d7-d44c9b4c2eb2 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.308414 Mar 26 21:10:06.702121 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2559/4858] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:06 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:06.861845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:06.870276 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-968795e1-cb04-4cb2-8049-6668cfd27241 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 1.079648 Mar 26 21:10:06.883466 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2300/4859] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:05 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:06.888982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:06.889948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:06.896331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:06.897133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:06.898143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:06.899061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.032182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7f98a76b-2319-4a54-801d-6cd06693fbad req-17707874-27e9-4781-9824-428ea91b067c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f96df0b-e511-4023-85ee-46dff0a647e5", "name": "network-vif-plugged", "status": "completed", "tag": "dded3166-95cc-4fc7-8eb8-795205dc5776"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:07.043400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7f98a76b-2319-4a54-801d-6cd06693fbad req-17707874-27e9-4781-9824-428ea91b067c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.044215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7f98a76b-2319-4a54-801d-6cd06693fbad req-17707874-27e9-4781-9824-428ea91b067c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.064644 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7f98a76b-2319-4a54-801d-6cd06693fbad req-17707874-27e9-4781-9824-428ea91b067c service nova] Creating event network-vif-plugged:dded3166-95cc-4fc7-8eb8-795205dc5776 for instance 1f96df0b-e511-4023-85ee-46dff0a647e5 on nch2-master-1 Mar 26 21:10:07.074864 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7f98a76b-2319-4a54-801d-6cd06693fbad req-17707874-27e9-4781-9824-428ea91b067c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370849 Mar 26 21:10:07.076224 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2560/4860] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:07.114436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:07.116661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:07.133480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.134432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.135501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.168461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.406386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:07.417466 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c13aabf3-3764-4216-85a7-cc35e0d09329 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.530084 Mar 26 21:10:07.418485 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2301/4861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:06 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:07.433982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:07.434667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:07.451537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.451844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.454124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.454681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.558229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:07.571399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-53739c35-d3db-4439-b72f-f2d0e12e2a6a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.492805 Mar 26 21:10:07.572421 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2561/4862] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:07 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:07.721670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:07.722360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:07.736517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.737390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:07.739818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:07.740576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.027513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:08.038527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:08.050855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:08.054784 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c6bf0724-6f92-4549-9679-3a1044afdfe2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1859 microversion: 2.42 time: 0.631282 Mar 26 21:10:08.058733 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2302/4863] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:07 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1859 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:08.075110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17ff9991-b1e7-4e78-b7ee-ed3ac21bd6f3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ccf83904-f1a5-4a9e-ae1b-3b1c10f65d67"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:08.078341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17ff9991-b1e7-4e78-b7ee-ed3ac21bd6f3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:08.079617 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17ff9991-b1e7-4e78-b7ee-ed3ac21bd6f3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018754 Mar 26 21:10:08.085259 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2303/4864] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:10:08 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:10:08.099687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:08.111464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:08.129215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:08.143331 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f60a9fe0-0e40-4ac5-87fa-87ff395f34fe tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1314 microversion: 2.1 time: 0.428028 Mar 26 21:10:08.144407 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2562/4865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:07 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:08.170459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.173011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.174098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.176757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.208771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-78d16879-a265-4a94-b0fe-c94618326908 req-343b47a0-c950-4caf-af2b-6d3ec065ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "9067d489-90c2-49f5-9304-a67efb091ee3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:08.244714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-78d16879-a265-4a94-b0fe-c94618326908 req-343b47a0-c950-4caf-af2b-6d3ec065ddc7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.245720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-78d16879-a265-4a94-b0fe-c94618326908 req-343b47a0-c950-4caf-af2b-6d3ec065ddc7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.280630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-78d16879-a265-4a94-b0fe-c94618326908 req-343b47a0-c950-4caf-af2b-6d3ec065ddc7 service nova] Creating event network-changed:9067d489-90c2-49f5-9304-a67efb091ee3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:08.293624 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-78d16879-a265-4a94-b0fe-c94618326908 req-343b47a0-c950-4caf-af2b-6d3ec065ddc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090954 Mar 26 21:10:08.294551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2563/4866] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:08.455011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:08.461676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:08.499187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.500410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.504314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.506347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.861540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:08.879545 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3187da32-267c-454b-a4cd-a6096395a888 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.787743 Mar 26 21:10:08.880954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2304/4867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:08 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:08.898038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:08.898760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:08.907556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.908049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:08.914006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:08.916878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.094555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.104221 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f104381e-93c9-43a6-abf5-0f604910044c tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.673084 Mar 26 21:10:09.107881 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2564/4868] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:08 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:09.118462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:09.119528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:09.131648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.134966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.136586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.137905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.203150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.209601 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-04825f69-0e86-4d42-a1dd-454a52d5efd6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.315452 Mar 26 21:10:09.210819 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2305/4869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:08 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:09.230326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:09.231140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:09.249676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.250768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.251687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.252144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.516648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.536961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.538867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.540450 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22f0fcd6-a50f-4aa4-a1f0-ac6a2eee139d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1859 microversion: 2.42 time: 0.430228 Mar 26 21:10:09.541294 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2565/4870] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:09 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1859 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:09.555812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ff03bfa-b147-4831-9cca-eaadcf0dba0b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:09.560832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ff03bfa-b147-4831-9cca-eaadcf0dba0b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: c404fa1b-60b8-4f98-9c42-111d24643b47] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:09.574790 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9ff03bfa-b147-4831-9cca-eaadcf0dba0b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance c404fa1b-60b8-4f98-9c42-111d24643b47 could not be found. Mar 26 21:10:09.575750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ff03bfa-b147-4831-9cca-eaadcf0dba0b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance c404fa1b-60b8-4f98-9c42-111d24643b47 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:09.576786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ff03bfa-b147-4831-9cca-eaadcf0dba0b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/c404fa1b-60b8-4f98-9c42-111d24643b47/action" status: 404 len: 111 microversion: 2.1 time: 0.034339 Mar 26 21:10:09.580794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2566/4871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:09 2022] POST /compute/v2.1/servers/c404fa1b-60b8-4f98-9c42-111d24643b47/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:09.595154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:09.596329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:09.622937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.631786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.634963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.635475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.884252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.904811 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57ac3086-fad9-46a3-8cf8-b09a12aa31f2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.318452 Mar 26 21:10:09.906371 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2567/4872] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:09 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:09.922881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:09.936010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:09.937021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:09.938106 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3dcf540c-e6b7-4add-b47a-aa3ce28c9db8 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1498 microversion: 2.1 time: 0.725996 Mar 26 21:10:09.938786 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2306/4873] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:09 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1498 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:09.955499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.957320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:09.957320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:09.957320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.124761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:10.125438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:10.142892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.144717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.145719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.147580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.196285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:10.206604 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-be703800-3d39-426b-8d87-d3f369e60631 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.274907 Mar 26 21:10:10.207046 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2568/4874] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:09 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:10.223689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:10.224488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:10.233258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.234026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.235198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.235872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.307085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lazy-loading 'flavor' on Instance uuid 40a24185-11da-4355-9203-d4bc0e5eeb51 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:10:10.839015 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-96e02f70-3355-4b2d-b698-ef8215991f76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.620790 Mar 26 21:10:10.839959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2569/4875] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:10 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:10:10.846446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-604ba300-f010-483e-86a3-1070ce1cb991 req-40f07f08-15ff-4f28-a9dc-e96cd66c6a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "9d882432-9513-4f42-8117-c2eae00858b5"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:10.855452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-604ba300-f010-483e-86a3-1070ce1cb991 req-40f07f08-15ff-4f28-a9dc-e96cd66c6a7f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.856186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-604ba300-f010-483e-86a3-1070ce1cb991 req-40f07f08-15ff-4f28-a9dc-e96cd66c6a7f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.868241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:10.868973 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-604ba300-f010-483e-86a3-1070ce1cb991 req-40f07f08-15ff-4f28-a9dc-e96cd66c6a7f service nova] Creating event network-changed:9d882432-9513-4f42-8117-c2eae00858b5 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:10.875765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-604ba300-f010-483e-86a3-1070ce1cb991 req-40f07f08-15ff-4f28-a9dc-e96cd66c6a7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033611 Mar 26 21:10:10.876924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2570/4876] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:10.884469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:10.887168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:10.888365 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-93c849ec-9322-4da0-8045-c43531a119c8 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.768198 Mar 26 21:10:10.891395 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2307/4877] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:10 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:10:10.902891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.907035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.911299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.912362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:10.912730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.918789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:10.946846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.954284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:10.954284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:10.954284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:11.384760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:11.395434 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-852367e6-d3e0-49bd-adc4-943d612b5270 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.502667 Mar 26 21:10:11.397165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2308/4878] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:10 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:11.404155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:11.405494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:11.415747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:11.416544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:11.418572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:11.419589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:11.491515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:10:11.673153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb218591-bafa-4671-8742-2210ce50a4d3 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 204 len: 0 microversion: 2.1 time: 0.273931 Mar 26 21:10:11.679010 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2309/4879] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:10:11 2022] DELETE /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:10:11.686477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:11.688616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:11.699985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:11.700897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:11.702359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:11.703268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.096587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.104380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.113858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.115872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0bcd9e83-f24b-4613-b6d7-40d6f1e186f8 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 1.237291 Mar 26 21:10:12.119160 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2571/4880] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:10 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:12.129807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:12.132416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:12.149277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:12.150973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.152817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:12.153838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.490988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.492988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.504295 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-832fe4d1-be94-4ee3-bcc5-5efbd2343d73 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.383557 Mar 26 21:10:12.516005 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2572/4881] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:12 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:12.516384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab5aab2c-f3c5-4eca-952c-d20ecd6b63ca tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1504 microversion: 2.1 time: 0.828593 Mar 26 21:10:12.516384 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2310/4882] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:11 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1504 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:12.520167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:12.520792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:12.529033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:12.529480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.530329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:12.530824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.912898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f8b5bb8c-6730-48d1-96a2-560f015a6eac req-3c0854e6-a371-4672-9361-45f2234876e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "9f26816b-64ca-4f6e-bc7f-0723c5bf7f79"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:12.948213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f8b5bb8c-6730-48d1-96a2-560f015a6eac req-3c0854e6-a371-4672-9361-45f2234876e3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:12.952430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f8b5bb8c-6730-48d1-96a2-560f015a6eac req-3c0854e6-a371-4672-9361-45f2234876e3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:12.952946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:12.969227 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e1511552-3d4f-4434-8a9f-4f8ca7f24e14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.461325 Mar 26 21:10:12.972246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2573/4883] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:12 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:12.984520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f8b5bb8c-6730-48d1-96a2-560f015a6eac req-3c0854e6-a371-4672-9361-45f2234876e3 service nova] Creating event network-changed:9f26816b-64ca-4f6e-bc7f-0723c5bf7f79 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:13.009544 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f8b5bb8c-6730-48d1-96a2-560f015a6eac req-3c0854e6-a371-4672-9361-45f2234876e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096670 Mar 26 21:10:13.013383 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2311/4884] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:13.149241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:13.151602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:13.165958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.166685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:13.172308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.172942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:13.529705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:13.531610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:13.543551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.546118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:13.547336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.548049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:13.880137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:13.891554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:13.893108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:13.905143 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-010b86d0-e094-4931-8005-6de4bd245b2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.770805 Mar 26 21:10:13.905976 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2574/4885] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:13 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:13.924271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:13.924903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:13.948050 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.948523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:13.949587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:13.950041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:14.396161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da090da7f121431abd13c9d9f0c71bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b6be6f8159f4491b83d9658d643464c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:14.409076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8a1b5c6-5f0e-4472-a563-1a1cd15d7d3e tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 200 len: 1504 microversion: 2.1 time: 0.488874 Mar 26 21:10:14.410511 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2575/4886] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:13 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:14.444460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:14.446680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:14.456441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:14.457665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:14.458386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:14.459040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:14.469810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:14.487715 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98fb4b03-ebf8-4a9b-addf-a458e788ecee tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.963259 Mar 26 21:10:14.489660 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2312/4887] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:13 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:14.696420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-fc459899-ca43-4573-8be6-a9a9e4743533 req-4ba695f0-a4b8-4cc9-a0de-067bd08b58a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f96df0b-e511-4023-85ee-46dff0a647e5", "name": "network-vif-deleted", "tag": "dded3166-95cc-4fc7-8eb8-795205dc5776"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:14.711288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fc459899-ca43-4573-8be6-a9a9e4743533 req-4ba695f0-a4b8-4cc9-a0de-067bd08b58a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:14.711859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fc459899-ca43-4573-8be6-a9a9e4743533 req-4ba695f0-a4b8-4cc9-a0de-067bd08b58a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:14.720619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:14.728070 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-fc459899-ca43-4573-8be6-a9a9e4743533 req-4ba695f0-a4b8-4cc9-a0de-067bd08b58a1 service nova] Creating event network-vif-deleted:dded3166-95cc-4fc7-8eb8-795205dc5776 for instance 1f96df0b-e511-4023-85ee-46dff0a647e5 on nch2-master-1 Mar 26 21:10:14.734672 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-fc459899-ca43-4573-8be6-a9a9e4743533 req-4ba695f0-a4b8-4cc9-a0de-067bd08b58a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242812 Mar 26 21:10:14.735670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2313/4888] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:14.743868 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62b4582d-4dd2-48c6-ac5c-75cedc1001e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.331741 Mar 26 21:10:14.744523 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2576/4889] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:14 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:14.929918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:14.930822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:14.946117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:14.946955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:14.948140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:14.948731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.371657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Calling method '.version_select at 0x7f6e58039a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:15.372665 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:10:15.372665 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:10:15.373984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.374481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.412932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.413566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.430642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.431157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.440423 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31187786-fd62-49bc-a7cf-6b066a0de4e2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157 tempest-PortsAdminExtendedAttrsIpV6TestJSON-253044157-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.292219 Mar 26 21:10:15.440927 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2577/4890] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:10:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:10:15.454197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ad1fd04d-b445-4ee5-9535-5b21ae33cce6 req-b6c8d79d-ac2a-45e0-9b12-3e33af7fba9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "3776e0f7-2a1d-4dbf-b7ac-963e98079436"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:15.469144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ad1fd04d-b445-4ee5-9535-5b21ae33cce6 req-b6c8d79d-ac2a-45e0-9b12-3e33af7fba9f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.469679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ad1fd04d-b445-4ee5-9535-5b21ae33cce6 req-b6c8d79d-ac2a-45e0-9b12-3e33af7fba9f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.486872 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ad1fd04d-b445-4ee5-9535-5b21ae33cce6 req-b6c8d79d-ac2a-45e0-9b12-3e33af7fba9f service nova] Creating event network-changed:3776e0f7-2a1d-4dbf-b7ac-963e98079436 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:15.492220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ad1fd04d-b445-4ee5-9535-5b21ae33cce6 req-b6c8d79d-ac2a-45e0-9b12-3e33af7fba9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045747 Mar 26 21:10:15.493019 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2578/4891] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:15.498584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:15.499817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] [instance: 1f96df0b-e511-4023-85ee-46dff0a647e5] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:15.507452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.508264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.514060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:15.522802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.524019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.533427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:15.535516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:15.537181 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df7826f0-bd4d-4ade-a28d-522922f94d80 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.613758 Mar 26 21:10:15.538008 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2314/4892] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:14 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:15.543104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:15.544136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:15.552772 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] HTTP exception thrown: Instance 1f96df0b-e511-4023-85ee-46dff0a647e5 could not be found. Mar 26 21:10:15.553495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] Returning 404 to user: Instance 1f96df0b-e511-4023-85ee-46dff0a647e5 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:15.554496 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e835c349-1357-4de3-bf2b-b8eae2d4e3d1 tempest-VolumesActionsTest-989936466 tempest-VolumesActionsTest-989936466-project] 10.222.0.16 "GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5" status: 404 len: 111 microversion: 2.1 time: 0.060056 Mar 26 21:10:15.555518 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2579/4893] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:15 2022] GET /compute/v2.1/servers/1f96df0b-e511-4023-85ee-46dff0a647e5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:15.568935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.570340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.571939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.573249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.763767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:15.765139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:15.788207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.790523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:15.793614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:15.794129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:16.239340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:16.254671 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-764f476b-4499-46cf-b7e0-93f7676576aa tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.712666 Mar 26 21:10:16.258282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2315/4894] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:15 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:16.472205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:16.479883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b8c259d-26f1-4baf-b11f-5efc653e3bb9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.722167 Mar 26 21:10:16.492222 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2580/4895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:15 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:16.560213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:16.560882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:16.573117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:16.577086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:16.579708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:16.580268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:17.116896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1858914693", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "d44f6756-0914-4122-b1f7-731679a6fca5"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:17.249269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] validate_networks() for [('d44f6756-0914-4122-b1f7-731679a6fca5', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:10:17.446570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:17.461258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:17.466843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:17.474971 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27f3b596-e518-4922-8669-c0e2d2e3e300 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.918873 Mar 26 21:10:17.480425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2316/4896] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:16 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:17.495063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:17.500159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:17.521060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:17.524176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:17.527359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:17.528859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.284678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:18.294461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a0c27f1-b516-4de5-94b8-175f58adbc88 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1523 microversion: 2.1 time: 0.812017 Mar 26 21:10:18.295476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2317/4897] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:17 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1523 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:18.301114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:18.301731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:18.308742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.309761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.310905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.311621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.472406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:10:18.472958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:10:18.473220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:10:18.474286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:10:18.474894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:10:18.490153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.501015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.502039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.502507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.542206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:18.548715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Getting quotas for project 52b4455ec1a2447ebb1f737c0d97fc83. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:10:18.556822 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-504c9d98-04fa-4ae0-8f2a-9f47d408c8e8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.253985 Mar 26 21:10:18.560144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Getting quotas for user 54a09bedd0ad4328b1e687fc5f7e3967 and project 52b4455ec1a2447ebb1f737c0d97fc83. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:10:18.565900 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2318/4898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:18 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:18.585909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c75c4dd8-5d31-4b61-9343-ebb5e9ca8338 req-16387dc4-995f-4d13-b096-d62dbde319be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "0e9d94a8-a505-4bce-9e95-8b10eaee424e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:18.602830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:10:18.609351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:10:18.610477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c75c4dd8-5d31-4b61-9343-ebb5e9ca8338 req-16387dc4-995f-4d13-b096-d62dbde319be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.610931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c75c4dd8-5d31-4b61-9343-ebb5e9ca8338 req-16387dc4-995f-4d13-b096-d62dbde319be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.649032 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c75c4dd8-5d31-4b61-9343-ebb5e9ca8338 req-16387dc4-995f-4d13-b096-d62dbde319be service nova] Creating event network-changed:0e9d94a8-a505-4bce-9e95-8b10eaee424e for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:18.667089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c75c4dd8-5d31-4b61-9343-ebb5e9ca8338 req-16387dc4-995f-4d13-b096-d62dbde319be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098975 Mar 26 21:10:18.667715 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2319/4899] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:18.695287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:18.700613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:18.717988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.719468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.723305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:18.723980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:18.752208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9dee49ec-68e5-400f-a18c-b850f9910da3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640849 Mar 26 21:10:18.761231 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2581/4900] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:10:18.774160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83545094-1526-43ab-9725-3e5f09c821ab tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:18.796837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83545094-1526-43ab-9725-3e5f09c821ab tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:18.956859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-83545094-1526-43ab-9725-3e5f09c821ab tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:18.965648 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83545094-1526-43ab-9725-3e5f09c821ab tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1219 microversion: 2.1 time: 0.202896 Mar 26 21:10:18.971872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2582/4901] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:18 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:19.316984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:19.319057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:19.350377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:19.352058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:19.353181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:19.356269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:19.554059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:19.576379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:19.581175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:19.585920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-04c2c280-09a5-4bd2-b876-bfe586c931f2 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.905499 Mar 26 21:10:19.589275 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2320/4902] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:18 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:19.600381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:19.611127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:19.649600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:19.650391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:19.653595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:19.661256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:20.090781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:20.100774 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ccbef1f1-b792-4102-a1b4-05594c7b305e tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1503 microversion: 2.1 time: 0.792022 Mar 26 21:10:20.107085 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2583/4903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:19 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1503 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:20.112763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:20.121849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:20.167303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:20.168442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:20.174185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:20.174802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:20.297531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:20.310139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e865faf8-b3eb-4338-9ab1-76b15067b342 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1271 microversion: 2.1 time: 0.197016 Mar 26 21:10:20.311300 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2584/4904] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:20 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:20.313225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:20.321559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d6dbf4c-5c3f-4916-85a9-05ca93a0712b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.728987 Mar 26 21:10:20.329493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-821e9f0e-74b3-4547-a05e-08d6e951fd29 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'create', calling method: .version_select at 0x7f6e595d5f70>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1360048401", "description": "tempest-description-1207545279"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:20.335684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2321/4905] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:19 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:20.610329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:20.611889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:20.619175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:20.629316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:20.632931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:20.633616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:20.972958 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-821e9f0e-74b3-4547-a05e-08d6e951fd29 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.659930 Mar 26 21:10:20.973578 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2585/4906] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Mar 26 21:10:20 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:20.978364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7efe2194-5f02-4e79-9c31-f803cad0943e req-b635230d-f23b-46b7-a5fd-1f371c55fdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "e3b38732-461a-4f7b-b115-580ff04122e3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:21.000952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7efe2194-5f02-4e79-9c31-f803cad0943e req-b635230d-f23b-46b7-a5fd-1f371c55fdf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.001428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7efe2194-5f02-4e79-9c31-f803cad0943e req-b635230d-f23b-46b7-a5fd-1f371c55fdf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.027163 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7efe2194-5f02-4e79-9c31-f803cad0943e req-b635230d-f23b-46b7-a5fd-1f371c55fdf0 service nova] Creating event network-changed:e3b38732-461a-4f7b-b115-580ff04122e3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:21.037895 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7efe2194-5f02-4e79-9c31-f803cad0943e req-b635230d-f23b-46b7-a5fd-1f371c55fdf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062831 Mar 26 21:10:21.041305 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2586/4907] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:21.051150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1360048401"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:21.056988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:21.070035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.070498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.074654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.075132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.199119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:21.214185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:21.215702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:21.216912 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58612820-d612-44ab-ac3b-30530bbc55b9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.612004 Mar 26 21:10:21.231645 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2322/4908] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:20 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:21.329925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:21.336357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:21.353277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.353737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.354584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.355002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.590296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:21.597555 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.network.security_group_api [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Adding security group cd4269a5-a356-462e-a0be-f7dbb164591b to port ad307adc-02ff-4ad8-a6ff-b391aef67ac1 Mar 26 21:10:21.599029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-222c8a90-ff8a-467a-a84b-e860928d5bb8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1277 microversion: 2.1 time: 0.273190 Mar 26 21:10:21.613455 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2323/4909] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:21 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:21.630691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:21.631608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:21.647197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.650965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:21.653268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:21.655122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:22.023528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:22.032893 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d05319a8-9422-4f4e-a57b-da22e8be06e1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.418285 Mar 26 21:10:22.037171 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2324/4910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:21 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:22.238717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:22.239721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:22.250133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:22.252163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:22.254815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:22.255960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:22.757441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:22.767339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:22.778851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:22.782939 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a00659a6-698f-4d24-b185-5a616ed1c33e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.548082 Mar 26 21:10:22.785726 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2325/4911] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:22 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:22.800693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:22.802187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:22.819628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:22.820154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:22.824458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:22.824962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.477884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:23.488217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed33083a-453d-4eab-889f-f471f835cbac tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1277 microversion: 2.1 time: 0.701095 Mar 26 21:10:23.494954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2326/4912] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:22 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1277 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:23.508305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:23.509907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:23.524700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.525781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.529400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.530699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.813974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4ff9786-9874-4a9c-b0ac-3c6bbf8dc266 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action" status: 202 len: 0 microversion: 2.1 time: 2.771385 Mar 26 21:10:23.814597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2587/4913] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:21 2022] POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action => generated 0 bytes in 2773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:10:23.820232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:23.821231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:23.849072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:23.850417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.852044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.854117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.857300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.857567 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-94d6fd18-d58a-4f0c-ad9d-4625a890e85e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.359687 Mar 26 21:10:23.859022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2327/4914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:23 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:23.864650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1360048401"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:23.865254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:23.871423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.873249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:23.874824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:23.875251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:24.382502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.security_group_api [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Removing security group cd4269a5-a356-462e-a0be-f7dbb164591b from port ad307adc-02ff-4ad8-a6ff-b391aef67ac1 Mar 26 21:10:24.625465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:24.642501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:24.644441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:24.649929 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f01f622-c14b-44c4-aa12-c7cab8539129 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.834032 Mar 26 21:10:24.653151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2588/4915] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:23 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:24.664049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c3c7d137-ff89-4818-870e-d344ca984693 req-2034fba5-06fc-4ffa-beba-682af4e8df2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:24.685102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c3c7d137-ff89-4818-870e-d344ca984693 req-2034fba5-06fc-4ffa-beba-682af4e8df2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:24.685899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c3c7d137-ff89-4818-870e-d344ca984693 req-2034fba5-06fc-4ffa-beba-682af4e8df2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:24.710765 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c3c7d137-ff89-4818-870e-d344ca984693 req-2034fba5-06fc-4ffa-beba-682af4e8df2a service nova] Creating event network-changed:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:10:24.724534 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c3c7d137-ff89-4818-870e-d344ca984693 req-2034fba5-06fc-4ffa-beba-682af4e8df2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069704 Mar 26 21:10:24.725720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2589/4916] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:24.735195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:24.736991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:24.750101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:24.753968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:24.754985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:24.755607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:24.984636 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e272a21d-11ee-44e8-808c-d33db9087050 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action" status: 202 len: 0 microversion: 2.1 time: 1.124535 Mar 26 21:10:24.985980 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2328/4917] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:23 2022] POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:10:24.992557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:24.993514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:25.029129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:25.034255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:25.043131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:25.043779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:25.619666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:25.628964 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26c3867c-16d7-4e30-87c6-a46adef2ca74 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.641618 Mar 26 21:10:25.629553 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2329/4918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:24 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:25.657925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1f4ad134-da08-45b9-b5f6-2bc2bcb07ec9 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'create', calling method: .version_select at 0x7f6e59648a60>, body: {"pool": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:25.722553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:25.736380 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-480d7a4a-da58-4cb6-ab32-60dc793deaf6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 1.008955 Mar 26 21:10:25.737124 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2590/4919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:24 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:25.745093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fb951df3-6d03-4268-b352-c523b5327f0b req-5968568c-43fc-4a7f-b244-c78d29b00ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:25.760326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fb951df3-6d03-4268-b352-c523b5327f0b req-5968568c-43fc-4a7f-b244-c78d29b00ee2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:25.761306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fb951df3-6d03-4268-b352-c523b5327f0b req-5968568c-43fc-4a7f-b244-c78d29b00ee2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:25.794241 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fb951df3-6d03-4268-b352-c523b5327f0b req-5968568c-43fc-4a7f-b244-c78d29b00ee2 service nova] Creating event network-changed:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:10:25.803392 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fb951df3-6d03-4268-b352-c523b5327f0b req-5968568c-43fc-4a7f-b244-c78d29b00ee2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064559 Mar 26 21:10:25.804996 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2591/4920] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:25.813401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:25.815075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:25.826192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:25.827691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:25.828895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:25.829592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:26.484902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:26.501861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:26.511171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:26.516880 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40950d6b-1151-4d4a-9e57-b429e94d929a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.708213 Mar 26 21:10:26.518624 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2592/4921] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:25 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:26.649635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:26.651437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:26.661829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:26.668102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:26.669729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:26.670439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:27.164175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:27.176824 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85511d49-5f07-4f24-b645-de1d86156722 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.534412 Mar 26 21:10:27.178378 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2593/4922] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:26 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:27.183239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:27.189752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:27.204848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:27.205600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:27.206434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:27.206885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:27.642406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:27.663510 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac8f029a-b4eb-4fda-b427-f64b89dd8931 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.483058 Mar 26 21:10:27.665130 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2594/4923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:27 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:27.674225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-117dcaa3-7e5a-487e-8a7c-3f8fc4231341 req-214d4017-4fc9-4939-b6ef-f5bd3e5adfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc597171-1f7d-43d9-b979-ca9c34c23f5a", "tag": "c8337db8-8ace-411f-91d0-9557a19ab3e1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:27.695692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-117dcaa3-7e5a-487e-8a7c-3f8fc4231341 req-214d4017-4fc9-4939-b6ef-f5bd3e5adfac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:27.698574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-117dcaa3-7e5a-487e-8a7c-3f8fc4231341 req-214d4017-4fc9-4939-b6ef-f5bd3e5adfac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:27.727075 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-117dcaa3-7e5a-487e-8a7c-3f8fc4231341 req-214d4017-4fc9-4939-b6ef-f5bd3e5adfac service nova] Creating event network-changed:c8337db8-8ace-411f-91d0-9557a19ab3e1 for instance fc597171-1f7d-43d9-b979-ca9c34c23f5a on nch2-master-1 Mar 26 21:10:27.751218 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-117dcaa3-7e5a-487e-8a7c-3f8fc4231341 req-214d4017-4fc9-4939-b6ef-f5bd3e5adfac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081207 Mar 26 21:10:27.753817 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2595/4924] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:27.795859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:27.800557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:27.817919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:27.823689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:27.825214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:27.826241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:29.249370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:29.283354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:29.292196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:29.302584 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d46b8207-8fe4-4580-8e7a-97f5647b4b03 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 1.545819 Mar 26 21:10:29.308291 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2596/4925] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:27 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:29.350835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:29.352869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:29.372648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:29.376249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:29.379693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:29.380191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:29.822384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:29.839124 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7efb2ae-856f-4d55-940c-acfa38502639 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.507490 Mar 26 21:10:29.840069 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2597/4926] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:29 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:29.854357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:29.855408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:29.868555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:29.872180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:29.873803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:29.874675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.149640 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1f4ad134-da08-45b9-b5f6-2bc2bcb07ec9 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.504277 Mar 26 21:10:30.150847 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2330/4927] 10.222.0.16 () {60 vars in 1169 bytes} [Sat Mar 26 21:10:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:30.164261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.27"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:30.165437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:30.173947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.174678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.175644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.176275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.206220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Acquired lock "refresh_cache-c845f296-4458-4f09-8fe7-570578d42bea" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 21:10:30.369448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:30.385455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ad0bb39-2668-48b1-9352-b2368ae71a77 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.541873 Mar 26 21:10:30.386232 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2598/4928] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:29 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:30.401648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:30.402281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:30.417924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.418598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.419583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.420223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.703223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:30.715162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:30.717405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:30.718739 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1bbd9b1-6063-454d-97d3-aed97bb765ed tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.330944 Mar 26 21:10:30.719791 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2599/4929] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:30 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:30.857463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:30.858361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:30.869990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.870740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:30.872776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:30.873925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:31.146154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:31.167258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1982e714-67b5-4800-910d-89276254b956 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.314091 Mar 26 21:10:31.168465 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2600/4930] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:30 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:31.418315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:31.421078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:31.443459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:31.454955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:31.456784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:31.458066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:31.970191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:31.995325 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2e17ab90-75f2-49d4-be3d-49f6f2a05222 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.595205 Mar 26 21:10:31.996692 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2601/4931] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:31 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:32.013806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:32.017934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:32.037531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:32.038703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:32.042068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:32.042995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:32.531881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:32.547013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:32.549548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:32.551477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62a22b02-40ca-4646-86a4-38e28f943c10 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.553134 Mar 26 21:10:32.565665 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2602/4932] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:31 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:32.572857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:32.573973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:32.585792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:32.587799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:32.588663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:32.589107 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:32.879113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:32.887086 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0702b17-e676-43fd-ae8b-4061f33edcd5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.320257 Mar 26 21:10:32.892659 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2603/4933] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:32 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:33.028952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:33.030485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:33.042434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:33.043242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:33.044289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:33.048193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:33.334936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Building network info cache for instance {{(pid=141580) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 21:10:33.355944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:33.374447 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e76397f6-7cc5-493a-a099-767985359775 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.357429 Mar 26 21:10:33.379465 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2604/4934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:33 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:33.395658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-bc11c80b-e8d8-4ba8-84ab-c3d90f5b9d2e req-1774f45b-3afc-4746-af77-324efd5b8231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:33.427084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bc11c80b-e8d8-4ba8-84ab-c3d90f5b9d2e req-1774f45b-3afc-4746-af77-324efd5b8231 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:33.431760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bc11c80b-e8d8-4ba8-84ab-c3d90f5b9d2e req-1774f45b-3afc-4746-af77-324efd5b8231 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:33.473904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-bc11c80b-e8d8-4ba8-84ab-c3d90f5b9d2e req-1774f45b-3afc-4746-af77-324efd5b8231 service nova] Creating event network-changed:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:10:33.502450 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-bc11c80b-e8d8-4ba8-84ab-c3d90f5b9d2e req-1774f45b-3afc-4746-af77-324efd5b8231 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121363 Mar 26 21:10:33.503646 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2605/4935] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:33.575170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:33.576657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:33.593263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:33.594040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:33.598158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:33.599660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:34.142646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:34.153662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:34.156070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:34.157745 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ed8ce6e-94da-44a7-90ef-0a8effaba045 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.589723 Mar 26 21:10:34.158830 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2606/4936] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:33 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:34.165115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:34.165951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:34.174628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:34.175732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:34.176786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:34.177472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:34.415896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:34.457493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7bb59fcc-c67e-4d88-8ea2-a57e26009748 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.297138 Mar 26 21:10:34.458581 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2607/4937] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:34 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:34.469589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:34.472083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:34.486444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:34.489020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:34.492896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:34.493703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:34.825686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:34.839473 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b36ef125-45b4-4f0b-b60b-d2f04814eb67 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.378923 Mar 26 21:10:34.840043 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2608/4938] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:34 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:35.177518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:35.178152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:35.202456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:35.202894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:35.203889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:35.204517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:35.694872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:35.709064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:35.711556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:35.713031 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d08df346-c974-4292-ae43-c1cf32489c5f tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.540631 Mar 26 21:10:35.714230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2609/4939] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:35 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:35.720737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:35.721571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:35.728878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:35.729863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:35.732553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:35.733547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.040083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:36.050350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d248752a-0b0c-4bb9-844c-e5eab2f8d5a9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.334327 Mar 26 21:10:36.051855 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2610/4940] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:35 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:36.068931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:36.070074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:36.078436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.089809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.092052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.093285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.343625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:36.355110 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7621b0f-b30c-449b-97f6-2a314d5b1326 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.298846 Mar 26 21:10:36.356809 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2611/4941] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:36 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:36.433563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Updating instance_info_cache with network_info: [{"id": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1", "address": "fa:16:3e:f8:af:0d", "network": {"id": "80821142-5907-4abd-9c14-6a6046396839", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-170183391-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "97d8cf03facb404b81a31014cf74f93c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad307adc-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141580) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 21:10:36.451064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Releasing lock "refresh_cache-c845f296-4458-4f09-8fe7-570578d42bea" {{(pid=141580) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 21:10:36.451947 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5d73be47-c2d8-42f7-9f76-55abe68b8559 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action" status: 202 len: 0 microversion: 2.1 time: 6.293868 Mar 26 21:10:36.452575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2331/4942] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:30 2022] POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action => generated 0 bytes in 6295 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 21:10:36.462188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.27"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:36.731612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:36.736436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:36.745030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.746217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.747196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.748386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.807547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:36.819141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.819598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:36.820526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:36.821153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:37.214725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:37.231559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:37.234674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Acquired lock "refresh_cache-c845f296-4458-4f09-8fe7-570578d42bea" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 26 21:10:37.238820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:37.243024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa6b29d9-337e-4f32-aa8d-cb4a9c78366b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.515388 Mar 26 21:10:37.250233 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2332/4943] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:36 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:37.274548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:37.276208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:37.321137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:37.324540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:37.327457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:37.328225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:37.662841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:37.673228 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed09a790-71ac-43b9-9608-fd036d76ae82 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1533 microversion: 2.1 time: 0.420205 Mar 26 21:10:37.678117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2333/4944] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:37 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1533 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:37.695737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:37.702397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:37.737632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:37.744570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:37.748932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:37.751353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:38.091293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:38.109410 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c043d6a-0486-46c3-921d-c5f542387300 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.425040 Mar 26 21:10:38.110243 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2334/4945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:37 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:38.115988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ddf47070-572c-446b-bc28-7b10538a7240 req-1a24d990-1b4a-44e0-9d1d-04eb62e459cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "9067d489-90c2-49f5-9304-a67efb091ee3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:38.150065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ddf47070-572c-446b-bc28-7b10538a7240 req-1a24d990-1b4a-44e0-9d1d-04eb62e459cd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:38.151874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ddf47070-572c-446b-bc28-7b10538a7240 req-1a24d990-1b4a-44e0-9d1d-04eb62e459cd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:38.193217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ddf47070-572c-446b-bc28-7b10538a7240 req-1a24d990-1b4a-44e0-9d1d-04eb62e459cd service nova] Creating event network-vif-plugged:9067d489-90c2-49f5-9304-a67efb091ee3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:38.212410 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ddf47070-572c-446b-bc28-7b10538a7240 req-1a24d990-1b4a-44e0-9d1d-04eb62e459cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098088 Mar 26 21:10:38.213406 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2335/4946] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:38.313244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:38.314264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:38.322180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:38.328263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:38.334520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:38.335251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:38.672777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Building network info cache for instance {{(pid=141581) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 26 21:10:38.851428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:38.863585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:38.865751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:38.868532 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a5bd7f1b-c8cc-4753-ae4d-0cd5317bbb17 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.606489 Mar 26 21:10:38.869815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2336/4947] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:38 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:38.878220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9a563f1e-bbc2-4b12-ac5a-4e5e8ca1c614 req-0ec12e61-233d-41bf-87e6-a8b19b7cfdfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:38.887881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a563f1e-bbc2-4b12-ac5a-4e5e8ca1c614 req-0ec12e61-233d-41bf-87e6-a8b19b7cfdfa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:38.888553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a563f1e-bbc2-4b12-ac5a-4e5e8ca1c614 req-0ec12e61-233d-41bf-87e6-a8b19b7cfdfa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:38.929993 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9a563f1e-bbc2-4b12-ac5a-4e5e8ca1c614 req-0ec12e61-233d-41bf-87e6-a8b19b7cfdfa service nova] Creating event network-changed:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:10:38.960259 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9a563f1e-bbc2-4b12-ac5a-4e5e8ca1c614 req-0ec12e61-233d-41bf-87e6-a8b19b7cfdfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087920 Mar 26 21:10:38.964658 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2337/4948] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:38.990046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:38.996016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:39.020450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:39.023500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:39.026517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:39.031555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.080290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:40.100216 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1518eab4-d19c-4a07-8c2f-0a00eddce9c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1533 microversion: 2.1 time: 1.133849 Mar 26 21:10:40.104476 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2338/4949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:38 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1533 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:40.110281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:40.116592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:40.130990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:40.135230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.136390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:40.136943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.587649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:40.601362 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a0f9581-9d9d-4bca-b8bd-9fcafc92dc5e tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.495401 Mar 26 21:10:40.610661 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2339/4950] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:40 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:40.610661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:40.610661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:40.640042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:40.642190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.644843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:40.645321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.690281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Updating instance_info_cache with network_info: [{"id": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1", "address": "fa:16:3e:f8:af:0d", "network": {"id": "80821142-5907-4abd-9c14-6a6046396839", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-170183391-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "97d8cf03facb404b81a31014cf74f93c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad307adc-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141581) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 26 21:10:40.704414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Releasing lock "refresh_cache-c845f296-4458-4f09-8fe7-570578d42bea" {{(pid=141581) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 26 21:10:40.705644 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-079eb53c-4abc-4a3f-8839-58e6c1b2b5f4 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action" status: 202 len: 0 microversion: 2.1 time: 4.247923 Mar 26 21:10:40.709666 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2612/4951] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:10:36 2022] POST /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea/action => generated 0 bytes in 4253 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 26 21:10:40.722811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc597171-1f7d-43d9-b979-ca9c34c23f5a", "name": "network-vif-plugged", "status": "completed", "tag": "c8337db8-8ace-411f-91d0-9557a19ab3e1"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d882432-9513-4f42-8117-c2eae00858b5"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "9f26816b-64ca-4f6e-bc7f-0723c5bf7f79"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "3776e0f7-2a1d-4dbf-b7ac-963e98079436"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:40.735288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:40.736118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:40.756519 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Creating event network-vif-plugged:c8337db8-8ace-411f-91d0-9557a19ab3e1 for instance fc597171-1f7d-43d9-b979-ca9c34c23f5a on nch2-master-1 Mar 26 21:10:40.757599 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Creating event network-vif-plugged:9d882432-9513-4f42-8117-c2eae00858b5 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:40.758286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Creating event network-vif-plugged:9f26816b-64ca-4f6e-bc7f-0723c5bf7f79 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:40.759225 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] Creating event network-vif-plugged:3776e0f7-2a1d-4dbf-b7ac-963e98079436 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:40.770543 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5f83b11a-a06f-43d3-92e6-e896ee590d03 req-a2255855-5af8-495a-afe3-aa1251b2cc71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.057472 Mar 26 21:10:40.771427 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2613/4952] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:40.792596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebf098f2-668d-44a8-b808-9324c856264f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '.version_select at 0x7f6e4be68280>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:41.466198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:41.493270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:41.513279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:41.517144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f299ff5d-0aa0-4143-ace7-6003ad757ded tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.913882 Mar 26 21:10:41.522309 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2340/4953] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:40 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:41.539805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:41.541745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:41.564075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:41.571465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:41.573325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:41.577721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:41.878509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:41.892975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cea485a9-8876-425c-94e5-0c7493a083ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.368621 Mar 26 21:10:41.893926 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2341/4954] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:41 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:41.899009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:41.900502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:41.907805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:41.908518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:41.910038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:41.910808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:42.287117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:42.300984 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d7cb4798-58a5-40e3-af1e-1044324554f5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1319 microversion: 2.1 time: 0.404814 Mar 26 21:10:42.302880 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2342/4955] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:41 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:42.543226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:42.543990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:42.557396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:42.561859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:42.562831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:42.563399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:43.082238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:43.099610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:43.101414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:43.108502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e86160d7-84b9-43ee-98dc-43009dc8c38e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.571671 Mar 26 21:10:43.111721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2343/4956] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:42 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:43.125478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "22b73853-ba48-4af3-b54b-5bc85d9fee52"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "0e9d94a8-a505-4bce-9e95-8b10eaee424e"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-plugged", "status": "completed", "tag": "e3b38732-461a-4f7b-b115-580ff04122e3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:43.146394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:43.150706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:43.186878 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Creating event network-vif-plugged:22b73853-ba48-4af3-b54b-5bc85d9fee52 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:43.198146 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Creating event network-vif-plugged:0e9d94a8-a505-4bce-9e95-8b10eaee424e for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:43.203982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] Creating event network-vif-plugged:e3b38732-461a-4f7b-b115-580ff04122e3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:43.220062 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e575ee68-a08e-4e93-b71a-7e932e56986f req-48051070-a32f-490c-a220-37d3fe89c454 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.106692 Mar 26 21:10:43.221069 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2344/4957] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:43.231109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:43.237876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:43.258049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:43.259360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:43.264243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:43.265311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:43.736196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:43.757285 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ee6cbc00-05bc-49b2-808b-6487e80dbf3d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.534738 Mar 26 21:10:43.769469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebf098f2-668d-44a8-b808-9324c856264f tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/e2a0edc4-6c1c-4e8c-9937-c1b2030f5b04" status: 202 len: 0 microversion: 2.1 time: 2.992395 Mar 26 21:10:43.773592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2614/4958] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 21:10:40 2022] DELETE /compute/v2.1/os-floating-ips/e2a0edc4-6c1c-4e8c-9937-c1b2030f5b04 => generated 0 bytes in 2994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:10:43.774248 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2345/4959] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:43 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:43.775448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:43.777627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:43.790566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-102ae0e4-3e83-4551-9607-ee5f2f9459ef tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '.version_select at 0x7f6e58616280>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:43.801727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:43.804877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:43.814452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:43.814953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.243153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:44.263320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2ee75bb-fbe3-4f49-9743-b2517574c1b2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1507 microversion: 2.1 time: 0.491225 Mar 26 21:10:44.264373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2615/4960] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:43 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:44.277710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:44.284528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:44.296765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.297713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.298769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.299377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.719797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-102ae0e4-3e83-4551-9607-ee5f2f9459ef tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cd4269a5-a356-462e-a0be-f7dbb164591b" status: 202 len: 0 microversion: 2.1 time: 0.942985 Mar 26 21:10:44.720522 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2346/4961] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 21:10:43 2022] DELETE /compute/v2.1/os-security-groups/cd4269a5-a356-462e-a0be-f7dbb164591b => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:10:44.729373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:44.731355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:44.742969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.747546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.748905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.751796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.765892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:44.784067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:44.785709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:44.787001 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-20ac97a7-dbdb-4580-99c6-c16d03036b57 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1880 microversion: 2.42 time: 0.521074 Mar 26 21:10:44.800638 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2616/4962] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:44 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1880 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:10:44.822279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:44.822850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:44.825269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:10:44.841151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.847857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:44.848995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:44.849493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.178193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:45.181250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ada834c-742b-4116-be2c-d270e976a181 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 204 len: 0 microversion: 2.1 time: 0.454868 Mar 26 21:10:45.190252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2347/4963] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:10:44 2022] DELETE /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:10:45.191035 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72581075-1d78-4aa8-82a1-b7d776eeffd8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.387233 Mar 26 21:10:45.192963 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2617/4964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:44 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:45.223686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:45.224447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:45.248984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7fdc9c8b-ca7f-4a58-a946-b3c6d422db9a req-3c9a5554-1e1f-4171-9635-25eb6c958483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "name": "network-vif-plugged", "status": "completed", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:45.252510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:45.253034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.264402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:45.264930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.284718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7fdc9c8b-ca7f-4a58-a946-b3c6d422db9a req-3c9a5554-1e1f-4171-9635-25eb6c958483 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:45.285194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7fdc9c8b-ca7f-4a58-a946-b3c6d422db9a req-3c9a5554-1e1f-4171-9635-25eb6c958483 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.341659 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7fdc9c8b-ca7f-4a58-a946-b3c6d422db9a req-3c9a5554-1e1f-4171-9635-25eb6c958483 service nova] Creating event network-vif-plugged:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:10:45.373595 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7fdc9c8b-ca7f-4a58-a946-b3c6d422db9a req-3c9a5554-1e1f-4171-9635-25eb6c958483 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128507 Mar 26 21:10:45.389370 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2618/4965] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:45.824739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:45.827399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:45.834863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:45.860002 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24470bf5-7b6e-4ab5-965b-e2bfbde9cfb0 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1509 microversion: 2.1 time: 0.665117 Mar 26 21:10:45.868612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:45.870742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.871892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:45.876535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:45.883213 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2348/4966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:45 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1509 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:46.210963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:46.211596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:46.220696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.221165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:46.221991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.222449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:46.414442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:46.430529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:46.439796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:46.445056 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-feb7873f-ab61-432a-9fd3-a2753355cc2e tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2839 microversion: 2.42 time: 0.627987 Mar 26 21:10:46.446623 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2619/4967] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:10:45 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2839 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:46.468023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:46.469652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:46.481238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.490153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:46.492352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.493027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:46.745190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:46.764029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3a2c078-c126-44a0-b483-ca184cc229b1 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.556916 Mar 26 21:10:46.773752 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2349/4968] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:46 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:46.845697 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1dd5677e-9dc5-4aa6-884d-2eebc491af5a tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.382225 Mar 26 21:10:46.847596 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2620/4969] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:10:46 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1/os-interface => generated 1832 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 26 21:10:46.895421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:46.896086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:46.926341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.928286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:46.933040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:46.939009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:47.535387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:47.546888 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-158254c5-64d8-4cb0-864a-ee9e49f24921 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1509 microversion: 2.1 time: 0.656995 Mar 26 21:10:47.556367 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2350/4970] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:46 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1509 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:47.782617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:47.783392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:47.816144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:47.816532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:47.817345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:47.817790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:48.323554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:48.332264 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-689901b0-a9f1-4325-8374-d02f7dd842ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.555034 Mar 26 21:10:48.343203 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2621/4971] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:48.568403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:48.569302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:48.597638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:48.598060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:48.599052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:48.599364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:49.360905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:49.361502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:49.391178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:49.391662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:49.392519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:49.396586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:49.733792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:49.742736 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9831803f-ef34-4bcb-868a-e7a3d01390e7 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1509 microversion: 2.1 time: 1.179901 Mar 26 21:10:49.743562 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2351/4972] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:48 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1509 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:49.777953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d8e8f830-cbd6-41ce-8e10-b4b7baecb66a req-29e3ae6b-0ae6-4181-b33b-ff1298742746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "tag": "22b73853-ba48-4af3-b54b-5bc85d9fee52"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:49.813609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d8e8f830-cbd6-41ce-8e10-b4b7baecb66a req-29e3ae6b-0ae6-4181-b33b-ff1298742746 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:49.821684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d8e8f830-cbd6-41ce-8e10-b4b7baecb66a req-29e3ae6b-0ae6-4181-b33b-ff1298742746 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:49.863708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d8e8f830-cbd6-41ce-8e10-b4b7baecb66a req-29e3ae6b-0ae6-4181-b33b-ff1298742746 service nova] Creating event network-changed:22b73853-ba48-4af3-b54b-5bc85d9fee52 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:10:49.906367 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d8e8f830-cbd6-41ce-8e10-b4b7baecb66a req-29e3ae6b-0ae6-4181-b33b-ff1298742746 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152080 Mar 26 21:10:49.907589 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2352/4973] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:49.989191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:49.998317 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32286891-cc40-43ea-b015-1ed28f32e766 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.642653 Mar 26 21:10:49.998916 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2622/4974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:10:50.764642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:50.784433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:50.784433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:50.784433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:50.784433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:50.784433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:51.015324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:51.019400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:51.048090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:51.048861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:51.049886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:51.050616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:51.596799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:51.610151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91295865-1572-4a00-a741-b1014ae25ee3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.597959 Mar 26 21:10:51.611111 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2623/4975] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:52.303321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e069c88bde243a39d59ee5a170f5094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d8cf03facb404b81a31014cf74f93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:52.315749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2a321696-6a87-4df2-956e-e080cf0f0e90 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 200 len: 1509 microversion: 2.1 time: 1.556612 Mar 26 21:10:52.325903 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2353/4976] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:50 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 1509 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:52.537972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1ff8e4ea-a0ae-46c3-bcd5-ad796a8d7a97 req-f68def4c-da2a-4a76-b941-e749ff22ef44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c845f296-4458-4f09-8fe7-570578d42bea", "name": "network-vif-deleted", "tag": "ad307adc-02ff-4ad8-a6ff-b391aef67ac1"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:52.574082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1ff8e4ea-a0ae-46c3-bcd5-ad796a8d7a97 req-f68def4c-da2a-4a76-b941-e749ff22ef44 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:52.574490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1ff8e4ea-a0ae-46c3-bcd5-ad796a8d7a97 req-f68def4c-da2a-4a76-b941-e749ff22ef44 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:52.615768 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1ff8e4ea-a0ae-46c3-bcd5-ad796a8d7a97 req-f68def4c-da2a-4a76-b941-e749ff22ef44 service nova] Creating event network-vif-deleted:ad307adc-02ff-4ad8-a6ff-b391aef67ac1 for instance c845f296-4458-4f09-8fe7-570578d42bea on nch1-master-1 Mar 26 21:10:52.629029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:52.629974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:52.658428 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1ff8e4ea-a0ae-46c3-bcd5-ad796a8d7a97 req-f68def4c-da2a-4a76-b941-e749ff22ef44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130414 Mar 26 21:10:52.659093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:52.659620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2624/4977] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:52.660179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:52.662385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:52.662868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:52.941711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:52.952874 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d42f4a53-f785-44d2-865e-d0afb13116ef tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.328795 Mar 26 21:10:52.962711 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2354/4978] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:52 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:53.333880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:53.334580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] [instance: c845f296-4458-4f09-8fe7-570578d42bea] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:53.347514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:53.355164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:53.358684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:53.362324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:53.410359 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] HTTP exception thrown: Instance c845f296-4458-4f09-8fe7-570578d42bea could not be found. Mar 26 21:10:53.413548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] Returning 404 to user: Instance c845f296-4458-4f09-8fe7-570578d42bea could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:10:53.418770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c46944d4-b02c-4c47-9d84-b0ba01564571 tempest-ServerRescueTestJSONUnderV235-519423541 tempest-ServerRescueTestJSONUnderV235-519423541-project] 10.222.0.16 "GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea" status: 404 len: 111 microversion: 2.1 time: 0.088647 Mar 26 21:10:53.422773 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2625/4979] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:53 2022] GET /compute/v2.1/servers/c845f296-4458-4f09-8fe7-570578d42bea => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:53.969791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:53.970401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:53.990355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:53.991208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:53.999231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:54.001524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:54.540298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:54.553193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6491d25-076b-430a-9b7e-c6960a289d12 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.584342 Mar 26 21:10:54.554229 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2355/4980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:53 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:55.570992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:55.575019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:55.603580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:55.606185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:55.610234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:55.611010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:55.993540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:56.005566 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a2224e1-bde5-4a1f-a120-35ec6266d76d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.438994 Mar 26 21:10:56.011218 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2626/4981] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:55 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:57.033068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:57.034930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:57.049217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:57.051215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:57.053572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:57.055950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:57.796079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:57.807521 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-649f3b26-a32d-4de4-ad86-a1e0f78e6170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.781471 Mar 26 21:10:57.813465 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2356/4982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:58.470294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c90bcbd0-9a75-48e6-a516-481e089658af", "device": "/dev/sdb"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:10:58.472932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:58.504550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:58.505027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:58.505846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:58.506297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:58.829773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:10:58.830401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:10:58.841752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:58.842160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:58.842970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:10:58.843392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:10:59.020097 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ef7edd9-ba4d-44bc-bf4d-8431f736cbd9 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "POST /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557472 Mar 26 21:10:59.027269 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2627/4983] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:10:58 2022] POST /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:10:59.743490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:10:59.763998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9322e383-1937-42ca-9ec6-179ce35822ff tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.935571 Mar 26 21:10:59.774314 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2357/4984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:10:58 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:00.794686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:00.795395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:00.806277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:00.806979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:00.809457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:00.810071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:01.234944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:01.246579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-668d08fe-bf19-421b-b245-de5b719ff8e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.459234 Mar 26 21:11:01.260096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2628/4985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:00 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:02.266789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:02.268179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:02.290957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:02.294247 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:02.295315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:02.297707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:02.719728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:02.733764 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce8fbd43-8c63-4554-bcbe-d25ccba02c2b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.471622 Mar 26 21:11:02.740559 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2358/4986] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:02 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:03.757437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:03.757437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:03.767332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:03.767786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:03.770974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:03.772852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:04.075513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-276756845", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:04.182972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:11:04.255949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:04.263558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0243c1b-eda1-4f70-8790-3a95a31c5379 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1528 microversion: 2.1 time: 0.512322 Mar 26 21:11:04.264198 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2629/4987] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:03 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1528 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:04.680745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:11:04.681414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:11:04.682115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:11:04.682534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:11:04.683004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:11:04.706760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:04.707475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:04.708378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:04.709082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:04.734308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Getting quotas for project 13edcc6f41ce42ff8b88edb21a3ae4ec. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:11:04.744173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Getting quotas for user 579df559018e45808c3886ac22ecc165 and project 13edcc6f41ce42ff8b88edb21a3ae4ec. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:11:04.770096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:11:04.777689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:11:04.837544 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-05fe593c-3fa6-461d-af78-4a938a381446 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768033 Mar 26 21:11:04.838247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2359/4988] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:11:04.849227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6bc02fb-678e-43d4-aa7b-a821cedae35f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:04.849903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6bc02fb-678e-43d4-aa7b-a821cedae35f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:04.935613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6bc02fb-678e-43d4-aa7b-a821cedae35f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:04.944953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6bc02fb-678e-43d4-aa7b-a821cedae35f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1213 microversion: 2.1 time: 0.099809 Mar 26 21:11:04.945789 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2630/4989] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:04 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:05.282300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:05.283550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:05.298600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:05.299879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:05.300743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:05.301203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:05.392271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c196f2e1-439d-4eb0-b686-25f0ea9bf032 tempest-ExtensionsTest-1293613877 tempest-ExtensionsTest-1293613877-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:05.394379 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c196f2e1-439d-4eb0-b686-25f0ea9bf032 tempest-ExtensionsTest-1293613877 tempest-ExtensionsTest-1293613877-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.271629 Mar 26 21:11:05.395323 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2360/4990] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Mar 26 21:11:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:05.407442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed846834-4f35-4477-8649-98bf9e02e273 tempest-ExtensionsTest-1293613877 tempest-ExtensionsTest-1293613877-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:05.414266 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed846834-4f35-4477-8649-98bf9e02e273 tempest-ExtensionsTest-1293613877 tempest-ExtensionsTest-1293613877-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008803 Mar 26 21:11:05.415694 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2361/4991] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 21:11:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:11:05.707219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:05.727419 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f36012e-6df5-4917-abc8-fa090420bbd4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1510 microversion: 2.1 time: 0.445822 Mar 26 21:11:05.740750 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2631/4992] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:05 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:05.963788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:05.964756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:05.973374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:05.973842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:05.974812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:05.975475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:06.088813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:06.097701 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af929c2a-6515-4cdc-b000-e4d9e3eb5a6f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1265 microversion: 2.1 time: 0.138877 Mar 26 21:11:06.109045 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2362/4993] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:05 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:06.756069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:06.757581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:06.766236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:06.766959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:06.767939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:06.768548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:06.965403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:06.977585 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6c58b654-7b73-472c-a364-f426abebb6d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1510 microversion: 2.1 time: 0.226187 Mar 26 21:11:06.978970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2632/4994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:06 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:07.114615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:07.115241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:07.125581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6ca49546-8972-42d6-a668-2969ae0f79bb req-7ff76e15-093a-49f8-957c-34286cdee387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "name": "network-vif-unplugged", "status": "completed", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:07.133243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:07.133702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:07.134487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:07.134927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:07.139838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ca49546-8972-42d6-a668-2969ae0f79bb req-7ff76e15-093a-49f8-957c-34286cdee387 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:07.143027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ca49546-8972-42d6-a668-2969ae0f79bb req-7ff76e15-093a-49f8-957c-34286cdee387 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:07.170535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6ca49546-8972-42d6-a668-2969ae0f79bb req-7ff76e15-093a-49f8-957c-34286cdee387 service nova] Creating event network-vif-unplugged:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:11:07.176317 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6ca49546-8972-42d6-a668-2969ae0f79bb req-7ff76e15-093a-49f8-957c-34286cdee387 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054844 Mar 26 21:11:07.179433 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2633/4995] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:11:07.272135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:07.280889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73c0d9fa-6b2a-400c-8e51-f54632a20afd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1271 microversion: 2.1 time: 0.170045 Mar 26 21:11:07.282049 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2363/4996] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:07 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:08.000084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:08.002001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.017233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.018620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.020818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.021552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.279075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:08.289132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2fb6e29-d5ae-4de6-8282-3040d1b67b31 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1453 microversion: 2.1 time: 0.295014 Mar 26 21:11:08.289791 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2634/4997] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:07 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1453 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:08.301019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:08.301019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.307749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:08.309497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.317746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.318630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.319068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.319604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.320251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.320595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.321123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.321237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.508568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:08.522740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:08.530708 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11fbc79f-5236-4877-a7a2-58c8a508143d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1453 microversion: 2.1 time: 0.227258 Mar 26 21:11:08.531874 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2635/4998] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:08 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:08.533091 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f402019-1f88-4cde-9cb9-44024d5471fe tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1271 microversion: 2.1 time: 0.238798 Mar 26 21:11:08.533858 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2364/4999] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:08 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:08.585301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:08.586360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.597229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.598059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.599192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.600120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.634960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lazy-loading 'flavor' on Instance uuid 40a24185-11da-4355-9203-d4bc0e5eeb51 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:11:08.651980 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'shelve' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state shelved_offloaded Mar 26 21:11:08.653321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'shelve' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state shelved_offloaded {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:08.655410 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-86c5d718-06de-481e-bc6c-9a7e4f55a6ae tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 155 microversion: 2.1 time: 0.076900 Mar 26 21:11:08.656016 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2636/5000] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:08 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:11:08.668153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:08.669673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.677740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.678320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.679413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.680053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.823158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a845c45-d802-4794-82ee-18fdcae4faa3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.160673 Mar 26 21:11:08.824744 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2365/5001] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:08 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:11:08.846404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:08.849925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:08.870978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.874882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:08.876974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:08.877751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:09.171190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:09.187351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48bbcb02-2df1-459e-b405-21f73774ae76 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1461 microversion: 2.1 time: 0.357861 Mar 26 21:11:09.188329 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2637/5002] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:08 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1461 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:09.551824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:09.552462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:09.570209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:09.570867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:09.572559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:09.573562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:10.206566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:10.207878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:10.216450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:10.217010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:10.218199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:10.218725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:10.549695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:10.552605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:10.560591 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3990ada0-dc01-43d7-9281-4c0a1409e16c tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 1.014006 Mar 26 21:11:10.561453 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2366/5003] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:09 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:10.564158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ff25a686-ac53-4a27-94d2-8834c440656b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1461 microversion: 2.1 time: 0.361493 Mar 26 21:11:10.564948 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2638/5004] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:10 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1461 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:11.584232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:11.584858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:11.586087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:11.587852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:11.599995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:11.601302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:11.602589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:11.605141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:11.605352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:11.607891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:11.610184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:11.612498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:12.454365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:12.462225 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ee1bad9f-355e-4e97-ba54-63241a890a09 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 0.885002 Mar 26 21:11:12.462818 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2367/5005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:11 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:12.477566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:12.497132 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-146f64e7-3596-4770-a7cf-4f6c7e9b3f5f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.914260 Mar 26 21:11:12.497756 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2639/5006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:11 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:12.763342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e18219d6-5172-45d8-b39b-965cb0a0a4e1 req-0adbe23c-b53b-4b34-8f0c-24edf071735a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60bf36a-bee8-4128-8ecd-d9905bc27d10", "tag": "d918e07f-e0c2-435d-872d-f275cd4abfff"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:12.787029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e18219d6-5172-45d8-b39b-965cb0a0a4e1 req-0adbe23c-b53b-4b34-8f0c-24edf071735a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:12.787755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e18219d6-5172-45d8-b39b-965cb0a0a4e1 req-0adbe23c-b53b-4b34-8f0c-24edf071735a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:12.827762 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e18219d6-5172-45d8-b39b-965cb0a0a4e1 req-0adbe23c-b53b-4b34-8f0c-24edf071735a service nova] Creating event network-changed:d918e07f-e0c2-435d-872d-f275cd4abfff for instance f60bf36a-bee8-4128-8ecd-d9905bc27d10 on nch1-master-1 Mar 26 21:11:12.843595 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e18219d6-5172-45d8-b39b-965cb0a0a4e1 req-0adbe23c-b53b-4b34-8f0c-24edf071735a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083224 Mar 26 21:11:12.845185 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2368/5007] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:13.492172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:13.493001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:13.520943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:13.523798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:13.564243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:13.564924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:13.569102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:13.570537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:13.571048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:13.575356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:13.590833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:13.593119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:14.193923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:14.201768 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7506db4-fbcb-4a12-be49-52bf037ccff6 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 0.724182 Mar 26 21:11:14.202361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2640/5008] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:13 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:14.463805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:14.475153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-add29063-0c71-4f88-a24c-5ceb08d32f48 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.964285 Mar 26 21:11:14.478157 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2369/5009] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:13 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:15.219145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:15.220123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:15.250270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:15.250739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:15.251541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:15.260988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:15.497581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:15.498207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:15.522385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:15.524613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:15.528407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:15.529284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:16.725323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:16.750431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a22fabb-4cf2-4e92-94c4-d173d0ede692 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 1.531548 Mar 26 21:11:16.752117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2641/5010] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:15 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:17.327724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:17.359173 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-888c8e21-1343-4019-ab05-6ce50378fa25 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 1.867553 Mar 26 21:11:17.362463 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2370/5011] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:15 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:17.768642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:17.769988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:17.837311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:17.837806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:17.839301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:17.839733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:18.378717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:18.379811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:18.400728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:18.400728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:18.400728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:18.401025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:18.416092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:18.436468 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-962384f8-6b68-43fd-ac87-bfb6ed6170df tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 0.665128 Mar 26 21:11:18.439954 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2642/5012] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:17 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:19.457699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:19.465919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:19.492595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:19.493158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:19.494167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:19.494624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:20.186189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:20.203675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9f92fbf-d8c1-4c84-84b0-432514ab1c96 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 0.752019 Mar 26 21:11:20.204449 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2643/5013] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:19 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:20.216073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-41ea5702-d24b-4d96-834c-f8880d04c6f9 req-42afc52e-c6ec-4906-9433-e587247c9e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60bf36a-bee8-4128-8ecd-d9905bc27d10", "name": "network-vif-plugged", "status": "completed", "tag": "d918e07f-e0c2-435d-872d-f275cd4abfff"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:20.241241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-41ea5702-d24b-4d96-834c-f8880d04c6f9 req-42afc52e-c6ec-4906-9433-e587247c9e64 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:20.248673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-41ea5702-d24b-4d96-834c-f8880d04c6f9 req-42afc52e-c6ec-4906-9433-e587247c9e64 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:20.289217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-41ea5702-d24b-4d96-834c-f8880d04c6f9 req-42afc52e-c6ec-4906-9433-e587247c9e64 service nova] Creating event network-vif-plugged:d918e07f-e0c2-435d-872d-f275cd4abfff for instance f60bf36a-bee8-4128-8ecd-d9905bc27d10 on nch1-master-1 Mar 26 21:11:20.310360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-41ea5702-d24b-4d96-834c-f8880d04c6f9 req-42afc52e-c6ec-4906-9433-e587247c9e64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101433 Mar 26 21:11:20.317380 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2644/5014] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:20.540942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:20.553626 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85ec70d1-56f4-4d62-8dbc-93b064270cd2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 2.179245 Mar 26 21:11:20.585932 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2371/5015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:18 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:21.228912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:21.231688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:21.266652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:21.267479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:21.268519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:21.271201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:21.596448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:21.597254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:21.616126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:21.617515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:21.621899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:21.622589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:22.160197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:22.174865 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-771aef52-3282-4990-9acb-fcb7b715012a tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 0.954274 Mar 26 21:11:22.175757 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2645/5016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:21 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:22.279243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:22.288516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7637d7f-0e25-4be2-a601-a25c102fa00f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.697534 Mar 26 21:11:22.293426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2372/5017] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:21 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:22.620392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: .version_select at 0x7f6e595d5f70>, body: {"keypair": {"name": "tempest-keypair-1527211117"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:22.656767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:11:22.670266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:11:23.198194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:23.200813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:23.233312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:23.234144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:23.236814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:23.240627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:23.313936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:11:23.322548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:11:23.344881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-20039e13-223f-4c2c-bc5e-3bd2bc54914b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.035449 Mar 26 21:11:23.355436 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2646/5018] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:11:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:23.362817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:23.363572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:23.374872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:23.377887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:23.377887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:23.378273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:23.878464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:23.910775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0c05ed1a-fbd5-4466-b3de-426b7a4273e5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.548387 Mar 26 21:11:23.931087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2647/5019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:23 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:24.254397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:24.279749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ff32192-ed08-4989-9084-495c315f2c62 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1313 microversion: 2.1 time: 1.089108 Mar 26 21:11:24.285972 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2373/5020] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:23 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1313 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:24.937576 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:24.945907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:24.996303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:25.001723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:25.003761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:25.061064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:25.300183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:25.300830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:25.318765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:25.337276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:25.337276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:25.337276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:25.974950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:25.984234 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86ed8cc7-6ad5-4b12-b24b-a754e4ff160f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1462 microversion: 2.1 time: 0.687795 Mar 26 21:11:25.996365 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2374/5021] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:25 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1462 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:26.022493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f15536f9-5d63-4bc4-8237-4141ad30b570", "device": "/dev/sdb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:26.023795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:26.065781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:26.066183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:26.067028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:26.070086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:26.715980 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-baaa4e2c-f4cb-4bd0-91e9-1784eb877b81 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "POST /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694499 Mar 26 21:11:26.720451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2375/5022] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:11:26 2022] POST /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:11:27.165408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:27.181681 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f756b5cf-78b2-4b84-a98a-be5349b02fbc tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 2.249702 Mar 26 21:11:27.190591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2648/5023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:24 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:28.203324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:28.205096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:28.228021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:28.228507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:28.229336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:28.229792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:29.156411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:29.169849 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b7056af6-a78f-442d-b0c0-5721f2619028 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.970676 Mar 26 21:11:29.172330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2376/5024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:28 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:29.774250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1925869430", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9977cf9e-5b17-4b99-a9a4-a525bfdbd22a"}], "security_groups": [{"name": "tempest-securitygroup--391528403"}], "key_name": "tempest-keypair-1527211117", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:30.040445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] validate_networks() for [('9977cf9e-5b17-4b99-a9a4-a525bfdbd22a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:11:30.194699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:30.196183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:30.214630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:30.215170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:30.216027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:30.216489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:30.590116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:11:30.590552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:11:30.591314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:11:30.591896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:11:30.592496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:11:30.606209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:30.606853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:30.608851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:30.609741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:30.630146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:11:30.637258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:11:30.650426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:11:30.653919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:11:30.744070 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7cdbcbc3-465f-4876-b432-996aabf49062 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.975105 Mar 26 21:11:30.747491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2649/5025] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:11:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:11:30.756172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9c48768d-a492-4584-a2a1-e5b4c82b1fa2 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:30.756871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9c48768d-a492-4584-a2a1-e5b4c82b1fa2 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:30.789349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:30.801257 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6822c5c-81cc-49d2-a02d-f77af400ba7c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.613076 Mar 26 21:11:30.805547 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2377/5026] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:30 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:30.836311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9c48768d-a492-4584-a2a1-e5b4c82b1fa2 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:30.846342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9c48768d-a492-4584-a2a1-e5b4c82b1fa2 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1242 microversion: 2.1 time: 0.094718 Mar 26 21:11:30.847057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2650/5027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:30 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:31.827469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:31.828974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:31.842343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:31.842704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:31.843544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:31.848883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:31.862728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:31.863358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:31.877964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:31.878699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:31.879844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:31.880546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:32.055132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:32.063510 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22695d79-7a68-4f52-92d0-2436a8ce583c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1302 microversion: 2.1 time: 0.204741 Mar 26 21:11:32.064276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2651/5028] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:31 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1302 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:32.411990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:32.422069 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d86880da-5ba8-4516-90b2-ee2e6ec2aeca tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.600081 Mar 26 21:11:32.427574 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2378/5029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:31 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:33.080826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:33.081554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:33.088505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:33.089854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:33.091023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:33.091693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:33.171545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:33.180494 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15f3701f-775f-4704-a15d-d20026304ec4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1300 microversion: 2.1 time: 0.103490 Mar 26 21:11:33.181604 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2652/5030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:33 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:33.442122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:33.442831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:33.449964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:33.450920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:33.451793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:33.452466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:33.830029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:33.844200 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0806d73f-6130-400b-bd53-772dbb9611c6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.405752 Mar 26 21:11:33.854892 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2379/5031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:33 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:34.198453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:34.199619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:34.207157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:34.207623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:34.208469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:34.209086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:34.864746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:34.868123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:34.877627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:34.878497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:34.879715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:34.883317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:34.884313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:34.896334 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49d17857-aa8a-4492-aab1-cd127c2aaf10 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1367 microversion: 2.1 time: 0.701570 Mar 26 21:11:34.899798 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2653/5032] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:34 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1367 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:34.966094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-43b11e4f-d7db-4c79-a1ca-f95867d21a85 req-73d9f24b-4b93-428d-a666-6db3ab3b1863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bb3efc-fabf-4bd5-9adb-7f04b1995029", "tag": "78d52758-4af7-474e-90cb-4760903aefc8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:34.977095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-43b11e4f-d7db-4c79-a1ca-f95867d21a85 req-73d9f24b-4b93-428d-a666-6db3ab3b1863 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:34.977862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-43b11e4f-d7db-4c79-a1ca-f95867d21a85 req-73d9f24b-4b93-428d-a666-6db3ab3b1863 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:35.001096 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-43b11e4f-d7db-4c79-a1ca-f95867d21a85 req-73d9f24b-4b93-428d-a666-6db3ab3b1863 service nova] Creating event network-changed:78d52758-4af7-474e-90cb-4760903aefc8 for instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 on nch2-master-1 Mar 26 21:11:35.016952 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-43b11e4f-d7db-4c79-a1ca-f95867d21a85 req-73d9f24b-4b93-428d-a666-6db3ab3b1863 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054757 Mar 26 21:11:35.024061 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2654/5033] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:35.300549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:35.310537 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-200a7d27-966f-4c75-af32-279fee22120a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.450330 Mar 26 21:11:35.312696 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2380/5034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:34 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:35.363736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3a9bd279-2f9f-478f-9e69-31a2c4d36873 req-93514bab-1504-4f09-add8-cf0d192274ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "name": "network-vif-plugged", "status": "completed", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:35.378915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3a9bd279-2f9f-478f-9e69-31a2c4d36873 req-93514bab-1504-4f09-add8-cf0d192274ee service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:35.396926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3a9bd279-2f9f-478f-9e69-31a2c4d36873 req-93514bab-1504-4f09-add8-cf0d192274ee service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:35.405230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3a9bd279-2f9f-478f-9e69-31a2c4d36873 req-93514bab-1504-4f09-add8-cf0d192274ee service nova] Creating event network-vif-plugged:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:11:35.410538 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3a9bd279-2f9f-478f-9e69-31a2c4d36873 req-93514bab-1504-4f09-add8-cf0d192274ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054033 Mar 26 21:11:35.411739 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2655/5035] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:35.915483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:35.916279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:35.923589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:35.924753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:35.925715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:35.926168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:36.218743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:36.228714 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df75f7fa-cd5e-4522-915a-2f1ab671fa95 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1367 microversion: 2.1 time: 0.316924 Mar 26 21:11:36.229923 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2381/5036] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:35 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:36.332903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:36.333828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:36.343399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:36.344180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:36.345267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:36.345917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:36.539880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:36.551210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dd4e2b6a-5686-4038-9f55-1e26cb7a25b2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.225315 Mar 26 21:11:36.551815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2656/5037] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:36 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:37.252625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:37.256303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:37.270777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:37.271574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:37.274090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:37.275589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:37.571635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:37.572851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:37.587697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:37.593273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:37.594585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:37.595462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:37.840289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:37.856236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-560c75b0-7bb0-41d3-b631-64b3702b1ce5 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1519 microversion: 2.1 time: 0.288105 Mar 26 21:11:37.861057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2657/5038] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:37 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:37.984703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:37.986969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:38.003370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:38.004196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:38.006378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:38.007334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:38.038749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:38.060029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3bb21ca7-3093-4e9a-b857-8ece71afd93b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1367 microversion: 2.1 time: 0.815101 Mar 26 21:11:38.062847 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2382/5039] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:37 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1367 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:38.158937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lazy-loading 'services' on Instance uuid f60bf36a-bee8-4128-8ecd-d9905bc27d10 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:11:38.255384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca11579c-0254-4fe3-b272-ef6fc5c34d26 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10/os-volume_attachments/f15536f9-5d63-4bc4-8237-4141ad30b570" status: 202 len: 0 microversion: 2.1 time: 0.281379 Mar 26 21:11:38.256711 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2658/5040] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:11:37 2022] DELETE /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10/os-volume_attachments/f15536f9-5d63-4bc4-8237-4141ad30b570 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:11:38.878869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:38.879457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:38.887097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:38.887560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:38.888387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:38.888828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.081218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:39.083852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:39.094614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.099238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.100445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.101052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.276826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:39.284595 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-69b8e170-1742-479a-a804-8e2d2fe495b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.409694 Mar 26 21:11:39.286399 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2383/5041] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:38 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:39.302513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:39.303288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:39.310615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.311398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.312472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.313119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.497333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:39.509991 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1e608fbb-8504-43b9-8948-25ec84eb1790 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.211432 Mar 26 21:11:39.512043 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2384/5042] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:39 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:39.517751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:39.518522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:39.526128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.527714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.528714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.529423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.561359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:11:39.716831 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8ed71e0-a9cb-4106-90d9-9e101cc991dd tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 204 len: 0 microversion: 2.1 time: 0.203239 Mar 26 21:11:39.717441 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2385/5043] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:11:39 2022] DELETE /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:11:39.737237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:39.738773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:39.740557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:39.750648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.751212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.752017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.752621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.753897 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-efa4d63e-17d2-4897-81c9-d6630c7cf64c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1367 microversion: 2.1 time: 0.678802 Mar 26 21:11:39.754509 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2659/5044] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:39 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1367 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:39.768205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5925d136-effe-4168-8423-a9d6a22aaec6 req-1aa7be54-0537-4d36-bb59-61139067e755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3efc-fabf-4bd5-9adb-7f04b1995029", "name": "network-vif-plugged", "status": "completed", "tag": "78d52758-4af7-474e-90cb-4760903aefc8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:39.788100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5925d136-effe-4168-8423-a9d6a22aaec6 req-1aa7be54-0537-4d36-bb59-61139067e755 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.788517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5925d136-effe-4168-8423-a9d6a22aaec6 req-1aa7be54-0537-4d36-bb59-61139067e755 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.823352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5925d136-effe-4168-8423-a9d6a22aaec6 req-1aa7be54-0537-4d36-bb59-61139067e755 service nova] Creating event network-vif-plugged:78d52758-4af7-474e-90cb-4760903aefc8 for instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 on nch2-master-1 Mar 26 21:11:39.830351 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5925d136-effe-4168-8423-a9d6a22aaec6 req-1aa7be54-0537-4d36-bb59-61139067e755 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074290 Mar 26 21:11:39.836139 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2660/5045] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:39.845964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:39.848533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:39.861380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.866152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.867537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:39.868183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:39.976230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:39.985760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-01883055-ba1a-4af6-b195-6d3c9d3d812a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.264050 Mar 26 21:11:39.986424 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2386/5046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:39 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:40.003733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81afeb70-1c2a-4533-89d6-a3dde57bf6c2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:40.011524 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-81afeb70-1c2a-4533-89d6-a3dde57bf6c2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance fc45f254-709b-408a-9e59-31bfd60dba2b has no mapping to a cell. Mar 26 21:11:40.012678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81afeb70-1c2a-4533-89d6-a3dde57bf6c2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance fc45f254-709b-408a-9e59-31bfd60dba2b has no mapping to a cell. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:40.013791 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81afeb70-1c2a-4533-89d6-a3dde57bf6c2 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/fc45f254-709b-408a-9e59-31bfd60dba2b/action" status: 404 len: 117 microversion: 2.1 time: 0.014488 Mar 26 21:11:40.015025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2387/5047] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:39 2022] POST /compute/v2.1/servers/fc45f254-709b-408a-9e59-31bfd60dba2b/action => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:40.024224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:40.025208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.036562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.037711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.039571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.039571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.189647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:40.197760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b52d3a82-efa2-42e4-8897-2d79df4c6f06 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.177704 Mar 26 21:11:40.198388 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2388/5048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:40 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:40.215342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:40.215993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.222221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.222669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.223452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.223895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.385499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:40.397193 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f98c8d17-9d39-4d48-8881-fd8aa7c12aeb tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.185779 Mar 26 21:11:40.398167 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2389/5049] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:40 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:40.416414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a1f787fe-a2a8-4cd6-9204-464e951fc9d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:40.417566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a1f787fe-a2a8-4cd6-9204-464e951fc9d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 9791ba75-e1c6-4f87-85a5-f343675c6002] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.427478 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a1f787fe-a2a8-4cd6-9204-464e951fc9d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 9791ba75-e1c6-4f87-85a5-f343675c6002 could not be found. Mar 26 21:11:40.428506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a1f787fe-a2a8-4cd6-9204-464e951fc9d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 9791ba75-e1c6-4f87-85a5-f343675c6002 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:40.429771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a1f787fe-a2a8-4cd6-9204-464e951fc9d4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/9791ba75-e1c6-4f87-85a5-f343675c6002/action" status: 404 len: 111 microversion: 2.1 time: 0.018665 Mar 26 21:11:40.430793 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2390/5050] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:40 2022] POST /compute/v2.1/servers/9791ba75-e1c6-4f87-85a5-f343675c6002/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:40.449462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:40.450531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.457882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.458344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.459221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.459693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.625209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:40.634812 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2cebffc1-9f62-4f3a-a1ea-004c9275a40a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.198673 Mar 26 21:11:40.635503 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2391/5051] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:40 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:40.653286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:40.653904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.661657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.662365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.663364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.664043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.664176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:40.674796 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41c038c7-f6af-4830-872c-e3ec271c760f tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1468 microversion: 2.1 time: 0.836573 Mar 26 21:11:40.676023 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2661/5052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:39 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1468 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:40.771714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:40.772364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:40.779976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.780613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.781558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:40.782144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:40.985493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:40.999232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6ece0b9f-2e25-4da9-b0df-a096a6db962d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.350400 Mar 26 21:11:41.000696 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2392/5053] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:40 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:41.018825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:41.019635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:41.037263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.038399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:41.039769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.040506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:41.086404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lazy-loading 'flavor' on Instance uuid 40a24185-11da-4355-9203-d4bc0e5eeb51 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:11:41.125516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:41.141977 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ced92365-32bf-4940-b601-33208c385b6e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1367 microversion: 2.1 time: 0.372991 Mar 26 21:11:41.143597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2662/5054] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:40 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:41.213487 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f5ac9b03-c12b-4b63-b5e5-da84d69e6314 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.199766 Mar 26 21:11:41.214710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2393/5055] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:41 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:11:41.224903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:41.225774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:41.234320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.236420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:41.242681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.243189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:41.657135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:41.665795 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9673640a-1fcd-44ae-9e57-0e057cd1a797 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1514 microversion: 2.1 time: 0.446709 Mar 26 21:11:41.668386 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2663/5056] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:41 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:41.695837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:41.696632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:41.704819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.705322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:41.706163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:41.706614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.018744 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0a257fd5-df2d-40db-86c6-86cb291e3c0a req-affbbc63-37d0-470d-8c61-faf77892161e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60bf36a-bee8-4128-8ecd-d9905bc27d10", "name": "network-vif-deleted", "tag": "d918e07f-e0c2-435d-872d-f275cd4abfff"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:42.033121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0a257fd5-df2d-40db-86c6-86cb291e3c0a req-affbbc63-37d0-470d-8c61-faf77892161e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.036616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0a257fd5-df2d-40db-86c6-86cb291e3c0a req-affbbc63-37d0-470d-8c61-faf77892161e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.049493 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0a257fd5-df2d-40db-86c6-86cb291e3c0a req-affbbc63-37d0-470d-8c61-faf77892161e service nova] Creating event network-vif-deleted:d918e07f-e0c2-435d-872d-f275cd4abfff for instance f60bf36a-bee8-4128-8ecd-d9905bc27d10 on nch1-master-1 Mar 26 21:11:42.055328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0a257fd5-df2d-40db-86c6-86cb291e3c0a req-affbbc63-37d0-470d-8c61-faf77892161e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040556 Mar 26 21:11:42.056434 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2664/5057] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:11:42.115949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579df559018e45808c3886ac22ecc165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:42.124797 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e0b0422-677b-44f4-9dbf-638b4dd29177 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 200 len: 1468 microversion: 2.1 time: 0.433590 Mar 26 21:11:42.127424 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2394/5058] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:41 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:42.163937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:42.165206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:42.173884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.174341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.175135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.175900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.521554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:42.529865 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7a2cfa9-65d7-4ab8-a6e4-6a1f350d31f7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1556 microversion: 2.1 time: 0.372878 Mar 26 21:11:42.531043 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2665/5059] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:42 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1556 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:42.547975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:42.548549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:42.561164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.562875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.564765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.566528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.684801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:42.685656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:42.693051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.693704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.694478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:42.695083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:42.794911 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e629e0f5-51f6-47ca-836f-611de6420d8e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250914 Mar 26 21:11:42.795674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2395/5060] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:11:42 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:11:42.961541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:42.970275 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9f7dbc59-d34a-48c7-a265-63ff5d79f33b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1497 microversion: 2.1 time: 0.289338 Mar 26 21:11:42.971002 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2666/5061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:42 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1497 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:42.994472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:43.000099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:43.013033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.013532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.014711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.016103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.049765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lazy-loading 'flavor' on Instance uuid 40a24185-11da-4355-9203-d4bc0e5eeb51 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:11:43.071690 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'suspend' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state suspended Mar 26 21:11:43.074926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'suspend' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state suspended {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:43.080089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99dde60d-646c-43d9-8fcd-d35c42b99232 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 148 microversion: 2.1 time: 0.093297 Mar 26 21:11:43.081031 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2396/5062] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:42 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 148 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:11:43.089573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:43.090146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:43.107112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.107633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.110153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.111090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.150346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:43.151995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] [instance: f60bf36a-bee8-4128-8ecd-d9905bc27d10] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:43.162723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.163756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.165377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.166221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.188392 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] HTTP exception thrown: Instance f60bf36a-bee8-4128-8ecd-d9905bc27d10 could not be found. Mar 26 21:11:43.189367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] Returning 404 to user: Instance f60bf36a-bee8-4128-8ecd-d9905bc27d10 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:43.190476 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-17310023-8135-4ac2-9f5a-cb0cdfd3b3c1 tempest-VolumesBackupsTest-1678098904 tempest-VolumesBackupsTest-1678098904-project] 10.222.0.16 "GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10" status: 404 len: 111 microversion: 2.1 time: 0.049451 Mar 26 21:11:43.191763 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2397/5063] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:43 2022] GET /compute/v2.1/servers/f60bf36a-bee8-4128-8ecd-d9905bc27d10 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:43.198196 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f33f5522-78ee-433b-9a7f-a464bb8013c9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 202 len: 0 microversion: 2.1 time: 0.111920 Mar 26 21:11:43.202587 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2667/5064] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:43 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:11:43.220752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:43.225758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:43.239322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.242227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:43.243322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:43.246785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:44.248215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:44.264909 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24872f46-6cae-4c12-964b-ffa8f4e65a50 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1503 microversion: 2.1 time: 1.053242 Mar 26 21:11:44.265601 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2398/5065] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:43 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1503 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:45.283718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:45.284464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:45.299140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:45.299784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:45.300942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:45.301466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:45.571854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b99eb799-7943-4700-b6c9-4b8aaa5e9ca5 req-4a57a4c8-369e-4613-8557-9f23c4d1a00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bb3efc-fabf-4bd5-9adb-7f04b1995029", "tag": "78d52758-4af7-474e-90cb-4760903aefc8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:45.585005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b99eb799-7943-4700-b6c9-4b8aaa5e9ca5 req-4a57a4c8-369e-4613-8557-9f23c4d1a00f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:45.585824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b99eb799-7943-4700-b6c9-4b8aaa5e9ca5 req-4a57a4c8-369e-4613-8557-9f23c4d1a00f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:45.617737 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b99eb799-7943-4700-b6c9-4b8aaa5e9ca5 req-4a57a4c8-369e-4613-8557-9f23c4d1a00f service nova] Creating event network-changed:78d52758-4af7-474e-90cb-4760903aefc8 for instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 on nch2-master-1 Mar 26 21:11:45.625776 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b99eb799-7943-4700-b6c9-4b8aaa5e9ca5 req-4a57a4c8-369e-4613-8557-9f23c4d1a00f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058964 Mar 26 21:11:45.626938 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2399/5066] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:11:45.688816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:45.700385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79db78c8-828b-4582-9c7a-27f2675677b3 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1503 microversion: 2.1 time: 0.420497 Mar 26 21:11:45.701557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2668/5067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:45 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:46.725485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:46.727063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:46.756968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:46.758486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:46.760014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:46.761541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:47.113728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:47.125921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6bd0ea6e-334e-4367-b4c4-649bddfa93a6 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.408631 Mar 26 21:11:47.126854 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2400/5068] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:46 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:47.145387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:47.146614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:47.160352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:47.163341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:47.164356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:47.164982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:47.597697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:47.607546 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f08fdb75-ebb5-410f-94e2-524ea5b63e7a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.466677 Mar 26 21:11:47.608442 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2669/5069] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:47.624652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c952e65-668e-4c4e-955b-cbdceedf4d6e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:47.625277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c952e65-668e-4c4e-955b-cbdceedf4d6e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 29097602-ea30-4a51-940c-b2676086cf40] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:47.633404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-4c952e65-668e-4c4e-955b-cbdceedf4d6e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 29097602-ea30-4a51-940c-b2676086cf40 could not be found. Mar 26 21:11:47.636556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c952e65-668e-4c4e-955b-cbdceedf4d6e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 29097602-ea30-4a51-940c-b2676086cf40 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:47.638042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c952e65-668e-4c4e-955b-cbdceedf4d6e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/29097602-ea30-4a51-940c-b2676086cf40/action" status: 404 len: 111 microversion: 2.1 time: 0.017538 Mar 26 21:11:47.638743 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2401/5070] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:47 2022] POST /compute/v2.1/servers/29097602-ea30-4a51-940c-b2676086cf40/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:47.647166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:47.647963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:47.657936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:47.658549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:47.659444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:47.660225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:47.960520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:47.974183 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-508c5e35-920f-4209-92b1-b7064aa5c170 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.330574 Mar 26 21:11:47.975547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2670/5071] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:47.992565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:47.993841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:48.010104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.011760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.012785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.014726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.261230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:48.269821 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-21d76d7b-8593-4d19-bba0-88c741f2386a tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.281565 Mar 26 21:11:48.282282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2402/5072] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:47 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:48.287017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:48.287567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:48.296508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.297457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.299171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.300238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.331199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'unpause' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active Mar 26 21:11:48.332173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'unpause' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:48.333373 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1752d9d9-9ddd-46f5-a84b-02ec95cbbd55 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 145 microversion: 2.1 time: 0.050417 Mar 26 21:11:48.334833 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2671/5073] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:48 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 145 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:11:48.343334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:48.344248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:48.351976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.353303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.354387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.356410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.634421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:48.648470 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9f0fdf3-023a-416d-b62a-1dbbeed28d70 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.308854 Mar 26 21:11:48.660501 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2403/5074] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:48 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:48.667866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:48.669100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:48.675880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.676604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.677499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:48.678040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:48.952258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:48.960899 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-716bfdf6-f35c-4ce5-b91e-6822eb7af604 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.297785 Mar 26 21:11:48.962273 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2672/5075] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:48 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:48.979547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36e96c79-77fd-458e-a317-b2ae95ece67d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:48.980169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-36e96c79-77fd-458e-a317-b2ae95ece67d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 629593d2-da73-4371-94f0-81cd19530a34] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:48.985871 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-36e96c79-77fd-458e-a317-b2ae95ece67d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 629593d2-da73-4371-94f0-81cd19530a34 could not be found. Mar 26 21:11:48.986679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36e96c79-77fd-458e-a317-b2ae95ece67d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 629593d2-da73-4371-94f0-81cd19530a34 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:48.987713 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36e96c79-77fd-458e-a317-b2ae95ece67d tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/629593d2-da73-4371-94f0-81cd19530a34/action" status: 404 len: 111 microversion: 2.1 time: 0.012273 Mar 26 21:11:48.988291 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2404/5076] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:48 2022] POST /compute/v2.1/servers/629593d2-da73-4371-94f0-81cd19530a34/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:48.997863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:48.999058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:49.005499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.006257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.007278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.007877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.291168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:49.307305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-046e7818-f29b-43d8-808f-7e898eeb0bf8 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.314246 Mar 26 21:11:49.309036 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2673/5077] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:48 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:11:49.327696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:49.329115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:49.339192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.340251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.341309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.341840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.624926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:49.634017 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-68c0bdfb-36fc-4bf8-a880-c68d7ae99a89 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.310606 Mar 26 21:11:49.650427 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2405/5078] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:49.653476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:49.654152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:49.668503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.668962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.670275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.679300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.747520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Cannot 'unshelve' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active Mar 26 21:11:49.751108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 409 to user: Cannot 'unshelve' instance 40a24185-11da-4355-9203-d4bc0e5eeb51 while it is in vm_state active {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:49.752259 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4f9c041-769c-456e-a824-6393e2723bbd tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action" status: 409 len: 146 microversion: 2.1 time: 0.103676 Mar 26 21:11:49.755038 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2674/5079] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:11:49 2022] POST /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:11:49.773043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:49.773917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:49.781653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.782935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:49.783973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:49.784579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.056975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:50.067250 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22622547-d10f-4eb3-a3f1-3314db1cfd39 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.306902 Mar 26 21:11:50.069874 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2406/5080] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:49 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:50.114456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:50.116335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:50.133991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.134527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.137289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.138534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.496058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:50.509949 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79a8b399-e1c9-4845-8630-5472d4d33d02 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.414096 Mar 26 21:11:50.512450 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2675/5081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:50 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:50.542586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f0f00e2-8d66-4139-ae82-fa0c59a8b2c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1500462591_updated"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:50.544389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9f0f00e2-8d66-4139-ae82-fa0c59a8b2c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 7e49123d-1bc1-43e8-bbfe-629009922c93] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:50.552756 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-9f0f00e2-8d66-4139-ae82-fa0c59a8b2c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 7e49123d-1bc1-43e8-bbfe-629009922c93 could not be found. Mar 26 21:11:50.553616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f0f00e2-8d66-4139-ae82-fa0c59a8b2c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 7e49123d-1bc1-43e8-bbfe-629009922c93 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:50.554786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f0f00e2-8d66-4139-ae82-fa0c59a8b2c4 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "PUT /compute/v2.1/servers/7e49123d-1bc1-43e8-bbfe-629009922c93" status: 404 len: 111 microversion: 2.1 time: 0.030208 Mar 26 21:11:50.556085 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2407/5082] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 21:11:50 2022] PUT /compute/v2.1/servers/7e49123d-1bc1-43e8-bbfe-629009922c93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:50.564932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:50.565569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:50.585966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.586703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.587717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.588177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.947629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:50.960229 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bbd2978f-631c-41dd-aa9e-4cac198d32e9 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.399066 Mar 26 21:11:50.961574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2676/5083] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:50 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:50.978422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:50.980450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:50.991037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.991498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:50.992752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:50.993401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:51.601212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:51.609223 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bea4544e-2cc9-428c-a0de-d6449a468e09 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.635062 Mar 26 21:11:51.610123 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2408/5084] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:50 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:51.625927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-34935b88-0e62-43a2-b30e-32e96a0e9d14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:51.627177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-34935b88-0e62-43a2-b30e-32e96a0e9d14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:51.628047 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-34935b88-0e62-43a2-b30e-32e96a0e9d14 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "PUT /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 400 len: 619 microversion: 2.1 time: 0.006270 Mar 26 21:11:51.628578 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2677/5085] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Mar 26 21:11:51 2022] PUT /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:11:51.637188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:51.637950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:51.644173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:51.645122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:51.645620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:51.646060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:51.896310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:51.911625 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f8972e57-0cae-459a-ab67-cb4da30b90e7 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.278718 Mar 26 21:11:51.912510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2409/5086] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:51.930192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:51.931061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:51.942409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:51.943226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:51.944306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:51.945350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:52.410275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:52.430500 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f8b8341-a251-46ca-a16b-bc8f95b08e1e tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.505116 Mar 26 21:11:52.431280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2678/5087] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:51 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:52.449414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-586245f0-4038-4760-9f3a-5a5d499a989f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:11:52.450858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-586245f0-4038-4760-9f3a-5a5d499a989f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:52.452002 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-586245f0-4038-4760-9f3a-5a5d499a989f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "PUT /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 400 len: 108 microversion: 2.1 time: 0.007614 Mar 26 21:11:52.453300 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2410/5088] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 21:11:52 2022] PUT /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:11:52.470674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:52.471323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:52.477984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:52.478441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:52.479253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:52.479694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:52.920273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:52.928062 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9efa3006-dafd-4055-982e-64f910e0f00c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1506 microversion: 2.1 time: 0.462016 Mar 26 21:11:52.928643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2679/5089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:52 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:57.566886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:57.568136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:57.576802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.578072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.578219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.578618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.612848 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. Mar 26 21:11:57.614378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:57.618326 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a5abefa9-bed8-4fb8-98b8-1917709c731c tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 404 len: 111 microversion: 2.1 time: 0.053806 Mar 26 21:11:57.619620 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2411/5090] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:11:57 2022] DELETE /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:57.630958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:57.631872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 883a6d07-9fc6-4614-a2fe-795b2f3fa451] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:57.646911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.647430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.648894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.649669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.675302 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. Mar 26 21:11:57.676381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 883a6d07-9fc6-4614-a2fe-795b2f3fa451 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:11:57.677314 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4ecae49a-94a1-40c2-9ff4-f14aa92bae71 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451" status: 404 len: 111 microversion: 2.1 time: 0.052969 Mar 26 21:11:57.677959 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2680/5091] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:57 2022] GET /compute/v2.1/servers/883a6d07-9fc6-4614-a2fe-795b2f3fa451 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:57.688448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:57.689067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:57.695270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.695808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.696704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.697251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.727398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:11:57.881696 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b6e7dfe9-79c2-4502-a772-7847614aee92 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 204 len: 0 microversion: 2.1 time: 0.198650 Mar 26 21:11:57.882408 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2412/5092] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:11:57 2022] DELETE /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:11:57.892751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:57.893340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:57.903261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.904033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:57.905204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:57.907374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:58.247009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:58.256794 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-51e25246-726c-48fd-ab6a-1225f36f009b tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.368656 Mar 26 21:11:58.257494 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2681/5093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:57 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:11:59.277241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:11:59.279498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:11:59.297861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:59.302187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:59.303002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:11:59.303465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:11:59.724569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:11:59.738809 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7e03092-4bc3-4c9e-95df-9ab4d1d8da98 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1512 microversion: 2.1 time: 0.467458 Mar 26 21:11:59.740858 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2413/5094] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:11:59 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:00.761383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:00.762041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:00.784487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:00.785021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:00.789825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:00.790480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:00.867196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a1dbd0e2-9e59-427b-86d3-c76be74a2ed7 req-776666a9-aac7-4ea2-93b1-0b6a7c268ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a24185-11da-4355-9203-d4bc0e5eeb51", "name": "network-vif-deleted", "tag": "d859cfd5-b1f6-4001-86f0-22b3601741dd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:00.877907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a1dbd0e2-9e59-427b-86d3-c76be74a2ed7 req-776666a9-aac7-4ea2-93b1-0b6a7c268ee4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:00.878676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a1dbd0e2-9e59-427b-86d3-c76be74a2ed7 req-776666a9-aac7-4ea2-93b1-0b6a7c268ee4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:00.894707 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a1dbd0e2-9e59-427b-86d3-c76be74a2ed7 req-776666a9-aac7-4ea2-93b1-0b6a7c268ee4 service nova] Creating event network-vif-deleted:d859cfd5-b1f6-4001-86f0-22b3601741dd for instance 40a24185-11da-4355-9203-d4bc0e5eeb51 on nch1-master-1 Mar 26 21:12:00.901743 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a1dbd0e2-9e59-427b-86d3-c76be74a2ed7 req-776666a9-aac7-4ea2-93b1-0b6a7c268ee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038088 Mar 26 21:12:00.903207 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2414/5095] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:12:00.935977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4f93d75c4f219861f8e3e119fd82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7d84d914bd48ddbd9e2801f8a9c616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:00.952436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 200 len: 1470 microversion: 2.1 time: 0.195383 Mar 26 21:12:00.953927 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2682/5096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:00 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:01.979986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:01.984445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] [instance: 40a24185-11da-4355-9203-d4bc0e5eeb51] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:01.999731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:02.000239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:02.003167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:02.005567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:02.024420 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] HTTP exception thrown: Instance 40a24185-11da-4355-9203-d4bc0e5eeb51 could not be found. Mar 26 21:12:02.025370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Returning 404 to user: Instance 40a24185-11da-4355-9203-d4bc0e5eeb51 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:12:02.027052 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3e6ffa55-4fc5-4119-b8ca-bb11b9aeb20f tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51" status: 404 len: 111 microversion: 2.1 time: 0.058245 Mar 26 21:12:02.027833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2415/5097] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:01 2022] GET /compute/v2.1/servers/40a24185-11da-4355-9203-d4bc0e5eeb51 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:12:09.068289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:09.070069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c756f0e8-b167-4764-ad41-6f5280388209 tempest-ServersNegativeTestJSON-750347579 tempest-ServersNegativeTestJSON-750347579-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002317 Mar 26 21:12:09.070834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2683/5098] 10.222.0.16 () {56 vars in 885 bytes} [Sat Mar 26 21:12:09 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 26 21:12:13.285540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc99eb38-5f57-4f15-819a-c9beb23bc65e tempest-ComputeTenantNetworksTest-1140296480 tempest-ComputeTenantNetworksTest-1140296480-project] Calling method '.version_select at 0x7f6e599238b0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:13.625902 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc99eb38-5f57-4f15-819a-c9beb23bc65e tempest-ComputeTenantNetworksTest-1140296480 tempest-ComputeTenantNetworksTest-1140296480-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.516507 Mar 26 21:12:13.627038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2416/5099] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 21:12:13 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:13.638172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04af25da-3aad-4fc1-9a51-c78febffe56c tempest-ComputeTenantNetworksTest-1140296480 tempest-ComputeTenantNetworksTest-1140296480-project] Calling method '.version_select at 0x7f6e4bf50160>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:13.828329 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04af25da-3aad-4fc1-9a51-c78febffe56c tempest-ComputeTenantNetworksTest-1140296480 tempest-ComputeTenantNetworksTest-1140296480-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/924c4ba2-e9ae-4a68-b736-76f3543c6a02" status: 200 len: 139 microversion: 2.1 time: 0.194889 Mar 26 21:12:13.828936 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2684/5100] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 21:12:13 2022] GET /compute/v2.1/os-tenant-networks/924c4ba2-e9ae-4a68-b736-76f3543c6a02 => generated 139 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:16.343771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Action: 'create', calling method: .version_select at 0x7f6e5ebfdb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1830757743", "metadata": {"Type": "work"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:16.831802 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9a363e64-9a68-4cfc-a023-fd7a1c4be294 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.821213 Mar 26 21:12:16.832746 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2417/5101] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:12:16 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 26 21:12:16.846873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd8e4f34-f870-4a4b-b1ae-6f63f851cbee tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e4bea9670>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:16.924960 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd8e4f34-f870-4a4b-b1ae-6f63f851cbee tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 200 len: 346 microversion: 2.1 time: 0.084281 Mar 26 21:12:16.925566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2685/5102] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:12:16 2022] GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:17.946339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-444838d4-47e9-4339-b4a0-5392a58ec6ca tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e586bb820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.023839 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-444838d4-47e9-4339-b4a0-5392a58ec6ca tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 200 len: 347 microversion: 2.1 time: 0.088225 Mar 26 21:12:18.024668 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2418/5103] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:12:17 2022] GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 347 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:18.039402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1f16fee6-86ef-412d-a497-be5af912d048 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e4be81040>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.122147 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1f16fee6-86ef-412d-a497-be5af912d048 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 200 len: 347 microversion: 2.1 time: 0.088974 Mar 26 21:12:18.122847 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2686/5104] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:12:18 2022] GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 347 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:18.135524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-098a3bca-f6a3-4bd3-bad1-bfff1566408c tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e59234820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.251013 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-098a3bca-f6a3-4bd3-bad1-bfff1566408c tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 202 len: 0 microversion: 2.1 time: 0.119298 Mar 26 21:12:18.251687 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2419/5105] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:12:18 2022] DELETE /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:12:18.263360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d32949a3-fc7f-4ace-8db6-3434227ee5e5 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e4be7ad30>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.329909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d32949a3-fc7f-4ace-8db6-3434227ee5e5 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 200 len: 346 microversion: 2.1 time: 0.073498 Mar 26 21:12:18.331178 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2687/5106] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:12:18 2022] GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:18.433121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.433740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:18.450011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.450628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.451538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.452181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.724433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:18.735315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:18.737305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:18.738708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4e415c2-322e-4c30-b6be-8f4e082d0cbd tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2958 microversion: 2.42 time: 0.311574 Mar 26 21:12:18.739617 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2420/5107] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:12:18 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2958 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:12:18.774603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.775642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:18.785397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.786528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.787663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.788516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.793202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:18.794417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:18.803073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.803841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.805048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:18.805499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:18.839059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2360266-4c37-4871-baf8-9d5a3f3f3987 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/ips" status: 200 len: 147 microversion: 2.1 time: 0.055728 Mar 26 21:12:18.840575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2421/5108] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:12:18 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/ips => generated 147 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:12:19.078452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d66ca6f5-06fe-4fa9-8dae-671459c7f30d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.309388 Mar 26 21:12:19.079324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2688/5109] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Mar 26 21:12:18 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1/os-interface => generated 1832 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:12:19.347644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0f7bdb78-1c43-494f-893a-aa019f8e0f23 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Calling method '.version_select at 0x7f6e592343a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:19.416211 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0f7bdb78-1c43-494f-893a-aa019f8e0f23 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] HTTP exception thrown: Volume 0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c could not be found. Mar 26 21:12:19.416892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0f7bdb78-1c43-494f-893a-aa019f8e0f23 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] Returning 404 to user: Volume 0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:12:19.417738 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0f7bdb78-1c43-494f-893a-aa019f8e0f23 tempest-VolumesGetTestJSON-1830149992 tempest-VolumesGetTestJSON-1830149992-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c" status: 404 len: 109 microversion: 2.1 time: 0.075794 Mar 26 21:12:19.418288 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2422/5110] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:12:19 2022] GET /compute/v2.1/os-volumes/0df26a66-0ee6-439e-8ec4-ae1b9fecaa9c => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:12:20.535728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e32deedb-a38c-4fdd-85c2-a35f8d222c58"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:20.537680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:20.561820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:20.563773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:20.568352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:20.570249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:21.131163 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52c02b1f-1280-4d1f-9d4d-abf758c7092d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602077 Mar 26 21:12:21.146973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2689/5111] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:12:20 2022] POST /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:25.869186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: .version_select at 0x7f6e5876b550>, body: {"keypair": {"name": "tempest-keypair-1135659999"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:25.912565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:25.930575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:26.575903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:26.582016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:26.600899 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12e9f159-cf5b-4537-93e6-145c2d42b319 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.738514 Mar 26 21:12:26.607663 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2423/5112] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:12:25 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:28.782855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-958484343", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9977cf9e-5b17-4b99-a9a4-a525bfdbd22a"}], "security_groups": [{"name": "tempest-securitygroup--1928037020"}], "key_name": "tempest-keypair-1135659999", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:28.989502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] validate_networks() for [('9977cf9e-5b17-4b99-a9a4-a525bfdbd22a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:12:30.536843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:12:30.537403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:12:30.538494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:12:30.538917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:12:30.539336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:12:30.560755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:30.561810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:30.564978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:30.566373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:30.607214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:30.614796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:30.630524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:12:30.633203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:12:30.718208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7dd4b75c-dbdd-4a3b-82d0-8b384c9f0b5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.941768 Mar 26 21:12:30.719440 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2690/5113] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:12:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:12:30.731823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-293bf961-13e7-4ca5-8073-25f88debe533 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:30.732716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-293bf961-13e7-4ca5-8073-25f88debe533 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:30.859070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-293bf961-13e7-4ca5-8073-25f88debe533 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:30.877763 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-293bf961-13e7-4ca5-8073-25f88debe533 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1241 microversion: 2.1 time: 0.151604 Mar 26 21:12:30.881382 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2424/5114] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:30 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:31.898603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:31.899365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:31.914663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:31.917539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:31.920379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:31.923332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:32.170562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:32.180174 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9f1febe-0fd6-40ef-9bf8-cf54370d0c5d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1237 microversion: 2.1 time: 0.286189 Mar 26 21:12:32.183401 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2691/5115] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:31 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1237 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:33.201072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:33.202053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:33.212133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:33.213100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:33.214114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:33.214910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:33.612931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:33.624469 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-278ccdd3-b688-46c4-9ac2-286a17f4c05b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1299 microversion: 2.1 time: 0.428226 Mar 26 21:12:33.627409 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2425/5116] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:33 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1299 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:34.649229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:34.650448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:34.671392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:34.672110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:34.673120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:34.673760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:34.999983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:35.013998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a0ce8c7-31bf-4876-8060-f0900b9af4cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1299 microversion: 2.1 time: 0.374480 Mar 26 21:12:35.015691 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2692/5117] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:34 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1299 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:36.033000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:36.033621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:36.051034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:36.051493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:36.058589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:36.060552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:36.416567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:36.446092 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-24985ac3-6707-492e-ae0e-bff4d9f21823 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.416860 Mar 26 21:12:36.460117 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2426/5118] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:36 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:37.035182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-89024b58-b017-462f-a102-e38967b849f2 req-f1fec2bf-efa2-4813-b36c-682ac2d0873d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5431bce9-4f3b-4361-89a6-9f16516aa8d4", "tag": "2ad246be-9db4-4928-bfb2-73737d075b68"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:37.059977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-89024b58-b017-462f-a102-e38967b849f2 req-f1fec2bf-efa2-4813-b36c-682ac2d0873d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:37.060491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-89024b58-b017-462f-a102-e38967b849f2 req-f1fec2bf-efa2-4813-b36c-682ac2d0873d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:37.094910 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-89024b58-b017-462f-a102-e38967b849f2 req-f1fec2bf-efa2-4813-b36c-682ac2d0873d service nova] Creating event network-changed:2ad246be-9db4-4928-bfb2-73737d075b68 for instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 on nch1-master-1 Mar 26 21:12:37.119631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-89024b58-b017-462f-a102-e38967b849f2 req-f1fec2bf-efa2-4813-b36c-682ac2d0873d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105006 Mar 26 21:12:37.127520 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2693/5119] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:37.463499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:37.464823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:37.471739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:37.472386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:37.472999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:37.473436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:37.818249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:37.832416 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-64117414-f66d-4fef-8910-359c38ed966a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.373515 Mar 26 21:12:37.838805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2427/5120] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:37 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:38.853560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:38.854263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:38.861406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:38.861853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:38.862619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:38.863338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:39.202782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:39.210827 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58e96bb6-4b8d-49b6-91f9-19ad7493ff46 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.361438 Mar 26 21:12:39.211461 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2694/5121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:38 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:40.229521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:40.230936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:40.252383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:40.253240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:40.254313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:40.255122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:40.492196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:40.502330 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98eb1439-aad3-4c2b-990f-4111dd6479de tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.277696 Mar 26 21:12:40.513971 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2428/5122] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:40 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:41.535892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:41.539197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:41.551425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:41.552512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:41.553842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:41.554672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:41.643736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4454f8e8-25cf-4af8-aa55-61a6fa81df0c req-7d0a5139-028d-4170-8246-954b3256941d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5431bce9-4f3b-4361-89a6-9f16516aa8d4", "name": "network-vif-plugged", "status": "completed", "tag": "2ad246be-9db4-4928-bfb2-73737d075b68"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:41.657629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4454f8e8-25cf-4af8-aa55-61a6fa81df0c req-7d0a5139-028d-4170-8246-954b3256941d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:41.658303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4454f8e8-25cf-4af8-aa55-61a6fa81df0c req-7d0a5139-028d-4170-8246-954b3256941d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:41.673863 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4454f8e8-25cf-4af8-aa55-61a6fa81df0c req-7d0a5139-028d-4170-8246-954b3256941d service nova] Creating event network-vif-plugged:2ad246be-9db4-4928-bfb2-73737d075b68 for instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 on nch1-master-1 Mar 26 21:12:41.682090 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4454f8e8-25cf-4af8-aa55-61a6fa81df0c req-7d0a5139-028d-4170-8246-954b3256941d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042247 Mar 26 21:12:41.683461 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2429/5123] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:41.817601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:41.818554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:41.827868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:41.828655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:41.829673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:41.830364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:42.003864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lazy-loading 'services' on Instance uuid fc597171-1f7d-43d9-b979-ca9c34c23f5a {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:12:42.141693 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4c00b41-ae6e-4ee7-a434-0759f7e86b31 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a/os-volume_attachments/c90bcbd0-9a75-48e6-a516-481e089658af" status: 202 len: 0 microversion: 2.1 time: 0.331436 Mar 26 21:12:42.142317 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2430/5124] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:12:41 2022] DELETE /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a/os-volume_attachments/c90bcbd0-9a75-48e6-a516-481e089658af => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:12:42.173897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:42.196759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2f988a87-d875-4143-8648-b97d4acfa1dd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.674973 Mar 26 21:12:42.216220 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2695/5125] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:41 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:43.215967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:43.217376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:43.238411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.240461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.244848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.246088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.365411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:43.366057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:43.390956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.391555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.393707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.396471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.488549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:12:43.699246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b4718533-a478-451d-bd8f-c135518c6337 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 204 len: 0 microversion: 2.1 time: 0.339245 Mar 26 21:12:43.699858 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2696/5126] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:12:43 2022] DELETE /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:12:43.710342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:43.711062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:43.731020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.731709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.732722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:43.733342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:43.792119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:43.801213 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1c9d4ca2-2f86-4976-97c5-2bcad8fce421 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1367 microversion: 2.1 time: 0.590174 Mar 26 21:12:43.806465 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2431/5127] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:43 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:44.010716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:44.023158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b54dbfc0-227b-48f0-9782-a976669b79c2 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1513 microversion: 2.1 time: 0.318691 Mar 26 21:12:44.029478 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2697/5128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:43 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:12:44.820565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:44.821847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:44.834300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:44.837767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:44.841920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:44.842581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:45.047022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:45.048293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:45.055220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:45.056177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:45.057179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:45.057784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:45.460143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:45.469869 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ed794a1b-5357-4e36-a2f9-27a03e4d7c40 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1513 microversion: 2.1 time: 0.427151 Mar 26 21:12:45.470485 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2698/5129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:45 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:12:45.535875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:45.551436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31b2d2d4-c9af-44d8-9549-82738c7f3594 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1557 microversion: 2.1 time: 0.736000 Mar 26 21:12:45.552807 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2432/5130] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:44 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1557 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:45.575677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:45.576668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:45.593063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:45.594046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:45.595048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:45.595658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:45.741352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6b6d07b-bbc0-45b8-9b65-b857529331f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172191 Mar 26 21:12:45.742174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2699/5131] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:12:45 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:46.043076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Action: 'create', calling method: .version_select at 0x7f6e59234ca0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-698869704"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:46.062074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for project fc922ea5d1564695ac143b86d7123f25. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:46.068263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for user 981e1bf6531f45c4b8911579995eecc0 and project fc922ea5d1564695ac143b86d7123f25. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:46.235327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for project fc922ea5d1564695ac143b86d7123f25. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:46.244106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for user 981e1bf6531f45c4b8911579995eecc0 and project fc922ea5d1564695ac143b86d7123f25. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:46.272300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cba06860-c1a3-47f8-9a59-19a203f04fce tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.604690 Mar 26 21:12:46.275779 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2433/5132] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:12:45 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:12:46.497255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:46.499059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:46.511271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:46.512164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:46.513200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:46.514204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:46.696542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:46.705238 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd5f90cb-cc41-4ca0-8d07-4f61fa236d8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 200 len: 1471 microversion: 2.1 time: 0.221541 Mar 26 21:12:46.712884 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2700/5133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:46 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:46.785032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-36fed4b8-3f7e-4d1a-84b9-1979b03e7620 req-e06c1590-f748-4af8-8338-d4e974aa36e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc597171-1f7d-43d9-b979-ca9c34c23f5a", "name": "network-vif-deleted", "tag": "c8337db8-8ace-411f-91d0-9557a19ab3e1"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:46.824783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-36fed4b8-3f7e-4d1a-84b9-1979b03e7620 req-e06c1590-f748-4af8-8338-d4e974aa36e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:46.825474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-36fed4b8-3f7e-4d1a-84b9-1979b03e7620 req-e06c1590-f748-4af8-8338-d4e974aa36e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:46.864086 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-36fed4b8-3f7e-4d1a-84b9-1979b03e7620 req-e06c1590-f748-4af8-8338-d4e974aa36e9 service nova] Creating event network-vif-deleted:c8337db8-8ace-411f-91d0-9557a19ab3e1 for instance fc597171-1f7d-43d9-b979-ca9c34c23f5a on nch2-master-1 Mar 26 21:12:46.872581 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-36fed4b8-3f7e-4d1a-84b9-1979b03e7620 req-e06c1590-f748-4af8-8338-d4e974aa36e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094925 Mar 26 21:12:46.874833 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2434/5134] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:47.723532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:47.724681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: fc597171-1f7d-43d9-b979-ca9c34c23f5a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:47.732361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:47.733222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:47.734590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:47.735047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:47.749781 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] HTTP exception thrown: Instance fc597171-1f7d-43d9-b979-ca9c34c23f5a could not be found. Mar 26 21:12:47.750625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Returning 404 to user: Instance fc597171-1f7d-43d9-b979-ca9c34c23f5a could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:12:47.751705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22b82c6a-660e-4378-b5b5-ba808e6cd3a8 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a" status: 404 len: 111 microversion: 2.1 time: 0.033475 Mar 26 21:12:47.752503 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2701/5135] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:47 2022] GET /compute/v2.1/servers/fc597171-1f7d-43d9-b979-ca9c34c23f5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:12:48.919977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ece35350-6dd3-49aa-995c-538eaf75da63 req-fa8268ab-16c1-4d70-b552-4b14d81f9c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5431bce9-4f3b-4361-89a6-9f16516aa8d4", "tag": "2ad246be-9db4-4928-bfb2-73737d075b68"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:48.940221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ece35350-6dd3-49aa-995c-538eaf75da63 req-fa8268ab-16c1-4d70-b552-4b14d81f9c26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:48.940930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ece35350-6dd3-49aa-995c-538eaf75da63 req-fa8268ab-16c1-4d70-b552-4b14d81f9c26 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:48.986463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ece35350-6dd3-49aa-995c-538eaf75da63 req-fa8268ab-16c1-4d70-b552-4b14d81f9c26 service nova] Creating event network-changed:2ad246be-9db4-4928-bfb2-73737d075b68 for instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 on nch1-master-1 Mar 26 21:12:48.993818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ece35350-6dd3-49aa-995c-538eaf75da63 req-fa8268ab-16c1-4d70-b552-4b14d81f9c26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079372 Mar 26 21:12:48.998387 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2435/5136] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:12:53.381711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1413042040", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "d44f6756-0914-4122-b1f7-731679a6fca5"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:12:53.471164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] validate_networks() for [('d44f6756-0914-4122-b1f7-731679a6fca5', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:12:54.901407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:12:54.901980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:12:54.902755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:12:54.903240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:12:54.903724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:12:54.915734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:54.916586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:54.917640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:54.918294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:54.950442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Getting quotas for project 52b4455ec1a2447ebb1f737c0d97fc83. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:12:54.972684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Getting quotas for user 54a09bedd0ad4328b1e687fc5f7e3967 and project 52b4455ec1a2447ebb1f737c0d97fc83. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:12:55.012111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:12:55.015101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:12:55.101675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2bd91d4-0211-497b-916d-500b5f8c1213 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723313 Mar 26 21:12:55.103455 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2702/5137] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:12:55.116420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cd3426e2-0564-465a-9c6a-ab920dad4a62 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:55.117692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cd3426e2-0564-465a-9c6a-ab920dad4a62 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:55.254399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cd3426e2-0564-465a-9c6a-ab920dad4a62 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:55.267522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cd3426e2-0564-465a-9c6a-ab920dad4a62 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1219 microversion: 2.1 time: 0.156969 Mar 26 21:12:55.269510 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2436/5138] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:55 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:56.285556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:56.286244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:56.310251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:56.310747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:56.313535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:56.314201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:56.523778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:56.537203 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d3a7128-9ae8-4a22-b098-b17d88fc4096 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1215 microversion: 2.1 time: 0.255848 Mar 26 21:12:56.538014 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2703/5139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:56 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:57.557605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:57.558102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:57.584817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:57.587126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:57.590337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:57.599171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:57.855076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:57.875543 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-796c9a52-2d41-4dbb-bdec-a5e96a1d87a1 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1277 microversion: 2.1 time: 0.324424 Mar 26 21:12:57.880381 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2437/5140] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:57 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:12:58.897283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:12:58.898648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:12:58.912049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:58.915049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:58.916238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:12:58.918215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:12:59.068813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:12:59.078923 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66276e46-78f0-4251-9526-c77796f1f1d5 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1277 microversion: 2.1 time: 0.184747 Mar 26 21:12:59.081651 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2704/5141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:12:58 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:00.096876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:00.098077 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:00.128525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:00.131496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:00.133368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:00.135309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:00.622320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:00.662502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-22d437de-2751-4878-ac6e-10fa69ee2f1f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.569395 Mar 26 21:13:00.663097 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2438/5142] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:00 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:01.175594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6a8f80ed-bcb9-4a64-9565-0336ae2a592b req-df11dd28-4e1c-4e8a-9eb2-012fda72101a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0f7556-44fc-42f7-b175-877f9e1574a1", "tag": "000821d1-4afa-4c85-8b22-1d3a08ad1232"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:01.197234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6a8f80ed-bcb9-4a64-9565-0336ae2a592b req-df11dd28-4e1c-4e8a-9eb2-012fda72101a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:01.199652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6a8f80ed-bcb9-4a64-9565-0336ae2a592b req-df11dd28-4e1c-4e8a-9eb2-012fda72101a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:01.230638 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6a8f80ed-bcb9-4a64-9565-0336ae2a592b req-df11dd28-4e1c-4e8a-9eb2-012fda72101a service nova] Creating event network-changed:000821d1-4afa-4c85-8b22-1d3a08ad1232 for instance 6d0f7556-44fc-42f7-b175-877f9e1574a1 on nch2-master-1 Mar 26 21:13:01.241035 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6a8f80ed-bcb9-4a64-9565-0336ae2a592b req-df11dd28-4e1c-4e8a-9eb2-012fda72101a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069209 Mar 26 21:13:01.241667 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2705/5143] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:01.468288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1025096168-access_point-1597491967", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "405b99d3-3fe8-4754-994b-2c346df679f7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-698869704", "security_groups": [{"name": "tempest-secgroup_access--1826655565"}, {"name": "tempest-secgroup_general--1289097470"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:01.692959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:01.694758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:01.720844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:01.722109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:01.724134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:01.724606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:01.997719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:02.013376 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-800422f8-5200-4ac2-b973-2cf0f0f57739 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.337514 Mar 26 21:13:02.023551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2706/5144] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:01 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:02.553594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] validate_networks() for [('405b99d3-3fe8-4754-994b-2c346df679f7', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:13:03.030276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:03.030906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:03.044481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:03.045019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:03.046244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:03.046862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:03.498774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:13:03.499850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:13:03.500530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:13:03.501138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:13:03.501739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:13:03.521199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:03.521872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:03.523575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:03.524379 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:03.554232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for project fc922ea5d1564695ac143b86d7123f25. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:13:03.564440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for user 981e1bf6531f45c4b8911579995eecc0 and project fc922ea5d1564695ac143b86d7123f25. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:13:03.593283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:13:03.595376 ncdv-master-1 devstack@n-api.service[141580]: WARNING nova.utils [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1025096168-access_point-1597491967 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1025096168-ac Mar 26 21:13:03.604736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:13:03.751818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3dea1f27-77ba-44c1-8f51-f4d144eb0825 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.287912 Mar 26 21:13:03.759903 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2439/5145] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:13:01 2022] POST /compute/v2.1/servers => generated 458 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:13:03.767506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c7ba8ac5-00c6-4854-8177-ce5facb7d1b4 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:03.769205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c7ba8ac5-00c6-4854-8177-ce5facb7d1b4 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:03.875027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c7ba8ac5-00c6-4854-8177-ce5facb7d1b4 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:03.899697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c7ba8ac5-00c6-4854-8177-ce5facb7d1b4 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1294 microversion: 2.1 time: 0.132253 Mar 26 21:13:03.900966 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2440/5146] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:03 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:04.194482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:04.212474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3aa3a0a-9c86-4539-a026-8b248de05955 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 1.186159 Mar 26 21:13:04.222534 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2707/5147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:03 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:04.919232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:04.920622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:04.936235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:04.937334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:04.938316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:04.938928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:05.228255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:05.243010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:05.243754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:05.244747 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3849022-0ae1-4642-aceb-a073327bd998 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1346 microversion: 2.1 time: 0.329873 Mar 26 21:13:05.245515 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2441/5148] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:04 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:05.263045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:05.263982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:05.265562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:05.266028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:05.739856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:05.748991 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e1632f2-7224-4aa9-bd97-d1da54f441bb tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.512319 Mar 26 21:13:05.751575 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2708/5149] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:05 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:06.262359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:06.262854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:06.270014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:06.271176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:06.272520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:06.273817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:06.375511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:06.391906 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-06690246-94bb-4912-af05-8efb58d9d133 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1352 microversion: 2.1 time: 0.133411 Mar 26 21:13:06.392688 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2442/5150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:06 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:06.770927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:06.772414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:06.785629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:06.787073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:06.788255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:06.789134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:07.098873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:07.107474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c5482ca4-345a-4f59-ba16-7deffd8cf5e3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.342594 Mar 26 21:13:07.123662 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2709/5151] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:06 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:07.415905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:07.416628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:07.437232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:07.438024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:07.439835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:07.440542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:07.870165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:07.891493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b9ba77c-b04f-4772-865b-67606c412206 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.482383 Mar 26 21:13:07.914515 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2443/5152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:07 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:08.129127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:08.130463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:08.138675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:08.139065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:08.140213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:08.140845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:08.253417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-cf269501-0917-4b75-bc11-d49fd7836cf0 req-2b918119-df00-48c3-af45-ddf841695292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0f7556-44fc-42f7-b175-877f9e1574a1", "name": "network-vif-plugged", "status": "completed", "tag": "000821d1-4afa-4c85-8b22-1d3a08ad1232"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:08.290930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cf269501-0917-4b75-bc11-d49fd7836cf0 req-2b918119-df00-48c3-af45-ddf841695292 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:08.293964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cf269501-0917-4b75-bc11-d49fd7836cf0 req-2b918119-df00-48c3-af45-ddf841695292 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:08.322490 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-cf269501-0917-4b75-bc11-d49fd7836cf0 req-2b918119-df00-48c3-af45-ddf841695292 service nova] Creating event network-vif-plugged:000821d1-4afa-4c85-8b22-1d3a08ad1232 for instance 6d0f7556-44fc-42f7-b175-877f9e1574a1 on nch2-master-1 Mar 26 21:13:08.338640 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-cf269501-0917-4b75-bc11-d49fd7836cf0 req-2b918119-df00-48c3-af45-ddf841695292 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090150 Mar 26 21:13:08.339271 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2444/5153] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:08.909940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:08.911647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:08.915252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:08.925211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:08.926429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:08.926983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:08.927786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:08.943842 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f664799-6b99-4bd9-9320-ecad781c4eb3 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.802093 Mar 26 21:13:08.946326 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2710/5154] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:08 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:09.651901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:09.660813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-23795c9a-61e9-4a8c-8563-36f08f2cfc9c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.754917 Mar 26 21:13:09.661472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2445/5155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:08 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:09.945206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-69e43a7c-af02-4b81-9304-f273bb04354b req-14dad022-22cc-4cc1-a468-08f566da630e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12d8236-39b7-4448-9a97-6481f621decf", "tag": "71d8ff85-a336-4e4d-bc38-cd6bdfd77b55"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:09.962062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-69e43a7c-af02-4b81-9304-f273bb04354b req-14dad022-22cc-4cc1-a468-08f566da630e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:09.962675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-69e43a7c-af02-4b81-9304-f273bb04354b req-14dad022-22cc-4cc1-a468-08f566da630e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:09.964715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:09.965489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:09.972933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:09.973400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:09.976932 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-69e43a7c-af02-4b81-9304-f273bb04354b req-14dad022-22cc-4cc1-a468-08f566da630e service nova] Creating event network-changed:71d8ff85-a336-4e4d-bc38-cd6bdfd77b55 for instance c12d8236-39b7-4448-9a97-6481f621decf on nch1-master-1 Mar 26 21:13:09.984862 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-69e43a7c-af02-4b81-9304-f273bb04354b req-14dad022-22cc-4cc1-a468-08f566da630e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046423 Mar 26 21:13:09.986252 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2711/5156] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:09.988539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:09.989132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:10.679210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:10.679772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:10.689307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:10.701373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:10.704217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:10.706285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:10.864014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:10.881246 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bf107fd5-230e-48b4-91ec-2858d39ac791 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1319 microversion: 2.1 time: 0.921840 Mar 26 21:13:10.892415 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2446/5157] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:09 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1319 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:13:11.072734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:11.081339 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f981c31-e755-4635-99c2-1f173e121c16 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.406544 Mar 26 21:13:11.084282 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2712/5158] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:10 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:13:11.899536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:11.901593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:11.913054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:11.916178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:11.920739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:11.921438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:12.105318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:12.106031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:12.120703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:12.122079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:12.124311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:12.134680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:12.298613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:12.322029 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d5fc6b2b-2df2-48c3-b5be-d7fe523f76a6 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1507 microversion: 2.1 time: 0.426577 Mar 26 21:13:12.331246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2447/5159] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:11 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:12.342646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a81c96-3fa3-4167-be2b-3237aa8faf35", "device": "/dev/sdb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:12.348647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:12.369397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:12.369890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:12.370705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:12.371148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:12.513594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:12.540320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6aabfce-480b-4862-8fa3-82e54317017b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.444662 Mar 26 21:13:12.542736 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2713/5160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:12 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:12.749447 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0c851bf-615e-4f9c-8f47-b45108ac0e68 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "POST /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410786 Mar 26 21:13:12.750894 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2448/5161] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:13:12 2022] POST /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:13.560505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:13.561059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:13.577659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:13.578156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:13.579001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:13.582768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:14.038832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:14.047370 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71f0f54a-b644-48e0-9ec2-243a405ac532 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.492406 Mar 26 21:13:14.055117 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2714/5162] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:13 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:15.071731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:15.073106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:15.087130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:15.087885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:15.088721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:15.089172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:15.876420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:15.887850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2713f18d-7f83-4d56-8787-8593d0c1c3f1 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.820334 Mar 26 21:13:15.889297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2449/5163] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:15 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:16.905566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:16.906248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:16.914178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:16.914869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:16.916326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:16.919215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:17.534382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:17.545614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2096613f-fa3e-42db-8a2f-94af0a7fba59 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.645026 Mar 26 21:13:17.552760 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2715/5164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:16 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:18.563209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:18.564974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:18.596882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:18.598342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:18.601267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:18.603474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:19.184859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:19.201914 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-027ac452-fa7d-4248-b838-6a4d93053c99 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.637145 Mar 26 21:13:19.213359 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2450/5165] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:18 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:20.221909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:20.223335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:20.251654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:20.253012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:20.254627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:20.257673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:20.432529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-444ca190-4e50-445f-b40a-0eb1fc4b1552 req-a00da582-ea90-4ac3-af35-633f7dce5bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12d8236-39b7-4448-9a97-6481f621decf", "name": "network-vif-plugged", "status": "completed", "tag": "71d8ff85-a336-4e4d-bc38-cd6bdfd77b55"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:20.458475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-444ca190-4e50-445f-b40a-0eb1fc4b1552 req-a00da582-ea90-4ac3-af35-633f7dce5bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:20.461090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-444ca190-4e50-445f-b40a-0eb1fc4b1552 req-a00da582-ea90-4ac3-af35-633f7dce5bfc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:20.495859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-444ca190-4e50-445f-b40a-0eb1fc4b1552 req-a00da582-ea90-4ac3-af35-633f7dce5bfc service nova] Creating event network-vif-plugged:71d8ff85-a336-4e4d-bc38-cd6bdfd77b55 for instance c12d8236-39b7-4448-9a97-6481f621decf on nch1-master-1 Mar 26 21:13:20.515522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-444ca190-4e50-445f-b40a-0eb1fc4b1552 req-a00da582-ea90-4ac3-af35-633f7dce5bfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089654 Mar 26 21:13:20.517356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2451/5166] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:13:20.774848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:20.785008 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dbe02f73-b4c5-4c4a-baf2-2738b8889c57 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.567779 Mar 26 21:13:20.785322 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2716/5167] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:20 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:21.804410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:21.805398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:21.822709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:21.823234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:21.824467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:21.826525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:22.395449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:22.413784 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d785f60f-77b2-49a3-8636-9504e2fc2a80 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1472 microversion: 2.1 time: 0.612911 Mar 26 21:13:22.414429 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2452/5168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:21 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1472 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:23.434604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:23.436143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:23.451222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.459284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.460493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.463703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.649945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:23.649945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:23.661069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.663703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.664825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.665291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.722421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8bd18b9-1349-4eaf-bcd2-e187a81d48bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/ips" status: 200 len: 150 microversion: 2.1 time: 0.080454 Mar 26 21:13:23.723540 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2453/5169] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:13:23 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:23.736223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e32deedb-a38c-4fdd-85c2-a35f8d222c58"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:23.737647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:23.747351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.748873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.750527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.751349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.864184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:23.880995 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-502884af-a8a5-45b7-bb59-1f2d93c0926f tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1644 microversion: 2.1 time: 0.452128 Mar 26 21:13:23.882386 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2717/5170] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:23 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1644 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:23.898641 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Invalid volume: volume e32deedb-a38c-4fdd-85c2-a35f8d222c58 is already attached to instances: 29bb3efc-fabf-4bd5-9adb-7f04b1995029 Mar 26 21:13:23.900313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 400 to user: Invalid volume: volume e32deedb-a38c-4fdd-85c2-a35f8d222c58 is already attached to instances: 29bb3efc-fabf-4bd5-9adb-7f04b1995029 {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:13:23.901042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ecd33d4-42cc-46e5-8bcf-289940ac6906 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.169201 Mar 26 21:13:23.903147 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2454/5171] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:13:23 2022] POST /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 26 21:13:23.911187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:23.912130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:23.913322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:23.913987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:23.936876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.937646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.938070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.938535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.939339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.939988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:23.943973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:23.944433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:24.024115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:13:24.259212 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-94227acf-5ba1-45ac-8201-4409a5cdc176 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 204 len: 0 microversion: 2.1 time: 0.351948 Mar 26 21:13:24.260700 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2455/5172] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:13:23 2022] DELETE /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:13:24.276812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:24.281279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:24.299726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:24.300450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:24.301994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:24.302603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:24.496404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:24.511226 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f9baeaf-19b0-401c-bc03-5e3e2a030cfa tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1644 microversion: 2.1 time: 0.611750 Mar 26 21:13:24.512697 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2718/5173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:23 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1644 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:24.529026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:24.529809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:24.544925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:24.546842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:24.550950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:24.551582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:24.685536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:24.695669 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e66dad94-6476-4de4-91ae-a29612155686 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1682 microversion: 2.1 time: 0.428964 Mar 26 21:13:24.702478 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2456/5174] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:24 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:25.141798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b677e42c-2531-4e36-816e-559039d17514 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1795 microversion: 2.1 time: 0.614431 Mar 26 21:13:25.143892 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2719/5175] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:24 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1795 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:25.721451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:25.723022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:25.737542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:25.738016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:25.743667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:25.745492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:26.244710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:26.260857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c279c59c-f848-4534-a3b4-8d14b109e1f8 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1682 microversion: 2.1 time: 0.544138 Mar 26 21:13:26.272964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2457/5176] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:25 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1682 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:27.286436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:27.287760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:27.296716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:27.297463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:27.299569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:27.300216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:27.480063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-244868d4-abd1-4074-9790-19937c28a9c8 req-4610683f-a57a-4710-a115-54b037a4717d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5431bce9-4f3b-4361-89a6-9f16516aa8d4", "name": "network-vif-deleted", "tag": "2ad246be-9db4-4928-bfb2-73737d075b68"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:27.503270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-244868d4-abd1-4074-9790-19937c28a9c8 req-4610683f-a57a-4710-a115-54b037a4717d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:27.504413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-244868d4-abd1-4074-9790-19937c28a9c8 req-4610683f-a57a-4710-a115-54b037a4717d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:27.532534 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-244868d4-abd1-4074-9790-19937c28a9c8 req-4610683f-a57a-4710-a115-54b037a4717d service nova] Creating event network-vif-deleted:2ad246be-9db4-4928-bfb2-73737d075b68 for instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 on nch1-master-1 Mar 26 21:13:27.541060 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-244868d4-abd1-4074-9790-19937c28a9c8 req-4610683f-a57a-4710-a115-54b037a4717d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068322 Mar 26 21:13:27.542022 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2458/5177] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:13:27.598390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:27.618533 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a6b3555-fb0f-408f-91b4-2a95e8e82a4b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 200 len: 1614 microversion: 2.1 time: 0.336482 Mar 26 21:13:27.621377 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2720/5178] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:27 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 1614 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:13:28.647279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:28.647279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:28.661845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:28.662603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:28.664981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:28.666226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:28.697979 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. Mar 26 21:13:28.699653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:13:28.701152 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6fdfbf40-3a66-40fb-a6a1-0c802930a0ac tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 404 len: 111 microversion: 2.1 time: 0.063031 Mar 26 21:13:28.705231 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2459/5179] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:28 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:13:28.712701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab37ad0d-7093-4de8-a74c-8ccb145919f0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '.version_select at 0x7f6e4be7a9d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:28.755050 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab37ad0d-7093-4de8-a74c-8ccb145919f0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135659999" status: 202 len: 0 microversion: 2.1 time: 0.046166 Mar 26 21:13:28.759174 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2721/5180] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135659999 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:13:30.347953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:30.349324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:30.370626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:30.371451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:30.372540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:30.373694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:30.523500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lazy-loading 'services' on Instance uuid 29bb3efc-fabf-4bd5-9adb-7f04b1995029 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:13:30.620051 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e336ff2-a57b-4c36-a4e4-a58ca45b265d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments/e32deedb-a38c-4fdd-85c2-a35f8d222c58" status: 202 len: 0 microversion: 2.1 time: 0.276841 Mar 26 21:13:30.626656 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2460/5181] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:13:30 2022] DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments/e32deedb-a38c-4fdd-85c2-a35f8d222c58 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:13:30.631199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:30.632942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:30.641549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:30.642388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:30.643534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:30.644288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:30.706367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-04fb4216-38b2-420f-8e6c-c44df9291be5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078590 Mar 26 21:13:30.714349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2722/5182] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:13:30 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:30.970694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bfb35c42-29ac-4b50-b8f6-96515032539d req-11444453-e4fd-4d8b-b6cb-4c7d07174d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12d8236-39b7-4448-9a97-6481f621decf", "tag": "71d8ff85-a336-4e4d-bc38-cd6bdfd77b55"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:30.987780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bfb35c42-29ac-4b50-b8f6-96515032539d req-11444453-e4fd-4d8b-b6cb-4c7d07174d5a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:30.990099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bfb35c42-29ac-4b50-b8f6-96515032539d req-11444453-e4fd-4d8b-b6cb-4c7d07174d5a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:31.031005 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bfb35c42-29ac-4b50-b8f6-96515032539d req-11444453-e4fd-4d8b-b6cb-4c7d07174d5a service nova] Creating event network-changed:71d8ff85-a336-4e4d-bc38-cd6bdfd77b55 for instance c12d8236-39b7-4448-9a97-6481f621decf on nch1-master-1 Mar 26 21:13:31.047133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bfb35c42-29ac-4b50-b8f6-96515032539d req-11444453-e4fd-4d8b-b6cb-4c7d07174d5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081375 Mar 26 21:13:31.048766 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2461/5183] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:31.729566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:31.731122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:31.749106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:31.750151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:31.751271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:31.751895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:31.865155 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32511f64-5e8e-4ec6-a646-81c8ef039ab0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143216 Mar 26 21:13:31.872656 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2723/5184] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:13:31 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:32.878950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:32.881653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:32.897267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:32.898079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:32.899308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:32.900134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:32.971115 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-df8b3067-22e5-419b-8cf2-4718cf127039 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097958 Mar 26 21:13:32.972376 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2462/5185] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:13:32 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:13:33.080146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:33.081737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:33.094317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:33.095296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:33.096713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:33.097582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:33.138116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:13:33.332838 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-275e3999-30e2-4c9c-9160-6885608098e1 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 204 len: 0 microversion: 2.1 time: 0.255973 Mar 26 21:13:33.335975 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2724/5186] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:13:33 2022] DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:13:33.344366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:33.345219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:33.356220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:33.360771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:33.362015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:33.362635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:33.596858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:33.606870 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-518ab2a3-a971-4097-ad55-494820cb3f1d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1679 microversion: 2.1 time: 0.266903 Mar 26 21:13:33.618477 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2463/5187] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:33 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1679 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:34.627431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:34.629172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:34.637690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:34.638559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:34.639508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:34.640149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:35.006351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:35.021169 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b79fafc9-9e01-48c0-9a81-6a2f80de022d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1679 microversion: 2.1 time: 0.397996 Mar 26 21:13:35.023074 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2725/5188] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:34 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1679 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:36.043018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:36.043650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:36.057858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:36.058317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:36.060180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:36.060938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:37.036678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:37.050667 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c1c19fe-ba82-4f93-a013-f971b7a174b6 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1679 microversion: 2.1 time: 1.011662 Mar 26 21:13:37.056586 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2464/5189] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:36 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1679 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:38.085391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:38.101125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a6818e77-73cd-43c1-9a2e-fc5ad0be5ba1 req-47a47c84-a7d1-4a9e-8437-3647d2822852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3efc-fabf-4bd5-9adb-7f04b1995029", "name": "network-vif-deleted", "tag": "78d52758-4af7-474e-90cb-4760903aefc8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:38.102291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:38.138073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:38.143235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:38.146286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a6818e77-73cd-43c1-9a2e-fc5ad0be5ba1 req-47a47c84-a7d1-4a9e-8437-3647d2822852 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:38.146976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:38.153246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:38.154830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a6818e77-73cd-43c1-9a2e-fc5ad0be5ba1 req-47a47c84-a7d1-4a9e-8437-3647d2822852 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:38.223156 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a6818e77-73cd-43c1-9a2e-fc5ad0be5ba1 req-47a47c84-a7d1-4a9e-8437-3647d2822852 service nova] Creating event network-vif-deleted:78d52758-4af7-474e-90cb-4760903aefc8 for instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 on nch2-master-1 Mar 26 21:13:38.266439 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a6818e77-73cd-43c1-9a2e-fc5ad0be5ba1 req-47a47c84-a7d1-4a9e-8437-3647d2822852 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156352 Mar 26 21:13:38.269414 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2465/5190] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:38.390388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:38.407757 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57f57864-cc11-4930-9b52-659e860ac95a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 200 len: 1327 microversion: 2.1 time: 0.336963 Mar 26 21:13:38.414465 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2726/5191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:38 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:39.432970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:39.434343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:39.456479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:39.456950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:39.457753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:39.458196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:39.498838 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. Mar 26 21:13:39.499641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:13:39.500693 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9344b06-4eec-46fd-9110-e7c8bf89cb27 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 404 len: 111 microversion: 2.1 time: 0.073775 Mar 26 21:13:39.502315 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2466/5192] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:39 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:13:39.510608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e32d3b35-4016-408a-9f8b-d1f621bc293f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '.version_select at 0x7f6e4be904c0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:39.547564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e32d3b35-4016-408a-9f8b-d1f621bc293f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527211117" status: 202 len: 0 microversion: 2.1 time: 0.038948 Mar 26 21:13:39.548346 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2727/5193] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527211117 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:13:41.595613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: .version_select at 0x7f6e59445ee0>, body: {"keypair": {"name": "tempest-keypair-1079369022"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:41.612913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:13:41.620659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:13:41.847602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:13:41.867773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:13:41.923352 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ff1e243-7e30-42a2-a0b2-c3de441767c7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.333766 Mar 26 21:13:41.928896 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2467/5194] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:13:41 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:44.932428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1281164877", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9977cf9e-5b17-4b99-a9a4-a525bfdbd22a"}], "security_groups": [{"name": "tempest-securitygroup--1744113814"}], "key_name": "tempest-keypair-1079369022", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:45.173472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] validate_networks() for [('9977cf9e-5b17-4b99-a9a4-a525bfdbd22a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:13:46.346118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:13:46.346738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:13:46.347114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:13:46.348373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:13:46.348961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:13:46.358760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:46.359514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:46.360519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:46.361140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:46.381593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:13:46.387437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:13:46.400985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:13:46.403726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:13:46.517246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-565e3be8-5ea0-4d67-82b4-70029ac8d8be tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.591404 Mar 26 21:13:46.518420 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2728/5195] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:13:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:13:46.529002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73397513-e1bc-4b07-b2b6-14e443464e86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:46.530217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73397513-e1bc-4b07-b2b6-14e443464e86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:46.665982 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73397513-e1bc-4b07-b2b6-14e443464e86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:46.678249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73397513-e1bc-4b07-b2b6-14e443464e86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1242 microversion: 2.1 time: 0.152026 Mar 26 21:13:46.688738 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2468/5196] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:46 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:47.695818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:47.697174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:47.710078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:47.712502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:47.713731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:47.714358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:47.815224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:47.826040 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d75f9dfa-4dfa-4666-a2e0-ee04510f2238 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1294 microversion: 2.1 time: 0.134988 Mar 26 21:13:47.832534 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2729/5197] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:47 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1294 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:48.846750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:48.848034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:48.857170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:48.857659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:48.858584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:48.859036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:48.987323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:48.995799 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b0eeb58-c185-44cb-8258-e856d2e1305e tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1300 microversion: 2.1 time: 0.153606 Mar 26 21:13:48.996553 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2469/5198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:48 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:50.014819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:50.015563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:50.045372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:50.047452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:50.050088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:50.052420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:50.179460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:50.190233 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8213cab-5af5-4a84-a370-33570ce79873 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1300 microversion: 2.1 time: 0.179501 Mar 26 21:13:50.201374 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2730/5199] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:50 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:51.210733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:51.212243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:51.225641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:51.226355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:51.227366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:51.228173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:51.642539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:51.653377 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a59eb054-eb52-45a3-800c-6601e618a500 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.448884 Mar 26 21:13:51.663299 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2470/5200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:51 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:52.487213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-98237bd3-485d-4883-8f0b-74925e532fee req-ec0fc7a4-f5d9-4e23-bdd5-d92a95bb05d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a385a731-a831-4390-a22f-d415b88ab971", "tag": "58fdf8b9-05fd-4e59-b16d-30ba582da9ad"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:52.498778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-98237bd3-485d-4883-8f0b-74925e532fee req-ec0fc7a4-f5d9-4e23-bdd5-d92a95bb05d8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:52.499641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-98237bd3-485d-4883-8f0b-74925e532fee req-ec0fc7a4-f5d9-4e23-bdd5-d92a95bb05d8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:52.513196 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-98237bd3-485d-4883-8f0b-74925e532fee req-ec0fc7a4-f5d9-4e23-bdd5-d92a95bb05d8 service nova] Creating event network-changed:58fdf8b9-05fd-4e59-b16d-30ba582da9ad for instance a385a731-a831-4390-a22f-d415b88ab971 on nch2-master-1 Mar 26 21:13:52.519807 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-98237bd3-485d-4883-8f0b-74925e532fee req-ec0fc7a4-f5d9-4e23-bdd5-d92a95bb05d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036301 Mar 26 21:13:52.523257 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2731/5201] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:52.671708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:52.673059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:52.685617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:52.689025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:52.691778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:52.692498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:53.158192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:53.166280 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b2c48c8-b3f4-4d24-8ab7-31def314946b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.499743 Mar 26 21:13:53.169175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2471/5202] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:52 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:54.188053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:54.189435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:54.197680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:54.198486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:54.199337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:54.199999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:54.896947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:54.907054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-12564dc7-caab-45fc-8c70-42be98407658 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.724046 Mar 26 21:13:54.917260 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2732/5203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:54 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:55.927888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:55.929182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:55.948785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:55.949509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:55.950484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:55.951150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:56.417926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:56.427353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-294945b8-6fcc-4f5a-aaf3-7dcd96cc6524 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.505510 Mar 26 21:13:56.428706 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2472/5204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:55 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:57.450701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:57.453063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:57.465442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:57.466224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:57.467514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:57.468444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:57.743962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:57.756603 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d463facd-a91e-4e66-b7e7-a682f036cc88 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.314614 Mar 26 21:13:57.758186 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2733/5205] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:57 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:13:58.412518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0551dcaa-493b-4009-8e34-0c79cf12b528 req-aec9a2cd-cbc4-4162-92d5-b9d648086b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a385a731-a831-4390-a22f-d415b88ab971", "name": "network-vif-plugged", "status": "completed", "tag": "58fdf8b9-05fd-4e59-b16d-30ba582da9ad"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:13:58.422407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0551dcaa-493b-4009-8e34-0c79cf12b528 req-aec9a2cd-cbc4-4162-92d5-b9d648086b4a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:58.424221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0551dcaa-493b-4009-8e34-0c79cf12b528 req-aec9a2cd-cbc4-4162-92d5-b9d648086b4a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:58.441537 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0551dcaa-493b-4009-8e34-0c79cf12b528 req-aec9a2cd-cbc4-4162-92d5-b9d648086b4a service nova] Creating event network-vif-plugged:58fdf8b9-05fd-4e59-b16d-30ba582da9ad for instance a385a731-a831-4390-a22f-d415b88ab971 on nch2-master-1 Mar 26 21:13:58.448263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0551dcaa-493b-4009-8e34-0c79cf12b528 req-aec9a2cd-cbc4-4162-92d5-b9d648086b4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039575 Mar 26 21:13:58.449113 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2473/5206] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:13:58.776273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:13:58.777852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:13:58.799340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:58.800821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:58.802537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:13:58.803177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:13:59.440363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:13:59.449092 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-488e233e-73a6-4eeb-a7fc-6e3111754244 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1368 microversion: 2.1 time: 0.678883 Mar 26 21:13:59.460280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2734/5207] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:13:58 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1368 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:00.471181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:00.472566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:00.481687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:00.482467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:00.483540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:00.491846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:00.729855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:00.748393 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b73adb87-783a-4a51-8acd-fcfba7e626bf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1558 microversion: 2.1 time: 0.279335 Mar 26 21:14:00.749868 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2474/5208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:00 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1558 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:00.768382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:00.769547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:00.778621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:00.779308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:00.780323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:00.780938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:00.948216 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11856ba7-70b7-492d-a8e2-4b795495a5e4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184416 Mar 26 21:14:00.955569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2735/5209] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:14:00 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:03.095415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-48f23dbc-2a5a-4c03-993e-dfc4186b3496 req-3c5446f6-739d-4f1a-9f4e-d2a76be2fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a385a731-a831-4390-a22f-d415b88ab971", "tag": "58fdf8b9-05fd-4e59-b16d-30ba582da9ad"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:03.107267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-48f23dbc-2a5a-4c03-993e-dfc4186b3496 req-3c5446f6-739d-4f1a-9f4e-d2a76be2fd2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:03.107737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-48f23dbc-2a5a-4c03-993e-dfc4186b3496 req-3c5446f6-739d-4f1a-9f4e-d2a76be2fd2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:03.135817 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-48f23dbc-2a5a-4c03-993e-dfc4186b3496 req-3c5446f6-739d-4f1a-9f4e-d2a76be2fd2a service nova] Creating event network-changed:58fdf8b9-05fd-4e59-b16d-30ba582da9ad for instance a385a731-a831-4390-a22f-d415b88ab971 on nch2-master-1 Mar 26 21:14:03.142587 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-48f23dbc-2a5a-4c03-993e-dfc4186b3496 req-3c5446f6-739d-4f1a-9f4e-d2a76be2fd2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050500 Mar 26 21:14:03.143699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2475/5210] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:11.033223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1312937573", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "df0776a3-f816-466d-b007-a74c90af681a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-698869704", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c12d8236-39b7-4448-9a97-6481f621decf"]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:11.145558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] validate_networks() for [('df0776a3-f816-466d-b007-a74c90af681a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:14:11.904717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:14:11.906698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:14:11.907778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:14:11.909426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:14:11.911381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:14:11.945390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:11.946270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:11.948629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:11.950186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:11.986511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for project fc922ea5d1564695ac143b86d7123f25. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:14:12.001929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Getting quotas for user 981e1bf6531f45c4b8911579995eecc0 and project fc922ea5d1564695ac143b86d7123f25. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:14:12.020802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:14:12.024736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:14:12.087797 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f54942f-aa33-4da6-86a6-3ec89ebd5633 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.061744 Mar 26 21:14:12.089645 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2736/5211] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:14:11 2022] POST /compute/v2.1/servers => generated 361 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:14:12.100627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6abf1e42-8518-4e78-95c4-7203532ade46 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:12.104252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6abf1e42-8518-4e78-95c4-7203532ade46 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:12.510499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6abf1e42-8518-4e78-95c4-7203532ade46 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:12.519441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6abf1e42-8518-4e78-95c4-7203532ade46 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1241 microversion: 2.1 time: 0.423536 Mar 26 21:14:12.521348 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2476/5212] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:12 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1241 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:13.537431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:13.538015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:13.553184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:13.553855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:13.554830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:13.555745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:13.772725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:13.789140 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88e6750f-8301-4e6f-8ed0-cfaf0da12a50 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.256396 Mar 26 21:14:13.791020 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2737/5213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:13 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:14.808444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:14.810044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:14.825662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:14.826440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:14.827701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:14.828835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:15.130486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:15.140982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-928654b0-97d3-4289-84e5-378462d10099 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.335541 Mar 26 21:14:15.144777 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2477/5214] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:14 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:15.791023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3781c97a-c96b-43e4-917d-9e2dc380a7c4 req-53f450d6-2806-4711-9070-e02c599d9ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df813a6-d672-4622-9a0a-b19a0ad35ef9", "tag": "782f18e7-259e-4695-9fad-8b82f3fd07df"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:15.810902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3781c97a-c96b-43e4-917d-9e2dc380a7c4 req-53f450d6-2806-4711-9070-e02c599d9ebb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:15.811366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3781c97a-c96b-43e4-917d-9e2dc380a7c4 req-53f450d6-2806-4711-9070-e02c599d9ebb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:15.858891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3781c97a-c96b-43e4-917d-9e2dc380a7c4 req-53f450d6-2806-4711-9070-e02c599d9ebb service nova] Creating event network-changed:782f18e7-259e-4695-9fad-8b82f3fd07df for instance 8df813a6-d672-4622-9a0a-b19a0ad35ef9 on nch2-master-1 Mar 26 21:14:15.872166 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3781c97a-c96b-43e4-917d-9e2dc380a7c4 req-53f450d6-2806-4711-9070-e02c599d9ebb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085116 Mar 26 21:14:15.876547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2738/5215] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:16.158122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:16.158844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:16.168066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:16.171253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:16.172966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:16.176786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:16.338640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:16.347622 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25c616df-ba30-4d8e-a3c5-10d0e70f25a7 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.193347 Mar 26 21:14:16.348334 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2478/5216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:16 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:17.373565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:17.374382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:17.384613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:17.385074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:17.385867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:17.386308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:17.524737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:17.534219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e336f331-ffa2-4086-aa1e-407971251ce9 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.171909 Mar 26 21:14:17.546208 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2739/5217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:17 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:18.552161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:18.552779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:18.564210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:18.565880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:18.572779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:18.576240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:18.781768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:18.790300 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2caf5ee-4f25-4856-a4da-6b5559cda4a2 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.242141 Mar 26 21:14:18.798089 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2479/5218] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:18 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:19.811241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:19.812236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:19.820363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:19.821100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:19.822062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:19.822679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:19.997054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:20.015436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9208918-72c5-4a5c-be2f-f0164a860e8a tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.208537 Mar 26 21:14:20.016865 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2740/5219] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:19 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:20.555644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-be3c75b6-fb9b-42f0-bad2-7c6178388f6d req-4939160b-5640-490d-abf9-3e4877da07fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df813a6-d672-4622-9a0a-b19a0ad35ef9", "name": "network-vif-plugged", "status": "completed", "tag": "782f18e7-259e-4695-9fad-8b82f3fd07df"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:20.570320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-be3c75b6-fb9b-42f0-bad2-7c6178388f6d req-4939160b-5640-490d-abf9-3e4877da07fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:20.571000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-be3c75b6-fb9b-42f0-bad2-7c6178388f6d req-4939160b-5640-490d-abf9-3e4877da07fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:20.587358 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-be3c75b6-fb9b-42f0-bad2-7c6178388f6d req-4939160b-5640-490d-abf9-3e4877da07fd service nova] Creating event network-vif-plugged:782f18e7-259e-4695-9fad-8b82f3fd07df for instance 8df813a6-d672-4622-9a0a-b19a0ad35ef9 on nch2-master-1 Mar 26 21:14:20.592805 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-be3c75b6-fb9b-42f0-bad2-7c6178388f6d req-4939160b-5640-490d-abf9-3e4877da07fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047187 Mar 26 21:14:20.593951 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2480/5220] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:21.034358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:21.035009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:21.043347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:21.044400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:21.045503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:21.046106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:21.323697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:21.332640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1682b363-472c-45d8-828f-ff9fd5062545 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1299 microversion: 2.1 time: 0.301726 Mar 26 21:14:21.333852 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2741/5221] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:21 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1299 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:22.351164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:22.351966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:22.359821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.360309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.361108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.361841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.560546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:22.571529 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9bb6e96-3179-4865-83b4-86e9208a25b0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1472 microversion: 2.1 time: 0.225358 Mar 26 21:14:22.573835 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2481/5222] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:22 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:22.590362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:22.590979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:22.599621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.600358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.601320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.601928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.775711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:22.786118 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-140b8211-3527-4518-812c-454dba355a75 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1472 microversion: 2.1 time: 0.199078 Mar 26 21:14:22.787550 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2742/5223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:22 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:22.803025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:22.803896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:22.811196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.811663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.812515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:22.813281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:22.978452 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c24c02f8-6382-4aa2-970d-4c98e1307502 tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1623 microversion: 2.1 time: 0.174983 Mar 26 21:14:22.980229 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2482/5224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:22 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1623 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:22.996377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:22.997194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:23.007407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.008189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.010130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.012582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.327348 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-94d87e46-c29e-48b0-93d0-e64d1a0c8d0c tempest-TestSecurityGroupsBasicOps-2113354031 tempest-TestSecurityGroupsBasicOps-2113354031-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1913 microversion: 2.1 time: 0.335017 Mar 26 21:14:23.332165 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2483/5225] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:22 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1913 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:14:23.376889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:23.377463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:23.384544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.385983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.386816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.387270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.418103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:14:23.485780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:23.486351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:23.496184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.496813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.498022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.498573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.532470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:14:23.556645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19d2b66e-6a2a-4bc4-a807-ab2329745af9 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 204 len: 0 microversion: 2.42 time: 0.614374 Mar 26 21:14:23.559961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2743/5226] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:14:22 2022] DELETE /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:14:23.570932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:23.572579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:23.588072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.588867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.589856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.590420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.662411 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61fb6e32-d107-4e6d-9764-66a05ac16388 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 204 len: 0 microversion: 2.1 time: 0.180340 Mar 26 21:14:23.665891 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2484/5227] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:14:23 2022] DELETE /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:14:23.676469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:23.677190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:23.685287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.685764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.686595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:23.687048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:23.871354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:23.879456 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f02241d-4f18-4626-90e6-e7df882d1f28 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1478 microversion: 2.1 time: 0.207840 Mar 26 21:14:23.880320 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2485/5228] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:23 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:14:23.943981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:23.975875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:23.977686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:23.979201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9541fb97-0e1b-446b-a6e3-88ddbc385919 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2964 microversion: 2.42 time: 0.416290 Mar 26 21:14:23.979859 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2744/5229] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:23 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2964 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:24.897725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:24.899242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:24.911525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:24.912208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:24.913010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:24.913455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:25.000669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:25.003533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:25.017367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:25.017842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:25.022070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:25.022537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:25.060314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:25.071748 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4bcb58e-9fb1-49e7-a8c9-e6c3626eacd6 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1478 microversion: 2.1 time: 0.178504 Mar 26 21:14:25.099504 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2486/5230] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:24 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1478 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:25.488977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:25.513858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:25.516101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:25.520713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9cd781d0-4b8f-4e27-be46-6d8c77fe0693 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2964 microversion: 2.42 time: 0.524070 Mar 26 21:14:25.521906 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2745/5231] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:24 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2964 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:25.869411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a959a8bf-10ad-425b-a115-6b4f1e1d1622 req-5113703f-49c7-4ee2-b6ee-d58b18523a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df813a6-d672-4622-9a0a-b19a0ad35ef9", "name": "network-vif-deleted", "tag": "782f18e7-259e-4695-9fad-8b82f3fd07df"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:25.884315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a959a8bf-10ad-425b-a115-6b4f1e1d1622 req-5113703f-49c7-4ee2-b6ee-d58b18523a65 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:25.885522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a959a8bf-10ad-425b-a115-6b4f1e1d1622 req-5113703f-49c7-4ee2-b6ee-d58b18523a65 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:25.930219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a959a8bf-10ad-425b-a115-6b4f1e1d1622 req-5113703f-49c7-4ee2-b6ee-d58b18523a65 service nova] Creating event network-vif-deleted:782f18e7-259e-4695-9fad-8b82f3fd07df for instance 8df813a6-d672-4622-9a0a-b19a0ad35ef9 on nch2-master-1 Mar 26 21:14:25.945023 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a959a8bf-10ad-425b-a115-6b4f1e1d1622 req-5113703f-49c7-4ee2-b6ee-d58b18523a65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080669 Mar 26 21:14:25.945654 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2487/5232] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:26.089639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:26.090173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:26.096872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:26.097329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:26.098158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:26.098604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:26.129733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:26.130187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:26.130886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lazy-loading 'fault' on Instance uuid 8df813a6-d672-4622-9a0a-b19a0ad35ef9 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:14:26.182850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:26.190224 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd3da9ca-4601-4fac-a90a-f113f607747c tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 200 len: 1331 microversion: 2.1 time: 0.104549 Mar 26 21:14:26.190990 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2746/5233] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:26 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:26.546913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:26.548033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:26.563663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:26.564481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:26.565640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:26.566085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:26.864945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:26.876273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:26.877804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:26.879825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3be1d84-8309-4bbd-be43-3cd7d81e00bc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2964 microversion: 2.42 time: 0.338725 Mar 26 21:14:26.880600 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2488/5234] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:26 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2964 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:27.209096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:27.210852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: 8df813a6-d672-4622-9a0a-b19a0ad35ef9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:27.218362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:27.219247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:27.220368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:27.220982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:27.239300 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] HTTP exception thrown: Instance 8df813a6-d672-4622-9a0a-b19a0ad35ef9 could not be found. Mar 26 21:14:27.240494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Returning 404 to user: Instance 8df813a6-d672-4622-9a0a-b19a0ad35ef9 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:27.241518 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0d94b2b-bb36-46a6-8bb5-7f6224254508 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9" status: 404 len: 111 microversion: 2.1 time: 0.037200 Mar 26 21:14:27.242585 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2747/5235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:27 2022] GET /compute/v2.1/servers/8df813a6-d672-4622-9a0a-b19a0ad35ef9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:14:27.902023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:27.902663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:27.913298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:27.914048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:27.915041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:27.916143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:28.247123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:28.261032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:28.265624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:28.267276 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba244988-3039-4125-a618-67e0f896083b tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2943 microversion: 2.42 time: 0.369880 Mar 26 21:14:28.268446 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2489/5236] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:27 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2943 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:28.310344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-bd946dcd-5e4d-46c6-ba5b-948e2cb96cd3 req-6405be15-eecc-47d4-abdb-8d99d9e944d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0e9d94a8-a505-4bce-9e95-8b10eaee424e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:28.325420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bd946dcd-5e4d-46c6-ba5b-948e2cb96cd3 req-6405be15-eecc-47d4-abdb-8d99d9e944d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:28.326215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-bd946dcd-5e4d-46c6-ba5b-948e2cb96cd3 req-6405be15-eecc-47d4-abdb-8d99d9e944d1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:28.344523 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-bd946dcd-5e4d-46c6-ba5b-948e2cb96cd3 req-6405be15-eecc-47d4-abdb-8d99d9e944d1 service nova] Creating event network-vif-unplugged:0e9d94a8-a505-4bce-9e95-8b10eaee424e for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:28.354237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-bd946dcd-5e4d-46c6-ba5b-948e2cb96cd3 req-6405be15-eecc-47d4-abdb-8d99d9e944d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050004 Mar 26 21:14:28.356212 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2748/5237] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:29.289302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:29.291218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:29.312815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:29.313394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:29.314217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:29.314810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:29.629582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:29.641969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:29.643762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:29.645529 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d0cf2ac-4abc-4285-bcba-ff23da64ecd1 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2922 microversion: 2.42 time: 0.361712 Mar 26 21:14:29.647005 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2490/5238] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:29 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2922 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:29.904303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f7f6ec03-2bf7-461a-a69f-6cd1b6cdab94 req-b000248a-48e6-4ba4-ac62-d8308c6967b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-deleted", "tag": "22b73853-ba48-4af3-b54b-5bc85d9fee52"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:29.935317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f7f6ec03-2bf7-461a-a69f-6cd1b6cdab94 req-b000248a-48e6-4ba4-ac62-d8308c6967b7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:29.940707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f7f6ec03-2bf7-461a-a69f-6cd1b6cdab94 req-b000248a-48e6-4ba4-ac62-d8308c6967b7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:29.978639 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f7f6ec03-2bf7-461a-a69f-6cd1b6cdab94 req-b000248a-48e6-4ba4-ac62-d8308c6967b7 service nova] Creating event network-vif-deleted:22b73853-ba48-4af3-b54b-5bc85d9fee52 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:29.994277 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f7f6ec03-2bf7-461a-a69f-6cd1b6cdab94 req-b000248a-48e6-4ba4-ac62-d8308c6967b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094509 Mar 26 21:14:29.995185 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2749/5239] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:30.447425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b38732-461a-4f7b-b115-580ff04122e3"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "9f26816b-64ca-4f6e-bc7f-0723c5bf7f79"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "22b73853-ba48-4af3-b54b-5bc85d9fee52"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-unplugged", "status": "completed", "tag": "3776e0f7-2a1d-4dbf-b7ac-963e98079436"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:30.478058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:30.481682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:30.532268 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Creating event network-vif-unplugged:e3b38732-461a-4f7b-b115-580ff04122e3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:30.532785 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Creating event network-vif-unplugged:9f26816b-64ca-4f6e-bc7f-0723c5bf7f79 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:30.533294 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Creating event network-vif-unplugged:22b73853-ba48-4af3-b54b-5bc85d9fee52 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:30.533792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] Creating event network-vif-unplugged:3776e0f7-2a1d-4dbf-b7ac-963e98079436 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:30.545849 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-6cddb186-7a48-4f5a-9dcc-c43fed7ada33 req-617c146a-c572-4e73-9db6-18ea21439356 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.103254 Mar 26 21:14:30.546475 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2491/5240] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:30.672202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:30.673800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:30.685217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:30.685736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:30.687851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:30.702256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:31.204279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:31.214260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:31.219456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:31.231090 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a55166a-34bd-4fa1-8e8c-3f3ba5fbe700 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2535 microversion: 2.42 time: 0.564061 Mar 26 21:14:31.245090 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2750/5241] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:30 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2535 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:32.049441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-deleted", "tag": "3776e0f7-2a1d-4dbf-b7ac-963e98079436"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-deleted", "tag": "9f26816b-64ca-4f6e-bc7f-0723c5bf7f79"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:32.084064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:32.084546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:32.135035 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] Creating event network-vif-deleted:3776e0f7-2a1d-4dbf-b7ac-963e98079436 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:32.135792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] Creating event network-vif-deleted:9f26816b-64ca-4f6e-bc7f-0723c5bf7f79 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:32.152261 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0401a9f9-1a90-4d16-80dd-d322b3a96f37 req-3f05bf70-6e70-4405-9a22-bbb0082e1d82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114199 Mar 26 21:14:32.158122 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2492/5242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:32.255792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:32.257190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:32.273282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:32.276039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:32.278499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:32.279246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:32.814538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:32.836383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:32.838484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:32.840115 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-23130007-473d-4124-a918-9cdb44b8412d tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 2214 microversion: 2.42 time: 0.592775 Mar 26 21:14:32.841291 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2751/5243] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:32 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 2214 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:33.877981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:33.884528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:33.901117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:33.902087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:33.919963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:33.920933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:34.131540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:34.147780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:34.154377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd05073d7e52411c92d7b9def363dd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a821ba46f3f5408ab82098a1d2d8a926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:34.159593 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-061a670a-4a72-4cef-a8ee-197c63303fdc tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 200 len: 1605 microversion: 2.42 time: 0.296689 Mar 26 21:14:34.161286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2493/5244] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:33 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 1605 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 26 21:14:34.211606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-deleted", "tag": "e3b38732-461a-4f7b-b115-580ff04122e3"}, {"server_uuid": "f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1", "name": "network-vif-deleted", "tag": "0e9d94a8-a505-4bce-9e95-8b10eaee424e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:34.230082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:34.230819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:34.266903 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] Creating event network-vif-deleted:e3b38732-461a-4f7b-b115-580ff04122e3 for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:34.268999 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] Creating event network-vif-deleted:0e9d94a8-a505-4bce-9e95-8b10eaee424e for instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 on nch2-master-1 Mar 26 21:14:34.276559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-25008507-d887-4db4-821f-4751fa6f0361 req-2af55c58-6a0b-4fcf-8475-1c4ff277e4ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069135 Mar 26 21:14:34.277484 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2752/5245] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:35.181614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:35.182319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:35.196138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:35.202949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:35.203928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:35.204407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:35.242456 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] HTTP exception thrown: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. Mar 26 21:14:35.248648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Returning 404 to user: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:35.250108 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9b70a89-286a-4f37-9935-3d4ce8c9eb52 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 404 len: 111 microversion: 2.42 time: 0.073191 Mar 26 21:14:35.252561 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2494/5246] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:35 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:14:35.264704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-522336b1-37b1-4192-89e7-742b0d89fdf6 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '.version_select at 0x7f6e4bf24790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:35.313357 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-522336b1-37b1-4192-89e7-742b0d89fdf6 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539819829" status: 204 len: 0 microversion: 2.42 time: 0.054831 Mar 26 21:14:35.318275 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2753/5247] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Mar 26 21:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539819829 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 26 21:14:36.245777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:36.247124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:36.261317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:36.262203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:36.268354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:36.269963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:36.320464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cb10928d-dd6b-4835-80d0-7e01eaebd771 req-6c4e9d0c-5a46-43c7-94ce-9e7775a297fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12d8236-39b7-4448-9a97-6481f621decf", "tag": "71d8ff85-a336-4e4d-bc38-cd6bdfd77b55"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:36.350034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:14:36.355932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb10928d-dd6b-4835-80d0-7e01eaebd771 req-6c4e9d0c-5a46-43c7-94ce-9e7775a297fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:36.357868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cb10928d-dd6b-4835-80d0-7e01eaebd771 req-6c4e9d0c-5a46-43c7-94ce-9e7775a297fd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:36.384220 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cb10928d-dd6b-4835-80d0-7e01eaebd771 req-6c4e9d0c-5a46-43c7-94ce-9e7775a297fd service nova] Creating event network-changed:71d8ff85-a336-4e4d-bc38-cd6bdfd77b55 for instance c12d8236-39b7-4448-9a97-6481f621decf on nch1-master-1 Mar 26 21:14:36.400431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cb10928d-dd6b-4835-80d0-7e01eaebd771 req-6c4e9d0c-5a46-43c7-94ce-9e7775a297fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079294 Mar 26 21:14:36.401564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2754/5248] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:14:36.535148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4cb044c7-6f1c-4ea3-bad2-58abd43ced76 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 204 len: 0 microversion: 2.1 time: 0.297690 Mar 26 21:14:36.536172 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2495/5249] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:14:36 2022] DELETE /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:14:36.546609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:36.547706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:36.564908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:36.569148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:36.572027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:36.572644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:37.529524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:37.560925 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b95c9ae8-9b2e-46d9-affe-21bc9200cd32 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1768 microversion: 2.1 time: 1.016011 Mar 26 21:14:37.567839 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2755/5250] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:36 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1768 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:37.828531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:37.829225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:37.850610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:37.850946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:37.851880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:37.852197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:37.967939 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bca9920c-bc59-40e2-9056-4174953fe100 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/ips" status: 200 len: 149 microversion: 2.1 time: 0.142176 Mar 26 21:14:37.972549 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2496/5251] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:14:37 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/ips => generated 149 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:38.585848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:38.587308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:38.603582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:38.604527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:38.605596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:38.608802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:39.092964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:39.112779 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ec9662d-8fb1-406a-b867-e2e56a23c61b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1650 microversion: 2.1 time: 0.531348 Mar 26 21:14:39.113398 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2756/5252] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:38 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1650 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:39.610211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ebe31e0c-b052-4d1d-abbe-617e7689a6bc req-74f4e3b2-eb31-4beb-b9ec-f0a63930cf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12d8236-39b7-4448-9a97-6481f621decf", "name": "network-vif-deleted", "tag": "71d8ff85-a336-4e4d-bc38-cd6bdfd77b55"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:39.659408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ebe31e0c-b052-4d1d-abbe-617e7689a6bc req-74f4e3b2-eb31-4beb-b9ec-f0a63930cf9c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:39.662160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ebe31e0c-b052-4d1d-abbe-617e7689a6bc req-74f4e3b2-eb31-4beb-b9ec-f0a63930cf9c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:39.683203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e254a2-447a-477c-aaaf-fc114ba77750"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:39.683203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:39.694349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:39.695308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:39.697189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:39.699629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:39.703531 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ebe31e0c-b052-4d1d-abbe-617e7689a6bc req-74f4e3b2-eb31-4beb-b9ec-f0a63930cf9c service nova] Creating event network-vif-deleted:71d8ff85-a336-4e4d-bc38-cd6bdfd77b55 for instance c12d8236-39b7-4448-9a97-6481f621decf on nch1-master-1 Mar 26 21:14:39.723013 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ebe31e0c-b052-4d1d-abbe-617e7689a6bc req-74f4e3b2-eb31-4beb-b9ec-f0a63930cf9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122490 Mar 26 21:14:39.724024 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2497/5253] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:40.137630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:40.138408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:40.158311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:40.158783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:40.159020 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-539c7c5c-07e2-4756-894e-c3767755e6bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490107 Mar 26 21:14:40.162128 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2757/5254] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:14:39 2022] POST /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:14:40.179714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:40.181053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:40.262801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:40.263423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:40.263888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lazy-loading 'fault' on Instance uuid c12d8236-39b7-4448-9a97-6481f621decf {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:14:40.402177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981e1bf6531f45c4b8911579995eecc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc922ea5d1564695ac143b86d7123f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:40.428443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4c24d0a-9c34-4e7c-92fe-503f4564b903 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 200 len: 1384 microversion: 2.1 time: 0.301092 Mar 26 21:14:40.431969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2498/5255] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:40 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 1384 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:14:41.449253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:41.450782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] [instance: c12d8236-39b7-4448-9a97-6481f621decf] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:41.463196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:41.464019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:41.467360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:41.468199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:41.506597 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] HTTP exception thrown: Instance c12d8236-39b7-4448-9a97-6481f621decf could not be found. Mar 26 21:14:41.507568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Returning 404 to user: Instance c12d8236-39b7-4448-9a97-6481f621decf could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:41.509783 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3086d495-f758-4337-ab9f-0afd0ef3363b tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf" status: 404 len: 111 microversion: 2.1 time: 0.065634 Mar 26 21:14:41.510570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2758/5256] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:41 2022] GET /compute/v2.1/servers/c12d8236-39b7-4448-9a97-6481f621decf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:14:42.282257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:42.283829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:42.296289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:42.297449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:42.299332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:42.299939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:42.347578 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] HTTP exception thrown: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. Mar 26 21:14:42.351089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Returning 404 to user: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:42.352578 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51e47d90-539b-465c-a0bb-20789df3ae82 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 404 len: 111 microversion: 2.42 time: 0.074759 Mar 26 21:14:42.353994 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2499/5257] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Mar 26 21:14:42 2022] DELETE /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:14:42.376252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:42.378715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] [instance: f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:42.400067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:42.400537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:42.401333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:42.407218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:42.464168 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] HTTP exception thrown: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. Mar 26 21:14:42.464983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] Returning 404 to user: Instance f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:42.465870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-07696bfa-d5b7-409b-8b42-eb8a2adacf76 tempest-TaggedBootDevicesTest_v242-272398941 tempest-TaggedBootDevicesTest_v242-272398941-project] 10.222.0.16 "GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1" status: 404 len: 111 microversion: 2.42 time: 0.107771 Mar 26 21:14:42.468761 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2759/5258] 10.222.0.16 () {60 vars in 1276 bytes} [Sat Mar 26 21:14:42 2022] GET /compute/v2.1/servers/f9a1ca4f-2310-41b3-87fe-a7da4e12c2c1 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:14:43.625540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e254a2-447a-477c-aaaf-fc114ba77750"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:43.626623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:43.636169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:43.636568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:43.637564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:43.638589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:43.762308 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Invalid volume: volume 08e254a2-447a-477c-aaaf-fc114ba77750 is already attached to instances: a385a731-a831-4390-a22f-d415b88ab971 Mar 26 21:14:43.764221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 400 to user: Invalid volume: volume 08e254a2-447a-477c-aaaf-fc114ba77750 is already attached to instances: a385a731-a831-4390-a22f-d415b88ab971 {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:43.765391 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-429c1e1d-ce1c-40ee-af26-a0cd8758cf6f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143992 Mar 26 21:14:43.772350 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2500/5259] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:14:43 2022] POST /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:14:44.002827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:44.006689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:44.021659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:44.022362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:44.023669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:44.037652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:44.271987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lazy-loading 'services' on Instance uuid a385a731-a831-4390-a22f-d415b88ab971 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:14:44.438718 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c066e9f9-b75f-49f1-85d7-e48d162c2601 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments/08e254a2-447a-477c-aaaf-fc114ba77750" status: 202 len: 0 microversion: 2.1 time: 0.441716 Mar 26 21:14:44.451751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:44.453367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:44.459883 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2760/5260] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:14:43 2022] DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments/08e254a2-447a-477c-aaaf-fc114ba77750 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:14:44.463758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:44.464603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:44.465794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:44.467045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:44.555226 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa1b754f-69d3-4c8b-bc1a-b05ba7cbefd7 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108954 Mar 26 21:14:44.560604 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2501/5261] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:14:44 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:14:45.569035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:45.570110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:45.583037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.585699 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:45.586519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.588319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:45.627843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8dbe4853-fc03-47ed-958b-3f626834ff52 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063421 Mar 26 21:14:45.636815 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2761/5262] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:14:45 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:14:45.694566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:45.695118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:45.702596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.703397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:45.704516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.705186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:45.739696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:14:45.825755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-afcbaf08-6c6f-49fe-b05c-f5472c99e094 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 204 len: 0 microversion: 2.1 time: 0.135239 Mar 26 21:14:45.827047 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2502/5263] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:14:45 2022] DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:14:45.836303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:45.836926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:45.845133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.845617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:45.847441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:45.848183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:46.476793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:46.485425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6a35efec-ee64-4ac7-971a-87dcccd82c7a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1682 microversion: 2.1 time: 0.653185 Mar 26 21:14:46.489403 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2762/5264] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:45 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1682 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:47.506354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:47.507342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:47.518255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:47.524521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:47.527604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:47.528263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:47.710360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63442c90-789a-49ff-ad14-54219b7e46c0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] Calling method '.version_select at 0x7f6e4bf240d0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:47.749260 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-63442c90-789a-49ff-ad14-54219b7e46c0 tempest-TestSecurityGroupsBasicOps-1025096168 tempest-TestSecurityGroupsBasicOps-1025096168-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-698869704" status: 202 len: 0 microversion: 2.1 time: 0.044312 Mar 26 21:14:47.750493 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2763/5265] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-698869704 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:14:47.998599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:48.015384 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3abb7787-f0bf-4242-8993-8f200119c5bb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1682 microversion: 2.1 time: 0.511888 Mar 26 21:14:48.020268 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2503/5266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:47 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1682 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:49.037177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:49.037902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:49.048129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:49.058302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:49.064201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:49.064803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:49.192107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-fa4e8600-ff36-4b2d-bc53-28aa8ead7d67 req-57acd4d5-d042-4bd7-aff1-98b40fa3ce19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a385a731-a831-4390-a22f-d415b88ab971", "name": "network-vif-deleted", "tag": "58fdf8b9-05fd-4e59-b16d-30ba582da9ad"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:49.210536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fa4e8600-ff36-4b2d-bc53-28aa8ead7d67 req-57acd4d5-d042-4bd7-aff1-98b40fa3ce19 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:49.212449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-fa4e8600-ff36-4b2d-bc53-28aa8ead7d67 req-57acd4d5-d042-4bd7-aff1-98b40fa3ce19 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:49.219719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:49.229672 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d7b5d7f-d913-41db-a9d5-d62421dac63b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 200 len: 1614 microversion: 2.1 time: 0.196802 Mar 26 21:14:49.234901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2764/5267] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:49 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 1614 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:49.265771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-fa4e8600-ff36-4b2d-bc53-28aa8ead7d67 req-57acd4d5-d042-4bd7-aff1-98b40fa3ce19 service nova] Creating event network-vif-deleted:58fdf8b9-05fd-4e59-b16d-30ba582da9ad for instance a385a731-a831-4390-a22f-d415b88ab971 on nch2-master-1 Mar 26 21:14:49.275678 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-fa4e8600-ff36-4b2d-bc53-28aa8ead7d67 req-57acd4d5-d042-4bd7-aff1-98b40fa3ce19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088428 Mar 26 21:14:49.277048 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2504/5268] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:14:50.251847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:50.252751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:50.266556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:50.267797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:50.269966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:50.271668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:50.306392 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. Mar 26 21:14:50.307300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:14:50.308407 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-22bd9956-aa08-42a0-ab39-7c1937bf9813 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 404 len: 111 microversion: 2.1 time: 0.060890 Mar 26 21:14:50.309474 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2765/5269] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:50 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:14:50.320827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88c5bff7-7731-4bfb-acc9-e08862799507 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '.version_select at 0x7f6e59374940>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:50.354982 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88c5bff7-7731-4bfb-acc9-e08862799507 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079369022" status: 202 len: 0 microversion: 2.1 time: 0.040520 Mar 26 21:14:50.356202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2505/5270] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:14:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079369022 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:14:52.517852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: .version_select at 0x7f6e4bf4e790>, body: {"keypair": {"name": "tempest-keypair-465746663"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:52.542961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:14:52.553628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:14:53.195571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:14:53.203830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:14:53.229796 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b962d2e2-d79b-47cb-9d64-758f3e855030 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.715831 Mar 26 21:14:53.236088 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2766/5271] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:14:52 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:54.089361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:54.090068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:54.097420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:54.097881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:54.098912 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:54.099360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:54.226431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lazy-loading 'services' on Instance uuid 6d0f7556-44fc-42f7-b175-877f9e1574a1 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:14:54.345961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-64f5854e-37fa-4ea0-90de-d18bc69cc415 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1/os-volume_attachments/a1a81c96-3fa3-4167-be2b-3237aa8faf35" status: 202 len: 0 microversion: 2.1 time: 0.261196 Mar 26 21:14:54.348470 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2506/5272] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:14:54 2022] DELETE /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1/os-volume_attachments/a1a81c96-3fa3-4167-be2b-3237aa8faf35 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:14:55.558584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:55.559809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:55.566422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:55.567200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:55.568320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:55.568999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:55.600821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:14:55.718640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec06cd9d-ef87-4cb3-9c09-0b7300956d2f tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 204 len: 0 microversion: 2.1 time: 0.164759 Mar 26 21:14:55.726442 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2767/5273] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:14:55 2022] DELETE /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:14:55.732866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:55.735358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:55.746289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:55.747146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:55.748217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:55.748953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:56.358416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:56.376876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3388d6f5-26af-4c7e-a232-2e5821d4374b tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1513 microversion: 2.1 time: 0.650511 Mar 26 21:14:56.378130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2507/5274] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:55 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1513 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:56.620461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1807682674", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9977cf9e-5b17-4b99-a9a4-a525bfdbd22a"}], "security_groups": [{"name": "tempest-securitygroup--497068558"}], "key_name": "tempest-keypair-465746663", "user_data": "}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:56.827545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] validate_networks() for [('9977cf9e-5b17-4b99-a9a4-a525bfdbd22a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:14:57.394877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:57.395508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:57.412245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:57.412997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:57.413962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:57.414571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:57.836348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:14:57.839270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:14:57.839270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:14:57.839270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:14:57.839270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:14:57.867262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:57.867885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:57.868900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:57.871062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:57.878191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:57.887364 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-869b74ed-c88e-48ba-a4b3-6ef08bcd0385 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1513 microversion: 2.1 time: 0.496287 Mar 26 21:14:57.906599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2508/5275] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:57 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1513 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:57.934888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:14:57.943783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Getting quotas for user 41ad4fbc224446efaf5ad85c8c87eeab and project 3a8e16658cc541b2976c9325d1558792. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:14:57.986094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:14:57.990397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:14:58.109638 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58d09c5c-8a60-47aa-bbe4-7431696988fa tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.497562 Mar 26 21:14:58.110883 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2768/5276] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:14:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:14:58.130016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cfa2c747-f00c-4751-b6f4-f6fb90421e48 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:58.132282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cfa2c747-f00c-4751-b6f4-f6fb90421e48 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:58.240364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cfa2c747-f00c-4751-b6f4-f6fb90421e48 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:58.250670 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cfa2c747-f00c-4751-b6f4-f6fb90421e48 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1241 microversion: 2.1 time: 0.129140 Mar 26 21:14:58.253272 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2509/5277] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:58 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:58.910830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:58.912171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:58.923774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:58.930870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:58.932556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:58.933247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:59.064126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a09bedd0ad4328b1e687fc5f7e3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b4455ec1a2447ebb1f737c0d97fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:59.072312 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-88cfea27-0562-4789-b387-b0e24f328a8c tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 200 len: 1471 microversion: 2.1 time: 0.167149 Mar 26 21:14:59.075001 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2769/5278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:58 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:14:59.272340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:14:59.273412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:14:59.281669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:59.282764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:59.292650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:59.293446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:59.402081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7aae5c63-6153-40c8-b92f-cbc1624a349a req-2ecf6c03-e4d2-4ba7-b592-8ccb77acf6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0f7556-44fc-42f7-b175-877f9e1574a1", "name": "network-vif-deleted", "tag": "000821d1-4afa-4c85-8b22-1d3a08ad1232"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:14:59.427581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7aae5c63-6153-40c8-b92f-cbc1624a349a req-2ecf6c03-e4d2-4ba7-b592-8ccb77acf6a8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:14:59.428099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7aae5c63-6153-40c8-b92f-cbc1624a349a req-2ecf6c03-e4d2-4ba7-b592-8ccb77acf6a8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:14:59.473423 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7aae5c63-6153-40c8-b92f-cbc1624a349a req-2ecf6c03-e4d2-4ba7-b592-8ccb77acf6a8 service nova] Creating event network-vif-deleted:000821d1-4afa-4c85-8b22-1d3a08ad1232 for instance 6d0f7556-44fc-42f7-b175-877f9e1574a1 on nch2-master-1 Mar 26 21:14:59.479713 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7aae5c63-6153-40c8-b92f-cbc1624a349a req-2ecf6c03-e4d2-4ba7-b592-8ccb77acf6a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.528823 Mar 26 21:14:59.480368 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2510/5279] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:14:59.518451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:14:59.529254 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37911e6a-6e2a-4b4f-83b4-c26e0250858d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1245 microversion: 2.1 time: 0.262537 Mar 26 21:14:59.532096 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2770/5280] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:14:59 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1245 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:00.096554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:00.097327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] [instance: 6d0f7556-44fc-42f7-b175-877f9e1574a1] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:00.114569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:00.117243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:00.121228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:00.122050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:00.145794 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] HTTP exception thrown: Instance 6d0f7556-44fc-42f7-b175-877f9e1574a1 could not be found. Mar 26 21:15:00.146868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] Returning 404 to user: Instance 6d0f7556-44fc-42f7-b175-877f9e1574a1 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:00.148122 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1fdf91a3-1332-4f9d-a2c6-ae5430ad5e51 tempest-VolumesSnapshotTestJSON-1730121226 tempest-VolumesSnapshotTestJSON-1730121226-project] 10.222.0.16 "GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1" status: 404 len: 111 microversion: 2.1 time: 0.058710 Mar 26 21:15:00.149277 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2511/5281] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:00 2022] GET /compute/v2.1/servers/6d0f7556-44fc-42f7-b175-877f9e1574a1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:15:00.551329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:00.552074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:00.571344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:00.586482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:00.602058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:00.602998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:00.796211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:00.813394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3195313b-e08b-4a2d-8562-d10f254fbf19 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1299 microversion: 2.1 time: 0.267419 Mar 26 21:15:00.816268 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2771/5282] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:00 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:01.834796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:01.835574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:01.850629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:01.854839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:01.855844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:01.856438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:02.015435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:02.038419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6c9bc631-60ba-43b7-acd5-fdd2a28eb771 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1299 microversion: 2.1 time: 0.208482 Mar 26 21:15:02.039084 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2512/5283] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:01 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:03.055649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:03.056493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:03.075824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:03.077005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:03.077859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:03.078459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:03.648613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:03.679025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8294378d-a117-4487-816c-424def8df187 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.627492 Mar 26 21:15:03.686944 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2772/5284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:03 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:04.254702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66671778-c815-4db4-8977-9d2e221ac2f3", "tag": "b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:04.279342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:04.282387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:04.321887 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] Creating event network-changed:b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5 for instance 66671778-c815-4db4-8977-9d2e221ac2f3 on nch1-master-1 Mar 26 21:15:04.333768 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085070 Mar 26 21:15:04.334394 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2513/5285] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:04.700793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:04.701637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:04.712155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:04.714371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:04.715853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:04.719560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:04.997183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:05.006124 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4aa4f591-e62b-447d-9c09-76e42f8efdb4 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.309447 Mar 26 21:15:05.011808 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2773/5286] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:04 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:05.866884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:05.868931 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9a3a2e7c-0c32-4a73-9cfd-ab733489313b req-359c68b5-fcb6-49d3-987a-082c2e91ca06 service nova] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003089 Mar 26 21:15:05.869667 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2514/5287] 10.222.0.16 () {56 vars in 885 bytes} [Sat Mar 26 21:15:05 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 26 21:15:06.029293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:06.029918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:06.065221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:06.065996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:06.067116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:06.068859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:06.349579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:06.362880 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64c217ea-1407-46e0-bf1c-09b0c19409b5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.335803 Mar 26 21:15:06.363507 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2774/5288] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:06 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:07.381071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:07.381795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:07.406998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:07.407474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:07.408356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:07.411506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:07.930500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:07.946695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ade326d-3ca7-46ea-b18e-59b632f8fa17 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.570286 Mar 26 21:15:07.956981 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2515/5289] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:07 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:08.974242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:08.975745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:08.990233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:08.990781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:08.992066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:09.009921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:09.313926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:09.355671 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c513dc99-f8e6-490d-95eb-9ae42026e713 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.392611 Mar 26 21:15:09.360760 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2775/5290] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:08 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:09.465973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-850b1acb-5338-490c-827f-f9f6d9f85b95 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Action: 'create', calling method: .version_select at 0x7f6e5893d670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1049435", "metadata": {"Type": "work"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:09.468299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-850b1acb-5338-490c-827f-f9f6d9f85b95 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.469459 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-850b1acb-5338-490c-827f-f9f6d9f85b95 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.187136 Mar 26 21:15:09.474478 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2516/5291] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:15:09.480543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc04f464-54d6-4909-96ac-4210640ad93f tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Action: 'create', calling method: .version_select at 0x7f6e4be84ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1356491321", "metadata": {"Type": "work"}}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:09.482056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cc04f464-54d6-4909-96ac-4210640ad93f tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.482879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cc04f464-54d6-4909-96ac-4210640ad93f tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006361 Mar 26 21:15:09.483656 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2776/5292] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:15:09.493224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5536aa3-0a09-4475-b873-3d5da0c97a86 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Action: 'create', calling method: .version_select at 0x7f6e587d2700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1305134314", "metadata": {"Type": "work"}}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:09.495665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5536aa3-0a09-4475-b873-3d5da0c97a86 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.496732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5536aa3-0a09-4475-b873-3d5da0c97a86 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007384 Mar 26 21:15:09.497472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2517/5293] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:15:09.507073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48d16a74-b15f-48da-8353-82e08b2652e4 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Calling method '.version_select at 0x7f6e4bfb6af0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:09.547068 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-48d16a74-b15f-48da-8353-82e08b2652e4 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] HTTP exception thrown: Volume tempest-invalid-838749396 could not be found. Mar 26 21:15:09.547677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-48d16a74-b15f-48da-8353-82e08b2652e4 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 404 to user: Volume tempest-invalid-838749396 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.549933 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-48d16a74-b15f-48da-8353-82e08b2652e4 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-838749396" status: 404 len: 98 microversion: 2.1 time: 0.046879 Mar 26 21:15:09.551517 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2777/5294] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 21:15:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-838749396 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 26 21:15:09.559861 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-51a843ca-9568-4263-9886-2efca02c44ca tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003843 Mar 26 21:15:09.562473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2518/5295] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 21:15:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 26 21:15:09.570390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-000c4b3e-0088-4f13-881a-c9680c6b74f0 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005000 Mar 26 21:15:09.570931 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2778/5296] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:15:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 26 21:15:09.581021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ec9045c-a0d6-4f93-b5bc-becd5d0bc57d tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Calling method '.version_select at 0x7f6e5943ec10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:09.628573 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-2ec9045c-a0d6-4f93-b5bc-becd5d0bc57d tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] HTTP exception thrown: Volume 021d7172-02f6-4e76-9084-81561cda49bd could not be found. Mar 26 21:15:09.629335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ec9045c-a0d6-4f93-b5bc-becd5d0bc57d tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 404 to user: Volume 021d7172-02f6-4e76-9084-81561cda49bd could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.633677 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ec9045c-a0d6-4f93-b5bc-becd5d0bc57d tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/021d7172-02f6-4e76-9084-81561cda49bd" status: 404 len: 109 microversion: 2.1 time: 0.054737 Mar 26 21:15:09.637929 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2519/5297] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:15:09 2022] DELETE /compute/v2.1/os-volumes/021d7172-02f6-4e76-9084-81561cda49bd => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:15:09.647415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3955abe5-10a4-4673-a60a-f7b1d8b75807 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Calling method '.version_select at 0x7f6e4bfb6a60>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:09.709953 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3955abe5-10a4-4673-a60a-f7b1d8b75807 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] HTTP exception thrown: Volume ab451ec0-8bb7-41ff-b351-426d9d185234 could not be found. Mar 26 21:15:09.710833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3955abe5-10a4-4673-a60a-f7b1d8b75807 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] Returning 404 to user: Volume ab451ec0-8bb7-41ff-b351-426d9d185234 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:15:09.712865 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3955abe5-10a4-4673-a60a-f7b1d8b75807 tempest-VolumesNegativeTest-2122645982 tempest-VolumesNegativeTest-2122645982-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ab451ec0-8bb7-41ff-b351-426d9d185234" status: 404 len: 109 microversion: 2.1 time: 0.069814 Mar 26 21:15:09.714469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2779/5298] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:15:09 2022] GET /compute/v2.1/os-volumes/ab451ec0-8bb7-41ff-b351-426d9d185234 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:15:10.381593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:10.383695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:10.394861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:10.395678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:10.397050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:10.397790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:10.968943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:10.999142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ffd63cac-7dfa-4c59-aa87-12b4e6240061 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.623907 Mar 26 21:15:11.000647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2520/5299] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:10 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:12.021661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:12.023428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:12.099041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:12.099705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:12.100873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:12.101493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:12.967352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:12.986217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44504df5-b958-4007-bd41-30d7e54aef2c tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.973094 Mar 26 21:15:12.990180 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2780/5300] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:12 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:13.355492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bfa51ea4-3807-4fc1-bc76-1e1f3422bfbb req-705063f4-5c4c-4663-8a0b-2f31428853a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66671778-c815-4db4-8977-9d2e221ac2f3", "name": "network-vif-plugged", "status": "completed", "tag": "b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:13.364591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bfa51ea4-3807-4fc1-bc76-1e1f3422bfbb req-705063f4-5c4c-4663-8a0b-2f31428853a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:13.364970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bfa51ea4-3807-4fc1-bc76-1e1f3422bfbb req-705063f4-5c4c-4663-8a0b-2f31428853a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:13.385978 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bfa51ea4-3807-4fc1-bc76-1e1f3422bfbb req-705063f4-5c4c-4663-8a0b-2f31428853a1 service nova] Creating event network-vif-plugged:b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5 for instance 66671778-c815-4db4-8977-9d2e221ac2f3 on nch1-master-1 Mar 26 21:15:13.391520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bfa51ea4-3807-4fc1-bc76-1e1f3422bfbb req-705063f4-5c4c-4663-8a0b-2f31428853a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381953 Mar 26 21:15:13.392194 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2521/5301] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:14.008918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:14.009897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:14.037615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:14.040759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:14.043277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:14.047302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:14.411884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:14.425979 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d839bd8c-3864-4543-8ac2-b121921900b9 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.421924 Mar 26 21:15:14.438252 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2781/5302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:14 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:15.445221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:15.446776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:15.461595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:15.463596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:15.481107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:15.481652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:15.765299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:15.776482 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da9ea625-db5f-4db5-91ef-d9231574e46f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1366 microversion: 2.1 time: 0.335791 Mar 26 21:15:15.777198 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2522/5303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:15 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:16.793780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:16.794496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:16.807448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:16.808115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:16.810641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:16.813294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:17.266202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:17.288629 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8ae8f7d-93d4-4e56-b90b-36a174f62a1b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1555 microversion: 2.1 time: 0.498330 Mar 26 21:15:17.289940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2782/5304] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:16 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1555 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:17.310696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:17.311211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:17.322597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:17.323800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:17.325018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:17.327214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:17.591834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f29417f-1fd1-4314-8c49-efd61a420fb5 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283581 Mar 26 21:15:17.593016 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2523/5305] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:15:17 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:21.510659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4ec53eba-b868-4da2-858b-48a50b859615 req-af0810ff-f8e5-4973-af41-2bcee417e8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66671778-c815-4db4-8977-9d2e221ac2f3", "tag": "b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:21.528639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4ec53eba-b868-4da2-858b-48a50b859615 req-af0810ff-f8e5-4973-af41-2bcee417e8d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:21.529982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4ec53eba-b868-4da2-858b-48a50b859615 req-af0810ff-f8e5-4973-af41-2bcee417e8d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:21.571614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4ec53eba-b868-4da2-858b-48a50b859615 req-af0810ff-f8e5-4973-af41-2bcee417e8d2 service nova] Creating event network-changed:b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5 for instance 66671778-c815-4db4-8977-9d2e221ac2f3 on nch1-master-1 Mar 26 21:15:21.591167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4ec53eba-b868-4da2-858b-48a50b859615 req-af0810ff-f8e5-4973-af41-2bcee417e8d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440096 Mar 26 21:15:21.597819 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2783/5306] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:26.205028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Action: 'create', calling method: .version_select at 0x7f6e5ec9bca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-484755387"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:26.235252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:15:26.249576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for user 7ac02d48a08c4284ae0c82008c970e7f and project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:15:26.528047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:15:26.534828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for user 7ac02d48a08c4284ae0c82008c970e7f and project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:15:26.569897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8208d7cb-f062-49d7-bc00-fac2339d3ce9 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.876776 Mar 26 21:15:26.570880 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2524/5307] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:15:25 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:29.002318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-772497781", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-484755387", "security_groups": [{"name": "tempest-secgroup-smoke-2037389272"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e4836231-1512-4907-a9ce-7cfc0228ac84"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:29.179089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] validate_networks() for [('e4836231-1512-4907-a9ce-7cfc0228ac84', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:15:30.241947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for project 1a14cf15734c4aa881ff16a0bc734242. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:15:30.248247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for user 7ac02d48a08c4284ae0c82008c970e7f and project 1a14cf15734c4aa881ff16a0bc734242. Resources: dict_keys(['metadata_items']) {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:15:30.262402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:15:30.262833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:15:30.263311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:15:30.263727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:15:30.264176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:15:30.274256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:30.274725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:30.275563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:30.276007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:30.294071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:15:30.304109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Getting quotas for user 7ac02d48a08c4284ae0c82008c970e7f and project 1a14cf15734c4aa881ff16a0bc734242. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:15:30.318698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:15:30.321987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:15:30.377228 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-046f37b6-0a5f-4d07-ad27-079539fa55a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.382246 Mar 26 21:15:30.378021 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2784/5308] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:15:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:15:30.388445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1cc2c855-7977-4d6c-89bb-020af439725b tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:30.389075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1cc2c855-7977-4d6c-89bb-020af439725b tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:30.466856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1cc2c855-7977-4d6c-89bb-020af439725b tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:30.475411 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1cc2c855-7977-4d6c-89bb-020af439725b tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1301 microversion: 2.1 time: 0.091170 Mar 26 21:15:30.476586 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2525/5309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:30 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:31.493711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:31.497544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:31.518847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:31.521043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:31.522154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:31.522686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:31.660630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:31.672182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2c045dc9-f6a4-4ac0-9079-3bfccfaa5c76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1361 microversion: 2.1 time: 0.182498 Mar 26 21:15:31.675095 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2785/5310] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:31 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:32.690999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:32.693132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:32.702273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:32.703137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:32.705037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:32.705671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:32.879688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:32.888680 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af6c3fb8-8e51-4bd9-804a-fb181ffde1d5 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.202566 Mar 26 21:15:32.898609 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2526/5311] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:32 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:33.758369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e6c96a5c-9baa-48fc-a43e-c2c580b984dc req-25eb816b-1eba-494b-9767-b509aec98aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd236bf8-150d-4e59-9e5d-f8914bc74c8c", "tag": "d6e7ebff-b51e-441f-b6b1-b718e5c678cf"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:33.815697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e6c96a5c-9baa-48fc-a43e-c2c580b984dc req-25eb816b-1eba-494b-9767-b509aec98aac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:33.821129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e6c96a5c-9baa-48fc-a43e-c2c580b984dc req-25eb816b-1eba-494b-9767-b509aec98aac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:33.866230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e6c96a5c-9baa-48fc-a43e-c2c580b984dc req-25eb816b-1eba-494b-9767-b509aec98aac service nova] Creating event network-changed:d6e7ebff-b51e-441f-b6b1-b718e5c678cf for instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c on nch2-master-1 Mar 26 21:15:33.879363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e6c96a5c-9baa-48fc-a43e-c2c580b984dc req-25eb816b-1eba-494b-9767-b509aec98aac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124621 Mar 26 21:15:33.880954 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2786/5312] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:33.908021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:33.909278 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:33.927196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:33.927746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:33.928675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:33.930669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:34.455965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:34.463691 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eb7b37d8-8764-4bba-93eb-2e12f9b2c096 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.561507 Mar 26 21:15:34.466563 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2527/5313] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:33 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:35.486026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:35.486654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:35.498733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:35.500673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:35.500673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:35.501638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:35.802616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:35.814384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f208b864-a624-4f5f-a618-47db60e7f6a0 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.333587 Mar 26 21:15:35.825541 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2787/5314] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:35 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:36.833989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:36.834622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:36.845180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:36.846155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:36.847229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:36.847908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:37.069558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:37.080304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4018f8d-589f-4792-b87f-a09282e6620e tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.252287 Mar 26 21:15:37.082625 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2528/5315] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:36 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:38.101037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:38.102264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:38.111780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:38.112539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:38.113525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:38.114021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:38.364428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:38.376000 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2fb808cd-5fbc-40b4-b56c-ca3b6d304fa8 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.278414 Mar 26 21:15:38.376920 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2788/5316] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:38 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:39.397931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:39.399339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:39.409603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:39.410057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:39.411007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:39.411454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:39.580581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:39.591209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2764fcc6-90f6-463f-803e-d68171a0b632 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.202439 Mar 26 21:15:39.591990 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2529/5317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:39 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:40.596537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2ca5b1d7-ad6e-4667-898e-cb6f384100a5 req-2cf016bb-57cb-45fa-8854-acaab7c58550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd236bf8-150d-4e59-9e5d-f8914bc74c8c", "name": "network-vif-plugged", "status": "completed", "tag": "d6e7ebff-b51e-441f-b6b1-b718e5c678cf"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:40.608698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:40.609335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:40.615795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2ca5b1d7-ad6e-4667-898e-cb6f384100a5 req-2cf016bb-57cb-45fa-8854-acaab7c58550 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:40.617317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2ca5b1d7-ad6e-4667-898e-cb6f384100a5 req-2cf016bb-57cb-45fa-8854-acaab7c58550 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:40.619507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:40.620008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:40.623032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:40.623532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:40.640681 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2ca5b1d7-ad6e-4667-898e-cb6f384100a5 req-2cf016bb-57cb-45fa-8854-acaab7c58550 service nova] Creating event network-vif-plugged:d6e7ebff-b51e-441f-b6b1-b718e5c678cf for instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c on nch2-master-1 Mar 26 21:15:40.647685 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2ca5b1d7-ad6e-4667-898e-cb6f384100a5 req-2cf016bb-57cb-45fa-8854-acaab7c58550 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055674 Mar 26 21:15:40.648351 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2789/5318] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:15:40.920120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:40.930955 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-95229d84-acd0-421b-ad55-85eed578be76 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1427 microversion: 2.1 time: 0.325838 Mar 26 21:15:40.931810 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2530/5319] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:40 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1427 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:41.953186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:41.954846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:41.974317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:41.974981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:41.975885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:41.977363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:42.533980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:42.542082 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ade27dea-4cd9-4eb3-8403-1ab235e37176 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1606 microversion: 2.1 time: 0.596475 Mar 26 21:15:42.542997 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2790/5320] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:41 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1606 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:42.559156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:42.559868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:42.567545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:42.568037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:42.569209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:42.569900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:42.753265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:42.761464 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6873fc9f-5df3-4f0d-bb76-07af4931c31d tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1606 microversion: 2.1 time: 0.206492 Mar 26 21:15:42.762155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2531/5321] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:42 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1606 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:42.778923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:42.780041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:42.786526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:42.787209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:42.788302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:42.788668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:42.959015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:15:42.967771 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f60b9da3-cb56-4a2c-a5e7-5efcb5b4c720 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1606 microversion: 2.1 time: 0.192589 Mar 26 21:15:42.969039 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2791/5322] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:42 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1606 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:45.298442 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:15:45.298980 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:15:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:15:45.343456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-997d6065-9797-4769-ab70-26579420d88d req-cdc315ce-cf6f-448c-94de-7b202d5e4f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd236bf8-150d-4e59-9e5d-f8914bc74c8c", "tag": "d6e7ebff-b51e-441f-b6b1-b718e5c678cf"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:45.352996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-997d6065-9797-4769-ab70-26579420d88d req-cdc315ce-cf6f-448c-94de-7b202d5e4f29 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:45.353647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-997d6065-9797-4769-ab70-26579420d88d req-cdc315ce-cf6f-448c-94de-7b202d5e4f29 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:45.371099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-997d6065-9797-4769-ab70-26579420d88d req-cdc315ce-cf6f-448c-94de-7b202d5e4f29 service nova] Creating event network-changed:d6e7ebff-b51e-441f-b6b1-b718e5c678cf for instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c on nch2-master-1 Mar 26 21:15:45.377414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-997d6065-9797-4769-ab70-26579420d88d req-cdc315ce-cf6f-448c-94de-7b202d5e4f29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037876 Mar 26 21:15:45.378132 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2532/5323] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:54.300343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:54.300978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:54.308473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:54.309094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:54.310121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:54.310742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:54.337369 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6eaa697a-5208-4a50-a903-129d81f1924f tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/ips" status: 200 len: 148 microversion: 2.1 time: 0.041257 Mar 26 21:15:54.338142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2792/5324] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:15:54 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:55.690638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b07df397-0d4f-4fff-8cad-eb943ad38c9e"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:15:55.691232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:55.697418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:55.697883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:55.698676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:55.699119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:55.988138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4bf1a76-a536-488e-bb6a-8114e6ba89f3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "POST /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303350 Mar 26 21:15:55.988138 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2533/5325] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:15:55 2022] POST /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:15:59.403596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:59.404794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:59.412430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:59.413566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:59.415229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:59.416338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:59.503048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lazy-loading 'services' on Instance uuid 66671778-c815-4db4-8977-9d2e221ac2f3 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:15:59.582037 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-600fa764-9053-44bf-9b73-f91de2bfaa14 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments/b07df397-0d4f-4fff-8cad-eb943ad38c9e" status: 202 len: 0 microversion: 2.1 time: 0.182288 Mar 26 21:15:59.582631 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2793/5326] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:15:59 2022] DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments/b07df397-0d4f-4fff-8cad-eb943ad38c9e => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:15:59.592769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:15:59.594021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:15:59.601342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:59.602087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:59.603131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:15:59.603778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:15:59.641543 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46f59eb0-8967-4f55-809d-dd7949f7fbed tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054191 Mar 26 21:15:59.642964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2534/5327] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:15:59 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:16:00.654536 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:00.656128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:00.663265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.663700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:00.664544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.664990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:00.721720 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66ec8bf0-480c-4b6f-9d29-7222fc8b785b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071453 Mar 26 21:16:00.722767 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2794/5328] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:16:00 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:16:00.783154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:00.783696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:00.790504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.791217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:00.792219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.792848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:00.823537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:16:00.934833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9799123a-1a23-4839-a58f-a92d900524bd tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 204 len: 0 microversion: 2.1 time: 0.155144 Mar 26 21:16:00.936112 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2535/5329] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:16:00 2022] DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:16:00.946009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:00.946704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:00.953507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.954502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:00.955697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:00.956386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:01.110936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:01.119097 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6bf46f06-1876-4242-9de5-b2ed49cb4d7d tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1679 microversion: 2.1 time: 0.177965 Mar 26 21:16:01.119809 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2795/5330] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:00 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:02.140836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:02.142150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:02.149573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:02.150046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:02.150836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:02.151362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:02.347314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:02.355292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8693f2a5-6f1e-4f28-81b6-c3041d6d4c36 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1679 microversion: 2.1 time: 0.221493 Mar 26 21:16:02.355876 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2536/5331] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:02 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:03.373659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:03.375664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:03.396160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:03.396700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:03.400366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:03.400834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:03.619399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ad4fbc224446efaf5ad85c8c87eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e16658cc541b2976c9325d1558792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:03.635431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e854c6d3-8248-40b4-af44-8bdf091939cf tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 200 len: 1679 microversion: 2.1 time: 0.266223 Mar 26 21:16:03.636342 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2796/5332] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:03 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:03.906269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-95175202-70f5-4475-ae2a-3a359cbebb1f req-c59747f6-b17f-46fc-a9b7-5546709ba101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66671778-c815-4db4-8977-9d2e221ac2f3", "name": "network-vif-deleted", "tag": "b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:03.927117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-95175202-70f5-4475-ae2a-3a359cbebb1f req-c59747f6-b17f-46fc-a9b7-5546709ba101 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:03.927582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-95175202-70f5-4475-ae2a-3a359cbebb1f req-c59747f6-b17f-46fc-a9b7-5546709ba101 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:03.962592 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-95175202-70f5-4475-ae2a-3a359cbebb1f req-c59747f6-b17f-46fc-a9b7-5546709ba101 service nova] Creating event network-vif-deleted:b4fda00c-1c3b-476e-bd95-b9ee7a75a2c5 for instance 66671778-c815-4db4-8977-9d2e221ac2f3 on nch1-master-1 Mar 26 21:16:03.998499 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-95175202-70f5-4475-ae2a-3a359cbebb1f req-c59747f6-b17f-46fc-a9b7-5546709ba101 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095476 Mar 26 21:16:04.002726 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2537/5333] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:16:04.653732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:04.654350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:04.672593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:04.673081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:04.674120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:04.674737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:04.705771 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. Mar 26 21:16:04.706262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:04.707000 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0ff80ac7-96b1-43fd-bede-053cb9652f5a tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 404 len: 111 microversion: 2.1 time: 0.057269 Mar 26 21:16:04.707787 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2797/5334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:04 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:04.717983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b1c4c98-1fd0-4bcc-b151-ce009270a4d0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '.version_select at 0x7f6e5893d4c0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:04.749562 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b1c4c98-1fd0-4bcc-b151-ce009270a4d0 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465746663" status: 202 len: 0 microversion: 2.1 time: 0.036788 Mar 26 21:16:04.751426 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2538/5335] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465746663 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:16:06.927818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:06.928614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:06.935507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:06.935896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:06.936976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:06.937317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:06.952187 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. Mar 26 21:16:06.953379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:06.954231 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b375a72b-d268-4182-8634-5b07cb19185b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 404 len: 111 microversion: 2.1 time: 0.030569 Mar 26 21:16:06.954789 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2798/5336] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:16:06 2022] DELETE /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:06.962931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:06.963896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 66671778-c815-4db4-8977-9d2e221ac2f3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:06.976639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:06.977101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:06.978028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:06.978617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:06.992894 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. Mar 26 21:16:06.993719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 66671778-c815-4db4-8977-9d2e221ac2f3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:06.994758 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-47e67c3a-e920-49a3-882a-e66da31846cb tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3" status: 404 len: 111 microversion: 2.1 time: 0.035709 Mar 26 21:16:06.995325 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2539/5337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:06 2022] GET /compute/v2.1/servers/66671778-c815-4db4-8977-9d2e221ac2f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:08.136447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:08.137626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:08.143967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.144657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.145610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.146225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.163387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. Mar 26 21:16:08.164054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:08.164939 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3ce63403-4636-4429-a473-79ad1ba47ac3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 404 len: 111 microversion: 2.1 time: 0.032377 Mar 26 21:16:08.165506 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2799/5338] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:16:08 2022] DELETE /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:08.175467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:08.176148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: a385a731-a831-4390-a22f-d415b88ab971] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:08.183452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.184081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.184728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.185178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.200649 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. Mar 26 21:16:08.201263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance a385a731-a831-4390-a22f-d415b88ab971 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:08.202109 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eaa288bc-7398-4ded-bbf6-9852a216f88b tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971" status: 404 len: 111 microversion: 2.1 time: 0.032338 Mar 26 21:16:08.202719 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2540/5339] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:08 2022] GET /compute/v2.1/servers/a385a731-a831-4390-a22f-d415b88ab971 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:08.210866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:08.211490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:08.220152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.220948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.221739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.222175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.236738 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. Mar 26 21:16:08.237329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:08.238161 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e44f0653-2123-45ce-b312-464f69909791 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 404 len: 111 microversion: 2.1 time: 0.031262 Mar 26 21:16:08.238702 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2800/5340] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:16:08 2022] DELETE /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:08.246793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:08.247356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 5431bce9-4f3b-4361-89a6-9f16516aa8d4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:08.253413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.253873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.254698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:08.255147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:08.269190 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. Mar 26 21:16:08.269797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 5431bce9-4f3b-4361-89a6-9f16516aa8d4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:08.270636 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f7d2cbbe-50fc-4bf9-9748-c12145739d86 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4" status: 404 len: 111 microversion: 2.1 time: 0.027896 Mar 26 21:16:08.271178 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2541/5341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:08 2022] GET /compute/v2.1/servers/5431bce9-4f3b-4361-89a6-9f16516aa8d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:09.411632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:09.412289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:09.420206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:09.420717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:09.422253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:09.422762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:09.437596 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. Mar 26 21:16:09.438186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:09.439071 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e8ce9255-b211-4fe0-bd44-6890941d5b77 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 404 len: 111 microversion: 2.1 time: 0.032029 Mar 26 21:16:09.439672 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2801/5342] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:16:09 2022] DELETE /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:09.447675 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:09.448431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] [instance: 29bb3efc-fabf-4bd5-9adb-7f04b1995029] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:09.454986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:09.455448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:09.456257 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:09.456707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:09.471943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] HTTP exception thrown: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. Mar 26 21:16:09.472561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] Returning 404 to user: Instance 29bb3efc-fabf-4bd5-9adb-7f04b1995029 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:16:09.473396 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e45b797d-c0a3-4feb-8899-e6ad91dafbc3 tempest-AttachVolumeNegativeTest-571250188 tempest-AttachVolumeNegativeTest-571250188-project] 10.222.0.16 "GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029" status: 404 len: 111 microversion: 2.1 time: 0.029575 Mar 26 21:16:09.473986 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2542/5343] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:09 2022] GET /compute/v2.1/servers/29bb3efc-fabf-4bd5-9adb-7f04b1995029 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:16:21.585394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:21.585871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:21.593400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:21.593981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:21.594875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:21.595326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:21.622320 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52745fee-2142-46e4-9bcc-f1934557bea7 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.041493 Mar 26 21:16:21.623283 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2802/5344] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:21 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:16:30.413573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: .version_select at 0x7f6e588c0700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-224468789"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:30.429531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:16:30.436850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:16:30.738498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:16:30.745659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:16:30.775167 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9375fb1-e98b-467f-b9a6-4f0b28166dfb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.605667 Mar 26 21:16:30.776184 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2543/5345] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:16:30 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:32.223040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Calling method '.version_select at 0x7f6e4bfc11f0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:32.224203 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:32.224203 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:16:32.225582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:32.226538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:32.243606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:32.244362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:32.256620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:32.257378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:32.265455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-849cd946-58da-4360-876d-5d18e0192b05 tempest-PortsAdminExtendedAttrsTestJSON-1136025564 tempest-PortsAdminExtendedAttrsTestJSON-1136025564-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.223673 Mar 26 21:16:32.272401 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2803/5346] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:16:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:16:38.084878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-886266200", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "a8f01075-f81c-46e7-a1ef-dfce7baa881a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-224468789", "security_groups": [{"name": "tempest-secgroup-smoke-783393543"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:38.289903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] validate_networks() for [('a8f01075-f81c-46e7-a1ef-dfce7baa881a', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:16:39.227642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:16:39.229480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:16:39.229992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:16:39.230602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:16:39.231038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:16:39.246545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:39.247020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:39.248396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:39.248849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:39.273312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:16:39.280361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:16:39.301650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:16:39.304484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:16:39.421772 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ab447e5-1d42-499f-a269-6191d7585a49 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.343456 Mar 26 21:16:39.422455 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2544/5347] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:16:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:16:39.445779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7cac440c-3a3a-4fd5-b290-15814c899f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:39.446459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7cac440c-3a3a-4fd5-b290-15814c899f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:39.538602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7cac440c-3a3a-4fd5-b290-15814c899f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:39.564717 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7cac440c-3a3a-4fd5-b290-15814c899f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1265 microversion: 2.1 time: 0.131398 Mar 26 21:16:39.577415 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2804/5348] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:39 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:40.584855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:40.586148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:40.593310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:40.593768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:40.594727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:40.595544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:40.664400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:40.672876 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10c1b463-61f8-47e0-8c15-f1def85c5a81 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1317 microversion: 2.1 time: 0.093189 Mar 26 21:16:40.673604 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2545/5349] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:40 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:41.691400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:41.692085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:41.704780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:41.707694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:41.708623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:41.709198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:41.919416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:41.929540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b62ee16b-a914-4b94-a3d6-572547891ef4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.242326 Mar 26 21:16:41.940663 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2805/5350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:41 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:42.584214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-92c3c89d-d90b-41e3-897c-99b92bf7d95e req-6fd6881f-89da-4cda-9232-55eb17851d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:42.598642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-92c3c89d-d90b-41e3-897c-99b92bf7d95e req-6fd6881f-89da-4cda-9232-55eb17851d20 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:42.599405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-92c3c89d-d90b-41e3-897c-99b92bf7d95e req-6fd6881f-89da-4cda-9232-55eb17851d20 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:42.621463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-92c3c89d-d90b-41e3-897c-99b92bf7d95e req-6fd6881f-89da-4cda-9232-55eb17851d20 service nova] Creating event network-changed:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch1-master-1 Mar 26 21:16:42.630664 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-92c3c89d-d90b-41e3-897c-99b92bf7d95e req-6fd6881f-89da-4cda-9232-55eb17851d20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050902 Mar 26 21:16:42.631597 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2546/5351] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:16:42.950136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:42.951598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:42.959237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:42.959697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:42.960913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:42.961797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:43.230983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:43.263694 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3472eed4-b0c6-47b1-aaea-25fc7becdce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.318398 Mar 26 21:16:43.264919 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2806/5352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:42 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:44.284084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:44.284908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:44.292245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:44.292795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:44.293920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:44.294400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:44.575404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:44.583181 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7cce2419-3387-4e2c-8e29-04cada89b13b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.304983 Mar 26 21:16:44.583769 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2547/5353] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:44 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:16:45.599520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:45.600191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:45.611068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:45.611449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:45.612264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:45.612704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:45.773357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:45.783211 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d4f4e70-4c4a-4f49-bfaa-c0d5dccfa63c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.187457 Mar 26 21:16:45.783889 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2807/5354] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:45 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:46.800521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:46.801679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:46.822176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:46.822977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:46.824038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:46.826883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:47.038249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:47.046847 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-46d95c74-73ec-41b0-909d-8ebaa2c6247d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.250566 Mar 26 21:16:47.048042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2548/5355] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:46 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:48.067197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:48.067843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:48.078301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:48.078765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:48.079563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:48.080047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:48.230812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:48.238396 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f2a860bd-47fe-4741-a41b-db2fc3908c41 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.177943 Mar 26 21:16:48.238986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2808/5356] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:48 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:48.651525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-91229a22-7b77-4eb1-a04d-57d9989e7ff7 req-62617cf7-3cfb-4441-b46e-4689e23bbc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "name": "network-vif-plugged", "status": "completed", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:48.670159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-91229a22-7b77-4eb1-a04d-57d9989e7ff7 req-62617cf7-3cfb-4441-b46e-4689e23bbc43 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:48.670784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-91229a22-7b77-4eb1-a04d-57d9989e7ff7 req-62617cf7-3cfb-4441-b46e-4689e23bbc43 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:48.693612 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-91229a22-7b77-4eb1-a04d-57d9989e7ff7 req-62617cf7-3cfb-4441-b46e-4689e23bbc43 service nova] Creating event network-vif-plugged:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch1-master-1 Mar 26 21:16:48.709794 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-91229a22-7b77-4eb1-a04d-57d9989e7ff7 req-62617cf7-3cfb-4441-b46e-4689e23bbc43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065592 Mar 26 21:16:48.710895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2549/5357] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:16:49.257105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:49.258097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:49.265964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:49.266477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:49.267292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:49.268108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:49.436052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:49.443863 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9737fc3-6df3-400e-819d-a4ef3ef8042c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1390 microversion: 2.1 time: 0.190514 Mar 26 21:16:49.449235 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2809/5358] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:49 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:50.461946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:50.462893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:50.470577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:50.471045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:50.471838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:50.472316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:50.791517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:50.799735 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f29ae36-83ff-413e-aabf-2d19aef4c9e2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1563 microversion: 2.1 time: 0.342064 Mar 26 21:16:50.800342 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2550/5359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:50 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1563 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:50.818291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:50.819147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:50.826319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:50.826719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:50.827519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:50.827996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:50.998053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:51.006250 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e46d7106-3587-42ef-be37-13ab30721bce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1563 microversion: 2.1 time: 0.192545 Mar 26 21:16:51.007250 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2810/5360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:50 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:16:53.237898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:16:53.238520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:16:53.248906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:53.249373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:53.250165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:53.250608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:53.259061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7f851ecc-cf76-4b2f-88a5-089f80dadac7 req-56cc1ab5-9693-4a5d-a7e3-9947070f841e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:16:53.269180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7f851ecc-cf76-4b2f-88a5-089f80dadac7 req-56cc1ab5-9693-4a5d-a7e3-9947070f841e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:16:53.269633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7f851ecc-cf76-4b2f-88a5-089f80dadac7 req-56cc1ab5-9693-4a5d-a7e3-9947070f841e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:16:53.292174 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7f851ecc-cf76-4b2f-88a5-089f80dadac7 req-56cc1ab5-9693-4a5d-a7e3-9947070f841e service nova] Creating event network-changed:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch1-master-1 Mar 26 21:16:53.298209 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7f851ecc-cf76-4b2f-88a5-089f80dadac7 req-56cc1ab5-9693-4a5d-a7e3-9947070f841e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043471 Mar 26 21:16:53.299688 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2811/5361] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:16:53.744033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:16:53.752564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac5d0e22-cd4c-43f1-9632-9622eca13c2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1563 microversion: 2.1 time: 0.518835 Mar 26 21:16:53.753581 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2551/5362] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:16:53 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1563 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:17.093264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:17.094295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:17.101255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:17.101719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:17.102587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:17.103061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:17.163363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-49d216a3-8628-4a27-b651-4c4fa9fefebe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action" status: 200 len: 24569 microversion: 2.1 time: 0.075198 Mar 26 21:17:17.164048 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2812/5363] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:17:17 2022] POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 21:17:26.576409 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:17:26.577082 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:17:28.193138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:28.193818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:28.200088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.200554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.201349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.201795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.470832 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-be9c2c0c-3c0b-4614-bf11-eba255072f70 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1833 microversion: 2.1 time: 0.281657 Mar 26 21:17:28.471993 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2552/5364] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:28 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1833 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:28.493544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:28.494369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:28.506279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.506877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.507823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.508493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.763761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:28.771379 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a50bd43-0d3d-4d29-8597-4e5d8019b6f2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1682 microversion: 2.1 time: 0.282560 Mar 26 21:17:28.772151 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2813/5365] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:28 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:28.896507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:28.897605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:28.904794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.905772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.906740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:28.907336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:28.965223 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b7292d67-4be1-420e-963e-a0b00add513a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action" status: 200 len: 32637 microversion: 2.1 time: 0.074084 Mar 26 21:17:28.966232 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2553/5366] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:17:28 2022] POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action => generated 32637 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:17:29.128646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:29.129430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:29.135805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:29.136300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:29.137839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:29.138413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:29.183155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7ee61895e452426fa20d33778753d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b6f802f2f946e9b7b7f069ab789e09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:29.184558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] flavor_id is None. Assuming migration. {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 26 21:17:29.185016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:17:29.451728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ce2567be-d522-45aa-aa59-cd5e3510875f tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action" status: 202 len: 0 microversion: 2.1 time: 0.327721 Mar 26 21:17:29.452400 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2814/5367] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:17:29 2022] POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:17:29.461230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:29.462487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:29.473009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:29.473914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:29.475571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:29.476376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:29.698337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:29.706590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-28981b75-b695-4cc3-b06b-4035c0567500 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1691 microversion: 2.1 time: 0.249407 Mar 26 21:17:29.707886 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2554/5368] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:29 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:30.727446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:30.728943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:30.735488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:30.736357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:30.737403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:30.738122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:30.895881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:30.903456 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c89c2f53-dfe4-457b-9113-67da33538737 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1691 microversion: 2.1 time: 0.181233 Mar 26 21:17:30.904061 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2815/5369] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:30 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:31.920295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:31.921557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:31.929031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:31.929839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:31.930857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:31.931683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:32.198005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:32.207100 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca3d2948-6f40-4ce1-bb23-cfda526ae02a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1691 microversion: 2.1 time: 0.290755 Mar 26 21:17:32.207877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2555/5370] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:31 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1691 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:17:33.228866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:33.229485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:33.242178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:33.242867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:33.243820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:33.244982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:33.423192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:33.433644 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27b94a16-5878-4b84-931a-a7d9b79c08ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.208964 Mar 26 21:17:33.434776 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2816/5371] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:33 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:34.450888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:34.452620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:34.460081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:34.460681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:34.461803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:34.462383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:34.742996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:34.756943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f15631ed-ed77-402b-b205-d53d152e2748 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.309930 Mar 26 21:17:34.757727 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2556/5372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:34 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:35.774511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:35.775816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:35.782851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:35.783307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:35.784116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:35.784617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:36.053341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:36.066477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d5465dc3-6f6e-4156-89f2-793776453a0d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.296024 Mar 26 21:17:36.067428 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2817/5373] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:35 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:37.084220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:37.085097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:37.094732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:37.095234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:37.096087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:37.096535 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:37.244259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:37.254204 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7cf2ac2d-6e4f-4e88-aa54-a7fe45630af6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.174409 Mar 26 21:17:37.255537 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2557/5374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:37 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:38.273019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:38.273748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:38.281297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:38.281851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:38.282688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:38.283207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:38.429710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:38.438099 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3268039-3d0e-4e2a-9586-479e624965c1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.169070 Mar 26 21:17:38.438683 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2818/5375] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:38 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:17:39.455264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:39.455889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:39.463025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:39.463485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:39.464850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:39.465294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:39.636252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:39.644566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-90751b6f-195b-4a60-81c9-95651307f137 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.193201 Mar 26 21:17:39.645336 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2558/5376] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:39 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:40.662347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:40.662975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:40.671090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:40.671603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:40.672624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:40.673173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:40.892636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:40.901165 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82dec40d-b926-4e37-9670-c86cd815fd34 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.242633 Mar 26 21:17:40.902007 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2819/5377] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:40 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:41.918321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:41.919494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:41.926901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:41.927496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:41.928446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:41.928901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:42.121204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:42.128629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-04a0ef29-0d8d-49ae-acf7-e38ce79dd3e4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.214939 Mar 26 21:17:42.129222 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2559/5378] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:41 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:43.147200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:43.147825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:43.162274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:43.162742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:43.163805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:43.165863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:43.365348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:43.374166 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-73d59b87-5a0f-4c95-81f4-3379b326ff7b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.232269 Mar 26 21:17:43.374769 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2820/5379] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:43 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:44.391760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:44.394140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:44.405205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:44.411400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:44.412505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:44.413068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:44.580477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:44.590231 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6cda20c-3a58-4310-a434-bb25c903713d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.201410 Mar 26 21:17:44.591319 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2560/5380] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:44 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:45.611196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:45.611822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:45.618606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:45.619073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:45.619856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:45.620925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:45.806889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:45.815631 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e2a798d-b869-471b-b685-a2f8f4d8e3de tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.208237 Mar 26 21:17:45.816259 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2821/5381] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:45 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:46.833565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:46.834295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:46.840987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:46.841451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:46.842229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:46.842674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:46.984794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:46.995089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-382451a8-5c19-4172-a24f-5df6c7c39535 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.165396 Mar 26 21:17:46.995935 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2561/5382] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:46 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:48.011609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:48.012303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:48.019113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:48.019573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:48.020383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:48.020830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:48.162079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:48.170121 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e7487f5-5ff3-4896-873b-1db78a30e07d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.162487 Mar 26 21:17:48.170696 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2822/5383] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:48 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:17:49.187089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:49.187745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:49.194646 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:49.195296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:49.196298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:49.196747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:49.389586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:49.411214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26167bde-b920-4680-80cf-c6adaa7bc389 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1696 microversion: 2.1 time: 0.222713 Mar 26 21:17:49.414531 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2562/5384] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:49 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1696 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:17:50.031383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "name": "network-vif-unplugged", "status": "completed", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:50.040453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:50.041038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:50.053874 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] Creating event network-vif-unplugged:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch2-master-1 Mar 26 21:17:50.059838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] Instance 98b160ee-7b73-4371-ae75-9908f082afaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:17:50.095295 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1c6ed270-737d-4663-a7a9-c867fad0bc90 req-6b8ddf0b-b50b-4cf5-ba47-7ae7a79dcfa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068517 Mar 26 21:17:50.096740 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2823/5385] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:17:50.432529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:50.434102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:50.441647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:50.442291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:50.443084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:50.443528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:50.754057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:50.763748 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d5d1664f-26dc-4ca1-afd7-8852ce9e4a26 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1695 microversion: 2.1 time: 0.335241 Mar 26 21:17:50.764911 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2563/5386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:50 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1695 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:51.785163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:51.786993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:51.793766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:51.794227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:51.795015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:51.795493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:51.939492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:51.947101 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-223e0dbb-8d81-4f7a-8354-ded4bfb50524 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1693 microversion: 2.1 time: 0.168044 Mar 26 21:17:51.947678 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2824/5387] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:51 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:52.125474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:52.134236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:52.134702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:52.146240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] Creating event network-changed:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch2-master-1 Mar 26 21:17:52.151713 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] Instance 98b160ee-7b73-4371-ae75-9908f082afaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:17:52.163806 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a7819694-6beb-4cc4-8e43-1d4d469a6b2c req-d8b9e503-7aab-40ad-bc02-3b0e6d93a840 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042393 Mar 26 21:17:52.164446 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2564/5388] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:17:52.967675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:52.968407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:52.978691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:52.981352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:52.984316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:52.985698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:53.171157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:53.180258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c26c41c2-3c9f-4840-b92c-b3885be817e7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1690 microversion: 2.1 time: 0.218850 Mar 26 21:17:53.181089 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2825/5389] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:52 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:53.199722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:53.201428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:53.211370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:53.212008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:53.213770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:53.215056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:53.286356 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f721dca4-5c8a-47f8-8f8d-5dcc7a002be4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action" status: 204 len: 0 microversion: 2.1 time: 0.092228 Mar 26 21:17:53.291103 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2565/5390] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:17:53 2022] POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:17:53.297048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:53.297923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:53.305462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:53.306461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:53.307847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:53.309202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:53.611743 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:53.619216 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a84b6a1-e20c-4118-82d0-41bb59ea5549 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1690 microversion: 2.1 time: 0.327075 Mar 26 21:17:53.619956 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2826/5391] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:53 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1690 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:54.638396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:54.639126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:54.645844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:54.646300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:54.647079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:54.650117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:54.788244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:54.796953 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4645e81-a293-4bb2-9738-ac1231a43b0c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1690 microversion: 2.1 time: 0.163910 Mar 26 21:17:54.807576 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2566/5392] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:54 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:55.815099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:17:55.815724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:17:55.822526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:55.822992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:55.824297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:55.824751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:55.964817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:17:55.972344 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-16ba0a3a-3b87-4f6f-8c05-a73c842ae56c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1682 microversion: 2.1 time: 0.161130 Mar 26 21:17:55.972911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2827/5393] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:17:55 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:17:57.201038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-63e7a521-df37-4963-96f0-215fe7b591e4 req-9479a0c9-1a53-480b-9286-453f850bb5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "name": "network-vif-plugged", "status": "completed", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:17:57.210744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-63e7a521-df37-4963-96f0-215fe7b591e4 req-9479a0c9-1a53-480b-9286-453f850bb5b1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:17:57.212470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-63e7a521-df37-4963-96f0-215fe7b591e4 req-9479a0c9-1a53-480b-9286-453f850bb5b1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:17:57.225016 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-63e7a521-df37-4963-96f0-215fe7b591e4 req-9479a0c9-1a53-480b-9286-453f850bb5b1 service nova] Creating event network-vif-plugged:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch2-master-1 Mar 26 21:17:57.230055 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-63e7a521-df37-4963-96f0-215fe7b591e4 req-9479a0c9-1a53-480b-9286-453f850bb5b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Mar 26 21:17:57.230895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2567/5394] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:07.898462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1313188939", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "c560919d-0fd7-44f8-b32c-c401178e0da8"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:07.949297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] validate_networks() for [('c560919d-0fd7-44f8-b32c-c401178e0da8', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:18:08.681494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:18:08.681933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:18:08.682413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:18:08.683708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:18:08.684167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:18:08.693000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:08.693453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:08.694257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:08.694701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:08.712034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Getting quotas for project dd3ee9d1e7b94fc4a74f972e70c05257. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:18:08.717363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Getting quotas for user 92be875a64494d6dae76ee0c088c84c0 and project dd3ee9d1e7b94fc4a74f972e70c05257. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:18:08.729509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:18:08.731780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:18:08.775659 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72d0b43b-97eb-47d3-838b-e3c95e6a89b1 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989724 Mar 26 21:18:08.776383 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2828/5395] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:18:08.786736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-49afe44f-fd03-46f8-996f-0d397f1747a9 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:08.787456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-49afe44f-fd03-46f8-996f-0d397f1747a9 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:08.845878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-49afe44f-fd03-46f8-996f-0d397f1747a9 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:08.852618 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-49afe44f-fd03-46f8-996f-0d397f1747a9 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1214 microversion: 2.1 time: 0.070025 Mar 26 21:18:08.853106 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2568/5396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:08 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:09.870550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:09.871316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:09.877981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:09.878438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:09.879226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:09.879676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:09.960768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:09.968651 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-652ba210-09db-47fd-b6e2-537ce2c65425 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1272 microversion: 2.1 time: 0.102877 Mar 26 21:18:09.969230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2829/5397] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:09 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:10.986894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:10.987629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:10.996161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:10.996624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:10.997407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:10.997856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:11.128365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-56448d10-b735-4294-b015-2d97780256ce req-7dcaa15d-4931-476b-9fb0-af4a9bd6746b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f2b437-3aff-46f0-9885-e250bdc7aaef", "tag": "a7ae3418-54a5-444d-bd30-31c3a2f2e5eb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:11.140124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56448d10-b735-4294-b015-2d97780256ce req-7dcaa15d-4931-476b-9fb0-af4a9bd6746b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:11.141067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56448d10-b735-4294-b015-2d97780256ce req-7dcaa15d-4931-476b-9fb0-af4a9bd6746b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:11.146108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:11.163552 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b06d3959-5f49-410e-8904-d25287dedb4a tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.181004 Mar 26 21:18:11.164178 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2569/5398] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:10 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:11.171539 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-56448d10-b735-4294-b015-2d97780256ce req-7dcaa15d-4931-476b-9fb0-af4a9bd6746b service nova] Creating event network-changed:a7ae3418-54a5-444d-bd30-31c3a2f2e5eb for instance 46f2b437-3aff-46f0-9885-e250bdc7aaef on nch1-master-1 Mar 26 21:18:11.176938 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-56448d10-b735-4294-b015-2d97780256ce req-7dcaa15d-4931-476b-9fb0-af4a9bd6746b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052898 Mar 26 21:18:11.177553 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2830/5399] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:18:12.181206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:12.181819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:12.189254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:12.189707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:12.190483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:12.190928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:12.394583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:12.402503 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3357cfdc-f9fe-4d26-a03f-5dd802a9c5f4 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.225213 Mar 26 21:18:12.403209 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2570/5400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:12 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:13.420752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:13.421456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:13.427886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:13.428366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:13.429123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:13.429563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:13.561599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:13.568830 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0ee4923a-3a47-4096-ac91-8d244394747d tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.153232 Mar 26 21:18:13.569404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2831/5401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:13 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:14.585340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:14.585965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:14.592904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:14.593428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:14.594210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:14.594662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:14.727507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:14.735502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eaf435a5-96f9-499a-a663-dff064fd1fa0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.154101 Mar 26 21:18:14.736111 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2571/5402] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:14 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:15.752142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:15.752752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:15.759455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:15.759907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:15.760715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:15.761155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:15.897836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:15.905182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f9a1e65-c35d-46ba-a73d-1de3d8300236 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.156951 Mar 26 21:18:15.905759 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2832/5403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:15 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:16.839832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-73072076-57e6-478b-9670-645c3e00f8e3 req-b435d9f3-49b5-4f46-9944-3291d2a6d8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f2b437-3aff-46f0-9885-e250bdc7aaef", "name": "network-vif-plugged", "status": "completed", "tag": "a7ae3418-54a5-444d-bd30-31c3a2f2e5eb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:16.851825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-73072076-57e6-478b-9670-645c3e00f8e3 req-b435d9f3-49b5-4f46-9944-3291d2a6d8ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:16.852446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-73072076-57e6-478b-9670-645c3e00f8e3 req-b435d9f3-49b5-4f46-9944-3291d2a6d8ed service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:16.863380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-73072076-57e6-478b-9670-645c3e00f8e3 req-b435d9f3-49b5-4f46-9944-3291d2a6d8ed service nova] Creating event network-vif-plugged:a7ae3418-54a5-444d-bd30-31c3a2f2e5eb for instance 46f2b437-3aff-46f0-9885-e250bdc7aaef on nch1-master-1 Mar 26 21:18:16.868260 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-73072076-57e6-478b-9670-645c3e00f8e3 req-b435d9f3-49b5-4f46-9944-3291d2a6d8ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Mar 26 21:18:16.868854 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2572/5404] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:16.922819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:16.923430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:16.930519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:16.930903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:16.931698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:16.932652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:17.132466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:17.139974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-277fdd87-6b1c-42de-8203-c0686c6a61f2 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.221220 Mar 26 21:18:17.140570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2833/5405] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:16 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:18.161448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:18.162140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:18.162498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:18.163442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:18.170126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:18.170829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:18.171371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:18.171807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:18.171955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:18.172288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:18.172707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:18.173119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:18.230266 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2cf39971-5618-444f-a5cd-c0241c80c4ae tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action" status: 200 len: 24559 microversion: 2.1 time: 0.075935 Mar 26 21:18:18.231180 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2834/5406] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:18:18 2022] POST /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa/action => generated 24559 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:18:18.313493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:18.320914 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4f6f9bc9-0362-4959-909b-ab4756617f38 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1314 microversion: 2.1 time: 0.167902 Mar 26 21:18:18.321519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2573/5407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:18 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:19.338695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:19.339300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:19.346720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:19.347176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:19.347964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:19.348421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:19.478146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:19.486527 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93436f09-2c4d-4331-be05-ebf63d2e8028 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1498 microversion: 2.1 time: 0.152330 Mar 26 21:18:19.487097 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2835/5408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:19 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:21.603388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:21.604059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:21.610411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:21.610877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:21.611660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:21.612151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:21.637178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:18:21.708789 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe884d91-0cb7-47b1-84c4-baf712c6d0bd tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 204 len: 0 microversion: 2.1 time: 0.109091 Mar 26 21:18:21.709482 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2574/5409] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:18:21 2022] DELETE /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:18:21.717753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:21.718366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:21.725389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:21.725845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:21.726619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:21.727062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:21.862086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:21.870053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1fbc2923-aa50-4572-8355-b3dbc9b38ce0 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1504 microversion: 2.1 time: 0.155515 Mar 26 21:18:21.870654 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2836/5410] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:21 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:22.887256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:22.887985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:22.894682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:22.895137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:22.895903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:22.896376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:23.038195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:23.046161 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e479b69a-783e-4d62-aead-075ff4a9bf5e tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1504 microversion: 2.1 time: 0.163285 Mar 26 21:18:23.046879 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2575/5411] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:22 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:23.632176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d081c863-99e2-461d-9de9-af52919627a2 req-d2829d8f-fdd8-4857-9d81-f089d4d54580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f2b437-3aff-46f0-9885-e250bdc7aaef", "name": "network-vif-deleted", "tag": "a7ae3418-54a5-444d-bd30-31c3a2f2e5eb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:23.642296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d081c863-99e2-461d-9de9-af52919627a2 req-d2829d8f-fdd8-4857-9d81-f089d4d54580 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:23.642753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d081c863-99e2-461d-9de9-af52919627a2 req-d2829d8f-fdd8-4857-9d81-f089d4d54580 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:23.653664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d081c863-99e2-461d-9de9-af52919627a2 req-d2829d8f-fdd8-4857-9d81-f089d4d54580 service nova] Creating event network-vif-deleted:a7ae3418-54a5-444d-bd30-31c3a2f2e5eb for instance 46f2b437-3aff-46f0-9885-e250bdc7aaef on nch1-master-1 Mar 26 21:18:23.658511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d081c863-99e2-461d-9de9-af52919627a2 req-d2829d8f-fdd8-4857-9d81-f089d4d54580 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030149 Mar 26 21:18:23.659107 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2837/5412] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:18:24.064672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:24.065311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:24.072180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:24.072676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:24.073453 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:24.073891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:24.106010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:24.106462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:24.106951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lazy-loading 'fault' on Instance uuid 46f2b437-3aff-46f0-9885-e250bdc7aaef {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:18:24.147721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be875a64494d6dae76ee0c088c84c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:24.154738 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66cfd7b9-3c0e-4811-82b8-86b964b12a87 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 200 len: 1304 microversion: 2.1 time: 0.094698 Mar 26 21:18:24.155341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2576/5413] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:24 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:24.495660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:24.496390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:24.502588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:24.503040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:24.503804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:24.504276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:24.633624 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfb49d85-4089-41c6-b8f1-b2c85c3438a7 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1833 microversion: 2.1 time: 0.142423 Mar 26 21:18:24.634199 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2838/5414] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:24 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1833 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:25.172069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:25.172701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] [instance: 46f2b437-3aff-46f0-9885-e250bdc7aaef] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:25.179881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.180370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.181153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.181593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.196073 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] HTTP exception thrown: Instance 46f2b437-3aff-46f0-9885-e250bdc7aaef could not be found. Mar 26 21:18:25.196682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] Returning 404 to user: Instance 46f2b437-3aff-46f0-9885-e250bdc7aaef could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:18:25.197559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d81b98d3-c17c-4060-ab82-1e91d5a26fc6 tempest-VolumesActionsTest-1501534813 tempest-VolumesActionsTest-1501534813-project] 10.222.0.16 "GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef" status: 404 len: 111 microversion: 2.1 time: 0.029490 Mar 26 21:18:25.198629 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2577/5415] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:25 2022] GET /compute/v2.1/servers/46f2b437-3aff-46f0-9885-e250bdc7aaef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:18:25.811007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:25.811527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:25.812814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0ea32461-c071-41c4-9ebb-00b29a7fa8cb req-cbdc0d2c-8146-4783-a910-b0c7249f8c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:25.818822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.819560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.820381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.820832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.821149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0ea32461-c071-41c4-9ebb-00b29a7fa8cb req-cbdc0d2c-8146-4783-a910-b0c7249f8c5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.821770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0ea32461-c071-41c4-9ebb-00b29a7fa8cb req-cbdc0d2c-8146-4783-a910-b0c7249f8c5d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.833810 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0ea32461-c071-41c4-9ebb-00b29a7fa8cb req-cbdc0d2c-8146-4783-a910-b0c7249f8c5d service nova] Creating event network-changed:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch2-master-1 Mar 26 21:18:25.839580 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0ea32461-c071-41c4-9ebb-00b29a7fa8cb req-cbdc0d2c-8146-4783-a910-b0c7249f8c5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030267 Mar 26 21:18:25.840650 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2578/5416] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:18:25.847676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:18:25.933672 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1af8bd07-fe4a-421e-bcb1-7a55392be4e3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 204 len: 0 microversion: 2.1 time: 0.125827 Mar 26 21:18:25.935371 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2839/5417] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:18:25 2022] DELETE /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:18:25.943884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:25.944722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:25.951621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.952221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:25.953074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:25.953589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:26.185291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:26.193385 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0219eb65-5be3-463d-96da-cf5b4ca81651 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1688 microversion: 2.1 time: 0.253690 Mar 26 21:18:26.193984 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2579/5418] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:25 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:18:27.211151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:27.211886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:27.219398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:27.219860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:27.220663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:27.221139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:27.359889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:27.367535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e066786a-3e2b-4387-900a-6f8d63486565 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 200 len: 1569 microversion: 2.1 time: 0.160640 Mar 26 21:18:27.368153 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2840/5419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:27 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:27.762813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3d870db1-fbfc-48c7-b139-ff8d32846fe4 req-6a6c0e96-eee9-4025-8393-90188d3bbd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b160ee-7b73-4371-ae75-9908f082afaa", "name": "network-vif-deleted", "tag": "a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:27.773670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d870db1-fbfc-48c7-b139-ff8d32846fe4 req-6a6c0e96-eee9-4025-8393-90188d3bbd45 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:27.774339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d870db1-fbfc-48c7-b139-ff8d32846fe4 req-6a6c0e96-eee9-4025-8393-90188d3bbd45 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:27.786999 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3d870db1-fbfc-48c7-b139-ff8d32846fe4 req-6a6c0e96-eee9-4025-8393-90188d3bbd45 service nova] Creating event network-vif-deleted:a7e06ef4-c425-4c68-8a0b-c5933e1ba5fd for instance 98b160ee-7b73-4371-ae75-9908f082afaa on nch2-master-1 Mar 26 21:18:27.793125 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3d870db1-fbfc-48c7-b139-ff8d32846fe4 req-6a6c0e96-eee9-4025-8393-90188d3bbd45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Mar 26 21:18:27.793721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2580/5420] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:28.385364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:28.385905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 98b160ee-7b73-4371-ae75-9908f082afaa] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:28.392710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:28.393174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:28.393982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:28.394436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:28.408144 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] HTTP exception thrown: Instance 98b160ee-7b73-4371-ae75-9908f082afaa could not be found. Mar 26 21:18:28.408772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Returning 404 to user: Instance 98b160ee-7b73-4371-ae75-9908f082afaa could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:18:28.409599 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e7835f0-ceb0-4b94-a084-6cbc3159782b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa" status: 404 len: 111 microversion: 2.1 time: 0.028387 Mar 26 21:18:28.410131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2841/5421] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:28 2022] GET /compute/v2.1/servers/98b160ee-7b73-4371-ae75-9908f082afaa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:18:32.052208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-371ae88c-a7fc-488a-bf3b-ca243816bd85 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '.version_select at 0x7f6e59658ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:32.089491 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-371ae88c-a7fc-488a-bf3b-ca243816bd85 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-224468789" status: 202 len: 0 microversion: 2.1 time: 0.042259 Mar 26 21:18:32.090172 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2581/5422] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 21:18:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-224468789 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:18:32.120498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: .version_select at 0x7f6e4bfc1310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-113274435"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:32.135866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:18:32.142714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:18:32.311728 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:18:32.316794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:18:32.331609 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea4e3c58-973f-4dbd-add6-1684e55ac24b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.215746 Mar 26 21:18:32.332257 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2842/5423] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:18:32 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:38.244644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1420840271", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "56d3ec5c-4f1b-47f4-8286-06a2652bf724"}], "key_name": "tempest-TestNetworkAdvancedServerOps-113274435", "security_groups": [{"name": "tempest-secgroup-smoke-519965976"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:38.352504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] validate_networks() for [('56d3ec5c-4f1b-47f4-8286-06a2652bf724', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:18:38.858680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:18:38.859554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:18:38.860215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:18:38.860797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:18:38.861373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:18:38.876593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:38.877317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:38.878355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:38.878985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:38.908553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:18:38.915001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:18:38.933474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:18:38.936277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:18:39.000155 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a8526df8-c665-4a24-bfac-04c0462109f7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760387 Mar 26 21:18:39.002018 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2582/5424] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:18:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:18:39.015646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8b3df61-4d4d-42ac-bf52-6245e410efbe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:39.017016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e8b3df61-4d4d-42ac-bf52-6245e410efbe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:39.140298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8b3df61-4d4d-42ac-bf52-6245e410efbe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:39.151055 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e8b3df61-4d4d-42ac-bf52-6245e410efbe tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1266 microversion: 2.1 time: 0.142502 Mar 26 21:18:39.166751 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2843/5425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:39 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:40.173992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:40.174882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:40.183709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:40.184269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:40.185073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:40.185523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:40.266950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:40.278139 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f5ecea91-3adb-4626-9aea-5f0fc910da9f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1318 microversion: 2.1 time: 0.108608 Mar 26 21:18:40.280170 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2583/5426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:40 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:41.297472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:41.298689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:41.312865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:41.313973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:41.314976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:41.315689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:41.395525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:41.409986 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e64b9115-3303-4d14-8c88-9ad82d9ec6b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1324 microversion: 2.1 time: 0.114355 Mar 26 21:18:41.410626 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2844/5427] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:41 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1324 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:42.429880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:42.431680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:42.439817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:42.445045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:42.446218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:42.447772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:42.571607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8294e18d-4fd0-472a-952d-fab634ad8c1c req-e4847782-065f-4216-84cf-c04f89a70f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:42.587029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8294e18d-4fd0-472a-952d-fab634ad8c1c req-e4847782-065f-4216-84cf-c04f89a70f5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:42.588538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8294e18d-4fd0-472a-952d-fab634ad8c1c req-e4847782-065f-4216-84cf-c04f89a70f5f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:42.604268 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8294e18d-4fd0-472a-952d-fab634ad8c1c req-e4847782-065f-4216-84cf-c04f89a70f5f service nova] Creating event network-changed:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:18:42.614227 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8294e18d-4fd0-472a-952d-fab634ad8c1c req-e4847782-065f-4216-84cf-c04f89a70f5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046722 Mar 26 21:18:42.615400 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2845/5428] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:42.707980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:42.719002 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81e59614-77ba-40f9-92ee-e1219a7ca4c2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.293475 Mar 26 21:18:42.719948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2584/5429] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:42 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:43.738071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:43.738696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:43.744938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:43.745396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:43.746169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:43.746613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:43.886109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:43.893371 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-550f5b7d-5ed8-4581-8d13-51e231cfe5f3 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.160490 Mar 26 21:18:43.893953 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2846/5430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:43 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:44.909566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:44.910179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:44.916898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:44.917353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:44.918146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:44.918591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:45.063473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:45.070879 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9efea6e8-95a7-4e87-bc78-e0bdc732085f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.165229 Mar 26 21:18:45.071467 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2585/5431] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:44 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:46.088076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:46.088646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:46.096047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:46.096500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:46.097275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:46.097724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:46.231613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:46.238909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c5a11682-8578-495a-8ea1-3acf6ccd520f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.154939 Mar 26 21:18:46.239463 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2847/5432] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:46 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:18:47.256091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:47.256704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:47.264265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:47.264718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:47.265546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:47.265990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:47.398723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:47.407296 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8601259d-8d75-448e-9d84-a0cc142f9e97 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.155133 Mar 26 21:18:47.407884 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2586/5433] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:47 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:48.424592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:48.425205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:48.432035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:48.432491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:48.433259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:48.433697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:48.568676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:48.576425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-173377d0-cba4-4226-ae04-06a1353607b0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.156214 Mar 26 21:18:48.577018 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2848/5434] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:48 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:48.982413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-96533cb7-c9a7-4a1a-b2b6-791ab716d2e1 req-d3920159-85af-44be-9573-469a38231026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "name": "network-vif-plugged", "status": "completed", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:48.991875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-96533cb7-c9a7-4a1a-b2b6-791ab716d2e1 req-d3920159-85af-44be-9573-469a38231026 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:48.992509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-96533cb7-c9a7-4a1a-b2b6-791ab716d2e1 req-d3920159-85af-44be-9573-469a38231026 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:49.003814 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-96533cb7-c9a7-4a1a-b2b6-791ab716d2e1 req-d3920159-85af-44be-9573-469a38231026 service nova] Creating event network-vif-plugged:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:18:49.014105 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-96533cb7-c9a7-4a1a-b2b6-791ab716d2e1 req-d3920159-85af-44be-9573-469a38231026 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Mar 26 21:18:49.014718 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2587/5435] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:49.592468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:49.593086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:49.599811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:49.600305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:49.601078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:49.601528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:50.009214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:50.016586 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a101da7e-8709-427a-884f-693a17ed5fe6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1391 microversion: 2.1 time: 0.428015 Mar 26 21:18:50.017164 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2849/5436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:49 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1391 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:51.035290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:51.036112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:51.042901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:51.043364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:51.044174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:51.044627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:51.186861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:51.194375 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10db1ced-7b84-4015-be5d-fb9222c76a07 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1562 microversion: 2.1 time: 0.164270 Mar 26 21:18:51.194963 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2588/5437] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:51 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:51.210184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:51.210794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:51.217467 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:51.217919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:51.218680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:51.219115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:51.362156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:51.370105 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-95880c73-12a2-4064-878a-59a84fee1e8f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1562 microversion: 2.1 time: 0.163710 Mar 26 21:18:51.370673 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2850/5438] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:51 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:18:52.983117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:18:52.983777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:18:52.989193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cde80ba7-cfdd-4ffd-a026-38fb8ea49d8a req-0dd3a368-ca49-4293-b348-9a94879ffd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:18:52.999216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:52.999792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:53.000679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:53.001383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:53.001505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cde80ba7-cfdd-4ffd-a026-38fb8ea49d8a req-0dd3a368-ca49-4293-b348-9a94879ffd88 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:18:53.001933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cde80ba7-cfdd-4ffd-a026-38fb8ea49d8a req-0dd3a368-ca49-4293-b348-9a94879ffd88 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:18:53.015593 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cde80ba7-cfdd-4ffd-a026-38fb8ea49d8a req-0dd3a368-ca49-4293-b348-9a94879ffd88 service nova] Creating event network-changed:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:18:53.023967 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cde80ba7-cfdd-4ffd-a026-38fb8ea49d8a req-0dd3a368-ca49-4293-b348-9a94879ffd88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038149 Mar 26 21:18:53.025994 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2851/5439] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:18:53.153153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:18:53.161316 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3fb99ef7-f205-4b51-bd2b-531b4bf5704f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1562 microversion: 2.1 time: 0.182397 Mar 26 21:18:53.161896 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2589/5440] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:18:52 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:18.417492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:18.418440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:18.425113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:18.425573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:18.426345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:18.426790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:18.482407 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-272e34fa-cbbe-49e7-9ad8-c3dc8c7705c9 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action" status: 200 len: 24554 microversion: 2.1 time: 0.070033 Mar 26 21:19:18.483053 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2852/5441] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:19:18 2022] POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action => generated 24554 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:19:29.535574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:29.536214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:29.542204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:29.542659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:29.543423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:29.543864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:29.874480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-de859c8e-be86-4404-aa5b-15bbe9fb0d83 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1832 microversion: 2.1 time: 0.342843 Mar 26 21:19:29.875055 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2590/5442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:29 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1832 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:29.892013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:29.892750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:29.900091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:29.900549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:29.901318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:29.901762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.099263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:30.107236 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f8e3ded-1282-4962-85b5-863ec635ef7e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1681 microversion: 2.1 time: 0.219542 Mar 26 21:19:30.107821 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2853/5443] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:29 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:30.208989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:30.209921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:30.215941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.216417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.217170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.217614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.268603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5db20632-e2d6-4061-9159-6d3bf08abefb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action" status: 200 len: 32627 microversion: 2.1 time: 0.063359 Mar 26 21:19:30.269238 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2591/5444] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:19:30 2022] POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action => generated 32627 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:19:30.429507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:30.430093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:30.436518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.436982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.437761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.438207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.463828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7ee61895e452426fa20d33778753d30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b6f802f2f946e9b7b7f069ab789e09', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:30.464934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] flavor_id is None. Assuming migration. {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 26 21:19:30.465385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:19:30.571535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44757f2a-2cb6-4734-bd62-bcebc62fe304 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action" status: 202 len: 0 microversion: 2.1 time: 0.145792 Mar 26 21:19:30.572475 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2854/5445] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:19:30 2022] POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:19:30.581408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:30.582231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:30.590527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.591464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.591784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:30.592268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:30.787439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:30.795307 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1819b272-0648-47f3-a3be-79f06aea0f57 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1690 microversion: 2.1 time: 0.218432 Mar 26 21:19:30.796534 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2592/5446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:30 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:31.814195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:31.814754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:31.820737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:31.821191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:31.821962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:31.822404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:32.001129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:32.008600 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b262f13b-c419-4e22-86ed-a3c55f3903b6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1690 microversion: 2.1 time: 0.199279 Mar 26 21:19:32.009212 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2855/5447] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:31 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:33.025780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:33.026394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:33.034008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:33.034603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:33.035390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:33.035837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:33.172529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:33.180160 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29d0ed77-cd2f-465d-8b35-0dacbb5f9a5f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.158252 Mar 26 21:19:33.180736 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2593/5448] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:33 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:34.198381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:34.199003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:34.206079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:34.206547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:34.207334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:34.207789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:34.347406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:34.355384 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-54cc375a-3535-4c40-83fa-03602d8e6ce7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.160296 Mar 26 21:19:34.355979 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2856/5449] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:34 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:35.373748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:35.374284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:35.381052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:35.381502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:35.382263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:35.382702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:35.516608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:35.524099 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-daf14113-ffb6-456e-86d7-5c682014221a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.154966 Mar 26 21:19:35.524674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2594/5450] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:35 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:36.541672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:36.542315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:36.549316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:36.549773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:36.550537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:36.550978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:36.686187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:36.693689 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-60d49bab-d5e6-4505-b21a-92bbe920d631 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.155965 Mar 26 21:19:36.694268 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2857/5451] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:36 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:37.710508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:37.711124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:37.718555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:37.719013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:37.719786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:37.720260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:37.860723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:37.868142 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a0c00acc-f331-4614-918b-27a3af3cf556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.161461 Mar 26 21:19:37.868705 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2595/5452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:37 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:38.886373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:38.886917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:38.893698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:38.894181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:38.894943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:38.895394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:39.029477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:39.037069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-00469863-a231-4a7a-9ec0-5de741502107 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.155249 Mar 26 21:19:39.037684 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2858/5453] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:38 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:40.054361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:40.054976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:40.062303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:40.062759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:40.063524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:40.063993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:40.197656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:40.205772 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4580f44-2ad6-4102-892e-bc14156a9a8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.155287 Mar 26 21:19:40.206342 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2596/5454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:40 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:41.222898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:41.223516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:41.230403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:41.230865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:41.231643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:41.232125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:41.369882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:41.377400 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7acaf35c-2653-4200-98ee-e301ae6277db tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.158446 Mar 26 21:19:41.377968 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2859/5455] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:41 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:42.394588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:42.395120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:42.402401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:42.402861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:42.403627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:42.404103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:42.536292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:42.544179 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-155741fb-6d00-459e-bfcf-60d4e24c9c10 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.153538 Mar 26 21:19:42.544745 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2597/5456] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:42 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:43.562085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:43.562696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:43.569433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:43.569896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:43.570676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:43.571125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:43.706918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:43.714297 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2610cb54-1561-42fe-aeac-191162b05d89 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.156723 Mar 26 21:19:43.714869 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2860/5457] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:43 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:44.731301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:44.731940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:44.738807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:44.739271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:44.740087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:44.740536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:44.877061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:44.884479 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0002b8df-c6a7-484e-b710-89486b3207c8 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.157107 Mar 26 21:19:44.885058 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2598/5458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:44 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:45.901627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:45.902266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:45.909099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:45.909555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:45.910327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:45.910771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:46.049745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:46.057246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-443c7080-dff2-4bb3-90d5-5ba170f77964 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.159596 Mar 26 21:19:46.057822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2861/5459] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:45 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:47.074208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:47.074830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:47.081630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:47.082091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:47.082867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:47.083316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:47.217318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:47.224904 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-60e842f4-fdb9-47e7-a79c-49873a37cfce tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.155329 Mar 26 21:19:47.225493 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2599/5460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:47 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:48.241994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:48.242610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:48.249940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:48.250399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:48.251172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:48.251627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:48.385987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:48.393409 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-460fa883-0604-40dd-b699-cc75afd51313 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.155353 Mar 26 21:19:48.393978 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2862/5461] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:48 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:49.410754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:49.411275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:49.418179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:49.418639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:49.419415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:49.419860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:49.555490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:49.563008 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c34ac04-eacc-4c3f-845c-6387421bb088 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1695 microversion: 2.1 time: 0.156274 Mar 26 21:19:49.563584 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2600/5462] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:49 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:50.232458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "name": "network-vif-unplugged", "status": "completed", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:50.241925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:50.242392 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:50.255238 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] Creating event network-vif-unplugged:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch2-master-1 Mar 26 21:19:50.260810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] Instance a324e3ad-79af-4b34-a62d-5ca799504736 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:19:50.271591 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e35c9ee8-2058-4397-8098-45939812d10f req-0eb983a9-50c8-4381-bdcb-4aadd6071614 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043649 Mar 26 21:19:50.272408 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2863/5463] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:19:50.581142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:50.581766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:50.589122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:50.589591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:50.590370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:50.590820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:50.868606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:50.875998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61ff38bf-ab39-47b1-ac63-a7596334b55f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1694 microversion: 2.1 time: 0.298752 Mar 26 21:19:50.876584 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2601/5464] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:50 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1694 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:51.895449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:51.896188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:51.902425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:51.902889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:51.903671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:51.904153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:52.045462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:52.053054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85820a31-66b5-4758-b706-30ecea779d05 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1692 microversion: 2.1 time: 0.162726 Mar 26 21:19:52.053628 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2864/5465] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:51 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:52.287684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:52.296968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:52.297677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:52.309144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] Creating event network-changed:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch2-master-1 Mar 26 21:19:52.314346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] Instance a324e3ad-79af-4b34-a62d-5ca799504736 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:19:52.325727 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f8401324-cb41-4741-bc6d-50c3baad5f2d req-684cb097-d680-42e1-bd13-6f9cbff40265 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041386 Mar 26 21:19:52.326652 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2602/5466] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:19:53.070455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:53.071084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:53.078683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.079148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.079953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.080409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.215671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:53.223370 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd54e845-4a02-4f40-b36f-562b3e1b6168 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1689 microversion: 2.1 time: 0.156855 Mar 26 21:19:53.223966 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2865/5467] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:53 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:53.240776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:53.241410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:53.248096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.248550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.249346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.249786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.351137 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-813f60e6-6209-4ce8-9a82-fca3a8c7e69b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action" status: 202 len: 0 microversion: 2.1 time: 0.114419 Mar 26 21:19:53.352178 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2603/5468] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:19:53 2022] POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:19:53.361173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:53.361787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:53.367613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.368097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.368881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:53.369431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:53.509950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:53.517655 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-02805e1f-5dc5-4af3-bd1c-23be385d8db2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1688 microversion: 2.1 time: 0.160689 Mar 26 21:19:53.518248 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2866/5469] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:53 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:19:54.535725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:54.536456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:54.544830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:54.545284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:54.546047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:54.546485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:54.678734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:54.686404 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4e760540-0bf8-4c1d-8db3-b3d970526eec tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1688 microversion: 2.1 time: 0.154952 Mar 26 21:19:54.686975 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2604/5470] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:54 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:55.703734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:55.704393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:55.711318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:55.711783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:55.712621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:55.713096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:55.866747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:55.874733 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-365c4fbb-168f-4f6a-84b5-27839b602132 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1688 microversion: 2.1 time: 0.175185 Mar 26 21:19:55.875331 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2867/5471] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:55 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:56.834817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:19:56.846406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:56.847028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:56.868255 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] Creating event network-changed:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:19:56.875184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] Instance a324e3ad-79af-4b34-a62d-5ca799504736 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:19:56.888610 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9ba4a793-d44c-4bd6-be9f-500b73efbf87 req-fe8daaca-c3da-47de-86db-586cdcf50457 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058689 Mar 26 21:19:56.889338 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2605/5472] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:19:56.892281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:56.892817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:56.900022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:56.900730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:56.901731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:56.902185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:57.165064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:57.174233 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0436e47f-c46a-48e0-be9c-3c9ad8419b82 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1688 microversion: 2.1 time: 0.285944 Mar 26 21:19:57.174826 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2868/5473] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:56 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1688 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:58.192291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:58.193028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:58.200003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:58.200470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:58.201256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:58.201703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:58.350370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:58.358056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d31dc60-746c-44e5-a594-f13f231da61f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1688 microversion: 2.1 time: 0.170898 Mar 26 21:19:58.358644 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2606/5474] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:58 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:19:59.375490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:19:59.376048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:19:59.383797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:59.384300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:59.385581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:19:59.386034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:19:59.530256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:19:59.538034 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-955ec11b-b0ee-4454-9254-43c900eee93c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1681 microversion: 2.1 time: 0.166694 Mar 26 21:19:59.538617 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2869/5475] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:19:59 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:03.514258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ec8f28fe-a953-47e0-8fe9-58e5d535b4ea req-39990105-3211-4f0c-9454-487f26596bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "name": "network-vif-plugged", "status": "completed", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:03.523649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec8f28fe-a953-47e0-8fe9-58e5d535b4ea req-39990105-3211-4f0c-9454-487f26596bda service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:03.525933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec8f28fe-a953-47e0-8fe9-58e5d535b4ea req-39990105-3211-4f0c-9454-487f26596bda service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:03.535633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ec8f28fe-a953-47e0-8fe9-58e5d535b4ea req-39990105-3211-4f0c-9454-487f26596bda service nova] Creating event network-vif-plugged:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:20:03.540588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ec8f28fe-a953-47e0-8fe9-58e5d535b4ea req-39990105-3211-4f0c-9454-487f26596bda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030632 Mar 26 21:20:03.541955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2607/5476] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:20:24.996964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:24.997567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:25.003897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.004385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.005154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.005614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.031522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:20:25.110636 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd6ee397-8d83-4245-aa27-4309acd85288 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 204 len: 0 microversion: 2.1 time: 0.118244 Mar 26 21:20:25.111264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2870/5477] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:20:24 2022] DELETE /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:20:25.121289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:25.121998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:25.128181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.128642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.129422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.129865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.267147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:25.274650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-43a92d34-9846-4018-aaad-b0ea776bdf8a tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1731 microversion: 2.1 time: 0.158992 Mar 26 21:20:25.275227 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2608/5478] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:25 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:25.765250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:25.766309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:25.772352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.772818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.773600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:25.774052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:25.839707 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2098efd7-096b-4451-8282-063a65de3e46 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action" status: 200 len: 63010 microversion: 2.1 time: 0.078653 Mar 26 21:20:25.840398 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2871/5479] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:20:25 2022] POST /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736/action => generated 63010 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:20:26.460707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:26.461447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:26.468264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:26.468723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:26.469498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:26.469936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:26.674022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:26.681765 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae5157dc-068f-4444-ad14-321808a4ea42 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1731 microversion: 2.1 time: 0.393935 Mar 26 21:20:26.682341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2609/5480] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:26 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1731 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:27.520085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f6e081fe-8aa7-467b-9738-33956e41338f req-ddf04e0e-0a88-4579-89af-8e58512f5158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd236bf8-150d-4e59-9e5d-f8914bc74c8c", "name": "network-vif-deleted", "tag": "d6e7ebff-b51e-441f-b6b1-b718e5c678cf"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:27.531298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f6e081fe-8aa7-467b-9738-33956e41338f req-ddf04e0e-0a88-4579-89af-8e58512f5158 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:27.531778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f6e081fe-8aa7-467b-9738-33956e41338f req-ddf04e0e-0a88-4579-89af-8e58512f5158 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:27.548870 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f6e081fe-8aa7-467b-9738-33956e41338f req-ddf04e0e-0a88-4579-89af-8e58512f5158 service nova] Creating event network-vif-deleted:d6e7ebff-b51e-441f-b6b1-b718e5c678cf for instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c on nch2-master-1 Mar 26 21:20:27.554413 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f6e081fe-8aa7-467b-9738-33956e41338f req-ddf04e0e-0a88-4579-89af-8e58512f5158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117283 Mar 26 21:20:27.555622 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2872/5481] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:20:27.699109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:27.699727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:27.706911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:27.707463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:27.708338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:27.708848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:27.741790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:27.742244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:27.742699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lazy-loading 'fault' on Instance uuid fd236bf8-150d-4e59-9e5d-f8914bc74c8c {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:20:27.787700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac02d48a08c4284ae0c82008c970e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a14cf15734c4aa881ff16a0bc734242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:27.795369 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44b6b501-5e9a-42bf-8603-b6552e1b70b3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 200 len: 1387 microversion: 2.1 time: 0.100687 Mar 26 21:20:27.796133 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2610/5482] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:27 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:28.813784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:28.814410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:28.820859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:28.821320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:28.822096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:28.822538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:28.835453 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] HTTP exception thrown: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. Mar 26 21:20:28.836118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Returning 404 to user: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:20:28.837442 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b7aae25-1a4c-46e9-ab89-62062edd25bd tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 404 len: 111 microversion: 2.1 time: 0.028424 Mar 26 21:20:28.837983 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2873/5483] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:28 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:20:29.290955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:29.291454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:29.298513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:29.298978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:29.299757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:29.300242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:29.313309 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] HTTP exception thrown: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. Mar 26 21:20:29.313903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Returning 404 to user: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:20:29.314789 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e6631a40-cc07-4685-8be6-7ddfb2047dd3 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 404 len: 111 microversion: 2.1 time: 0.027969 Mar 26 21:20:29.315321 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2611/5484] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:20:29 2022] DELETE /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:20:29.323823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:29.324544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] [instance: fd236bf8-150d-4e59-9e5d-f8914bc74c8c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:29.330976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:29.331442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:29.332259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:29.332714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:29.346531 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] HTTP exception thrown: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. Mar 26 21:20:29.347075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Returning 404 to user: Instance fd236bf8-150d-4e59-9e5d-f8914bc74c8c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:20:29.347909 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-44192da1-785a-4b5f-b5b3-6cab90c479bf tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c" status: 404 len: 111 microversion: 2.1 time: 0.028515 Mar 26 21:20:29.348452 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2874/5485] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:29 2022] GET /compute/v2.1/servers/fd236bf8-150d-4e59-9e5d-f8914bc74c8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:20:29.503946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f6800276-0ca7-4ea6-a175-a27f9ecac327 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] Calling method '.version_select at 0x7f6e58598af0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:29.523668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f6800276-0ca7-4ea6-a175-a27f9ecac327 tempest-TestServerBasicOps-519159747 tempest-TestServerBasicOps-519159747-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-484755387" status: 202 len: 0 microversion: 2.1 time: 0.023591 Mar 26 21:20:29.524338 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2612/5486] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-484755387 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:20:32.240393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:32.241036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:32.248144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:32.248608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:32.249394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:32.249840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:32.499580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c24c7f0c-e9b8-4e39-baed-7347145bfd41 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1832 microversion: 2.1 time: 0.261962 Mar 26 21:20:32.513670 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2875/5487] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:32 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1832 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:33.499870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-66ee5152-952e-4fa2-9ba0-c29ac7629d62 req-7185c272-0c51-409c-b034-b734bba73951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:33.506394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:33.507404 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:33.512084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-66ee5152-952e-4fa2-9ba0-c29ac7629d62 req-7185c272-0c51-409c-b034-b734bba73951 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:33.512586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-66ee5152-952e-4fa2-9ba0-c29ac7629d62 req-7185c272-0c51-409c-b034-b734bba73951 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:33.514943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:33.515579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:33.516625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:33.517061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:33.528126 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-66ee5152-952e-4fa2-9ba0-c29ac7629d62 req-7185c272-0c51-409c-b034-b734bba73951 service nova] Creating event network-changed:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:20:33.534804 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-66ee5152-952e-4fa2-9ba0-c29ac7629d62 req-7185c272-0c51-409c-b034-b734bba73951 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038532 Mar 26 21:20:33.535754 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2876/5488] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:20:33.545254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:20:33.634978 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-29fe31ca-388b-4b6c-94ad-3fcd0775a280 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 204 len: 0 microversion: 2.1 time: 0.142360 Mar 26 21:20:33.636282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2613/5489] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:20:33 2022] DELETE /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:20:33.646586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:33.647569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:33.654935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:33.655600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:33.656651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:33.657254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:34.021056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:34.031489 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70c5b43e-0f7d-48e8-802f-0d00d2a1b3ad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1687 microversion: 2.1 time: 0.390355 Mar 26 21:20:34.032267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2877/5490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:33 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1687 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:35.051518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:35.052864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:35.059360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:35.059823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:35.060630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:35.061081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:35.222098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:35.233229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3a4fac9-e637-4d88-8610-c948892aa6bc tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1568 microversion: 2.1 time: 0.185935 Mar 26 21:20:35.233991 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2614/5491] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:35 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:36.076532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-56c0723a-3d67-452a-873a-0fb7f5ce1be0 req-a98d731a-4982-4400-a45a-7f2eb274a110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a324e3ad-79af-4b34-a62d-5ca799504736", "name": "network-vif-deleted", "tag": "9b190770-f5cf-46e2-933a-b74ae077b2ae"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:36.086057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56c0723a-3d67-452a-873a-0fb7f5ce1be0 req-a98d731a-4982-4400-a45a-7f2eb274a110 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:36.086768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-56c0723a-3d67-452a-873a-0fb7f5ce1be0 req-a98d731a-4982-4400-a45a-7f2eb274a110 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:36.108311 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-56c0723a-3d67-452a-873a-0fb7f5ce1be0 req-a98d731a-4982-4400-a45a-7f2eb274a110 service nova] Creating event network-vif-deleted:9b190770-f5cf-46e2-933a-b74ae077b2ae for instance a324e3ad-79af-4b34-a62d-5ca799504736 on nch1-master-1 Mar 26 21:20:36.113837 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-56c0723a-3d67-452a-873a-0fb7f5ce1be0 req-a98d731a-4982-4400-a45a-7f2eb274a110 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124479 Mar 26 21:20:36.114823 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2878/5492] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:20:36.250859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:36.252145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:36.260307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:36.261021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:36.262016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:36.262627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:36.311309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:36.311782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:36.312308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lazy-loading 'fault' on Instance uuid a324e3ad-79af-4b34-a62d-5ca799504736 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:20:36.359474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:36.367276 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-148b743f-df06-4cb6-ba0e-d25240f10082 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 200 len: 1356 microversion: 2.1 time: 0.120461 Mar 26 21:20:36.369772 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2615/5493] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:36 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 1356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:37.387902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:37.390068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: a324e3ad-79af-4b34-a62d-5ca799504736] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:37.398552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:37.399785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:37.400798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:37.401248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:37.417350 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] HTTP exception thrown: Instance a324e3ad-79af-4b34-a62d-5ca799504736 could not be found. Mar 26 21:20:37.418151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Returning 404 to user: Instance a324e3ad-79af-4b34-a62d-5ca799504736 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:20:37.419006 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ab5c40f9-6514-4f8c-a9df-a837d51cd57d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736" status: 404 len: 111 microversion: 2.1 time: 0.036211 Mar 26 21:20:37.419568 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2879/5494] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:37 2022] GET /compute/v2.1/servers/a324e3ad-79af-4b34-a62d-5ca799504736 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:20:41.543556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5df705ac-0558-4e20-9f63-4e96e353fd6d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '.version_select at 0x7f6e588e6dc0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:41.623018 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5df705ac-0558-4e20-9f63-4e96e353fd6d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113274435" status: 202 len: 0 microversion: 2.1 time: 0.082623 Mar 26 21:20:41.627567 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2616/5495] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 21:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113274435 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:20:41.673550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: .version_select at 0x7f6e4bf18c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1804487334"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:41.717701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:20:41.730394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:20:42.140740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:20:42.146057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:20:42.160743 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5b7d572f-047a-4c80-b1c3-09b7506fbb4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.491496 Mar 26 21:20:42.161349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2880/5496] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:20:41 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:45.309486 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:20:45.310259 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:20:50.889102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1437161827", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "18f9904e-eec9-462f-b69f-a69c5cd6079a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1804487334", "security_groups": [{"name": "tempest-secgroup-smoke-109411946"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:51.037785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] validate_networks() for [('18f9904e-eec9-462f-b69f-a69c5cd6079a', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:20:51.838439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:20:51.839001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:20:51.839818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:20:51.840268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:20:51.840699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:20:51.864810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:51.865409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:51.866285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:51.866782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:51.909384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:20:51.916551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:20:51.937003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:20:51.941070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:20:52.014451 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84e5b626-e82a-4088-9b96-1c741fced0cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.128920 Mar 26 21:20:52.016856 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2617/5497] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:20:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:20:52.031572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-271b6a73-727c-4752-8a73-dd2cf28c7c1e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:52.032223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-271b6a73-727c-4752-8a73-dd2cf28c7c1e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:52.106286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-271b6a73-727c-4752-8a73-dd2cf28c7c1e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:52.119045 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-271b6a73-727c-4752-8a73-dd2cf28c7c1e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1267 microversion: 2.1 time: 0.096295 Mar 26 21:20:52.122131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2881/5498] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:52 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:53.141034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:53.141824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:53.151716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:53.152205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:53.152997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:53.153437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:53.330964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:53.383084 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66eeef49-9095-4dac-aa7e-62f39ea02157 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1263 microversion: 2.1 time: 0.241742 Mar 26 21:20:53.384439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2618/5499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:53 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:54.402558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:54.403088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:54.411207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:54.411666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:54.412477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:54.413836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:54.503454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:54.513147 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-449033a3-1822-4378-978a-4d48a838f30b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1325 microversion: 2.1 time: 0.115308 Mar 26 21:20:54.513747 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2882/5500] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:54 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:55.510715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1f3212f2-f25a-455c-87a4-1672eee5495a req-542c5939-c007-41d8-8a8d-52069dae20da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:55.525953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1f3212f2-f25a-455c-87a4-1672eee5495a req-542c5939-c007-41d8-8a8d-52069dae20da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:55.526595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1f3212f2-f25a-455c-87a4-1672eee5495a req-542c5939-c007-41d8-8a8d-52069dae20da service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:55.530644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:55.531324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:55.542042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1f3212f2-f25a-455c-87a4-1672eee5495a req-542c5939-c007-41d8-8a8d-52069dae20da service nova] Creating event network-changed:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:20:55.547017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:55.547491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:55.548445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:55.548922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:55.549184 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1f3212f2-f25a-455c-87a4-1672eee5495a req-542c5939-c007-41d8-8a8d-52069dae20da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042054 Mar 26 21:20:55.550261 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2619/5501] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:20:55.918463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2119154754", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "97e236f2-b607-4957-9631-2c5ab141d8d7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:56.025374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:20:56.114584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:56.123026 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5623dee-2afa-419b-961b-a1a3d15e58ba tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.596652 Mar 26 21:20:56.124056 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2883/5502] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:55 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:56.525825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:20:56.526305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:20:56.526726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:20:56.527141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:20:56.527561 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:20:56.539709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:56.540456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:56.541436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:56.541886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:56.562105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:20:56.568400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:20:56.583548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:20:56.585964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='97e236f2-b607-4957-9631-2c5ab141d8d7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:20:56.686138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4cc5ee3-2c86-442e-8339-e30b0e7012af tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772452 Mar 26 21:20:56.686791 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2620/5503] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 26 21:20:56.698443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c9da0150-94a4-4fb3-9f12-a8f6f402cc80 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:56.699074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c9da0150-94a4-4fb3-9f12-a8f6f402cc80 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:56.806885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c9da0150-94a4-4fb3-9f12-a8f6f402cc80 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:56.816678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c9da0150-94a4-4fb3-9f12-a8f6f402cc80 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1057 microversion: 2.1 time: 0.123646 Mar 26 21:20:56.828592 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2884/5504] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:56 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1057 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:20:57.140375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:57.141079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:57.147786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:57.148360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:57.149165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:57.149634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:57.296288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:57.303901 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d86132cd-4679-4269-92f8-fc91fcb46baf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.167703 Mar 26 21:20:57.304877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2621/5505] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:57 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:57.834712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:57.835339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:57.845507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:57.845970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:57.846764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:57.847218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:57.928977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:57.937581 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4af1c08c-6012-4c9f-a498-64ef20136a20 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1127 microversion: 2.1 time: 0.106538 Mar 26 21:20:57.938694 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2885/5506] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:57 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1127 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:58.321311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:58.321935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:58.329906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:58.330367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:58.331158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:58.331603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:58.603383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:58.617541 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86881ee6-4ee6-42f8-bfe6-0a95aad035c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.300043 Mar 26 21:20:58.618748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2622/5507] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:58 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:58.956157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:58.957378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:58.963949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:58.964725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:58.965823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:58.966307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:59.162038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:59.177440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85a94185-9a67-4104-bb28-d4aa683bd716 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1169 microversion: 2.1 time: 0.225140 Mar 26 21:20:59.188402 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2886/5508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:58 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:20:59.514645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c5d7c41a-a23b-4dfa-a5be-7f819ab3f1f1 req-c119eb63-1268-47b4-abde-f6acd91e3fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490552dd-4509-4c3b-95ed-ad31429a3eca", "tag": "052d471a-aa51-4515-8e0c-5f51ce6b0d51"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:20:59.528600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c5d7c41a-a23b-4dfa-a5be-7f819ab3f1f1 req-c119eb63-1268-47b4-abde-f6acd91e3fc1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:59.532032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c5d7c41a-a23b-4dfa-a5be-7f819ab3f1f1 req-c119eb63-1268-47b4-abde-f6acd91e3fc1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:59.558491 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c5d7c41a-a23b-4dfa-a5be-7f819ab3f1f1 req-c119eb63-1268-47b4-abde-f6acd91e3fc1 service nova] Creating event network-changed:052d471a-aa51-4515-8e0c-5f51ce6b0d51 for instance 490552dd-4509-4c3b-95ed-ad31429a3eca on nch2-master-1 Mar 26 21:20:59.563812 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c5d7c41a-a23b-4dfa-a5be-7f819ab3f1f1 req-c119eb63-1268-47b4-abde-f6acd91e3fc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054880 Mar 26 21:20:59.565154 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2623/5509] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:20:59.636973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:20:59.637603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:20:59.643999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:59.644468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:59.645270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:20:59.645923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:20:59.831632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:20:59.839426 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7391642a-4604-4245-b1b0-d02e26e20446 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.208489 Mar 26 21:20:59.849567 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2887/5510] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:20:59 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:00.198149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:00.199685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:00.206637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:00.207344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:00.208532 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:00.209125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:00.473674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:00.482858 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e42b4c56-59cb-4746-8fca-5bcf753a296f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1169 microversion: 2.1 time: 0.291736 Mar 26 21:21:00.483911 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2624/5511] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:00 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1169 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:00.856114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:00.856663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:00.863333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:00.863787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:00.864587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:00.865032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:01.011028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:01.023076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fc7cb32b-066e-4d80-ad9b-6af7b4be9e18 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.170888 Mar 26 21:21:01.027168 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2888/5512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:00 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:01.500760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:01.501316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:01.508560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:01.509097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:01.509838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:01.510253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:01.662423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:01.673100 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ead67aa2-16cf-4837-a030-fa45f8b86aaf tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1169 microversion: 2.1 time: 0.176416 Mar 26 21:21:01.684462 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2625/5513] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:01 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:01.782893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0f1c852f-6446-40dc-9f62-bd107465b100 req-438a9392-e804-4177-9804-0dab6b75aa0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "name": "network-vif-plugged", "status": "completed", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:01.791871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0f1c852f-6446-40dc-9f62-bd107465b100 req-438a9392-e804-4177-9804-0dab6b75aa0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:01.792446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0f1c852f-6446-40dc-9f62-bd107465b100 req-438a9392-e804-4177-9804-0dab6b75aa0c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:01.803936 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0f1c852f-6446-40dc-9f62-bd107465b100 req-438a9392-e804-4177-9804-0dab6b75aa0c service nova] Creating event network-vif-plugged:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:01.809023 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0f1c852f-6446-40dc-9f62-bd107465b100 req-438a9392-e804-4177-9804-0dab6b75aa0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175034 Mar 26 21:21:01.809707 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2889/5514] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:02.041910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:02.042559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:02.049183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:02.049644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:02.050475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:02.050925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:02.192758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:02.201553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56b18f94-fea2-4d55-9571-682cc484a366 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1392 microversion: 2.1 time: 0.164140 Mar 26 21:21:02.202468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2626/5515] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:02 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:02.692105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:02.692813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:02.699615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:02.700110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:02.700880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:02.701323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:02.832860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:02.840728 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6944b13b-2203-41b7-a79d-19dc9c0ba82a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.153744 Mar 26 21:21:02.841307 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2890/5516] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:02 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:03.218755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:03.219375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:03.226557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.227012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:03.227945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.228410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:03.367171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:03.374681 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-193f7419-7124-42bc-8d01-1279a84f3fff tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1565 microversion: 2.1 time: 0.159898 Mar 26 21:21:03.375241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2627/5517] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:03 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:03.390852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:03.391471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:03.397364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.398318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:03.399093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.399543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:03.534903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:03.542968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a982f668-2903-439a-b9a3-ed8bde0ae747 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1565 microversion: 2.1 time: 0.156167 Mar 26 21:21:03.543542 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2891/5518] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:03 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:03.857991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:03.858525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:03.864454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.864904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:03.865669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:03.866107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:04.081430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:04.089174 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-91cb1962-ea24-43c1-abe7-a7ea806ec1b0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.235154 Mar 26 21:21:04.089836 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2628/5519] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:03 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:05.106759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:05.107413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:05.114688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:05.115159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:05.116074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:05.116469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:05.254552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:05.262939 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-50c3373c-7548-467c-9023-fa4f12e8cf74 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.160212 Mar 26 21:21:05.263512 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2892/5520] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:05 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:05.697339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:05.697956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:05.699954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-342d6dfb-512e-443a-863c-8a7950c42b0a req-85ffa931-672a-4a41-be97-38f4bd977409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:05.705395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:05.705853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:05.706870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:05.707475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:05.708816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-342d6dfb-512e-443a-863c-8a7950c42b0a req-85ffa931-672a-4a41-be97-38f4bd977409 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:05.709348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-342d6dfb-512e-443a-863c-8a7950c42b0a req-85ffa931-672a-4a41-be97-38f4bd977409 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:05.720721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-342d6dfb-512e-443a-863c-8a7950c42b0a req-85ffa931-672a-4a41-be97-38f4bd977409 service nova] Creating event network-changed:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:05.725965 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-342d6dfb-512e-443a-863c-8a7950c42b0a req-85ffa931-672a-4a41-be97-38f4bd977409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030071 Mar 26 21:21:05.727008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2893/5521] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:05.852820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:05.860645 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8cd12fb7-1f09-4dc6-aa4e-0c4861aa197e tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1565 microversion: 2.1 time: 0.168129 Mar 26 21:21:05.861472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2629/5522] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:05 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:06.280365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:06.281227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:06.289096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:06.289579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:06.290377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:06.290851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:06.457210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:06.466582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f3e927f2-ddec-47ec-a9df-a5129a694d00 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.190783 Mar 26 21:21:06.467369 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2894/5523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:06 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:07.483291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:07.483832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:07.490674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:07.491141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:07.492584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:07.493034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:07.627026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:07.634347 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aba2dbd4-2d86-4158-9874-72b7c8b3cdad tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.155132 Mar 26 21:21:07.634930 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2630/5524] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:07 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:08.052891 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d7d31587-a10f-452c-9a48-32af4e2b2cd9 req-a32ca49a-1874-41b7-b8ce-87cbd441d1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490552dd-4509-4c3b-95ed-ad31429a3eca", "name": "network-vif-plugged", "status": "completed", "tag": "052d471a-aa51-4515-8e0c-5f51ce6b0d51"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:08.062586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d7d31587-a10f-452c-9a48-32af4e2b2cd9 req-a32ca49a-1874-41b7-b8ce-87cbd441d1f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:08.063042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d7d31587-a10f-452c-9a48-32af4e2b2cd9 req-a32ca49a-1874-41b7-b8ce-87cbd441d1f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:08.075178 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d7d31587-a10f-452c-9a48-32af4e2b2cd9 req-a32ca49a-1874-41b7-b8ce-87cbd441d1f9 service nova] Creating event network-vif-plugged:052d471a-aa51-4515-8e0c-5f51ce6b0d51 for instance 490552dd-4509-4c3b-95ed-ad31429a3eca on nch2-master-1 Mar 26 21:21:08.080120 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d7d31587-a10f-452c-9a48-32af4e2b2cd9 req-a32ca49a-1874-41b7-b8ce-87cbd441d1f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031364 Mar 26 21:21:08.080890 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2895/5525] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:08.650654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:08.651271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:08.658090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:08.658543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:08.659317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:08.659761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:08.794640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:08.802291 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0b99d06-3d9d-493b-a42a-c26b5f9c648b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1203 microversion: 2.1 time: 0.155567 Mar 26 21:21:08.802861 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2631/5526] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:08 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:09.820433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:09.821138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:09.828229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:09.828684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:09.829455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:09.829902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:09.961929 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:09.969866 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-140a89bf-72f7-42fa-9c49-f94965296d6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1389 microversion: 2.1 time: 0.154214 Mar 26 21:21:09.970461 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2896/5527] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:09 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:09.985678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:09.986290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:09.993496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:09.993953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:09.994718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:09.995157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.126171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:10.134370 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c84c4807-74db-4715-a88e-78eaa490b6a2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1389 microversion: 2.1 time: 0.152594 Mar 26 21:21:10.134942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2632/5528] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:09 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:10.150195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:10.150812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:10.156714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.157170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.157937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.158379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.293650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:10.301385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45c0d211-1bf7-4f29-ba70-7af079aebfcd tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1389 microversion: 2.1 time: 0.155108 Mar 26 21:21:10.301951 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2897/5529] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:10 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:10.368823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:10.369419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:10.375296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.375777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.376574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.377019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.400586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:21:10.471616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f22896ff-3e2b-4d3a-b015-5a5ee4891c14 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 204 len: 0 microversion: 2.1 time: 0.106818 Mar 26 21:21:10.472301 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2633/5530] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:21:10 2022] DELETE /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:21:10.481111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:10.481772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:10.487772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.488275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.489056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:10.489505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:10.624047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:10.631417 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b555bb37-6b1f-44a2-a27f-c9303e7fcd7c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1395 microversion: 2.1 time: 0.154286 Mar 26 21:21:10.632009 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2898/5531] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:10 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:11.648852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:11.649558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:11.656469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:11.656968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:11.657873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:11.658332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:11.788871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:11.796722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9b9cc8ba-a499-47b0-a22e-0bd6ef491135 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1395 microversion: 2.1 time: 0.152173 Mar 26 21:21:11.797350 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2634/5532] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:11 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1395 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:12.432713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-519adfe6-a477-4a88-920f-41370303fc8a req-f31fc106-0f08-4d79-8382-695618a519e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490552dd-4509-4c3b-95ed-ad31429a3eca", "name": "network-vif-deleted", "tag": "052d471a-aa51-4515-8e0c-5f51ce6b0d51"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:12.444845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-519adfe6-a477-4a88-920f-41370303fc8a req-f31fc106-0f08-4d79-8382-695618a519e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:12.445300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-519adfe6-a477-4a88-920f-41370303fc8a req-f31fc106-0f08-4d79-8382-695618a519e9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:12.458128 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-519adfe6-a477-4a88-920f-41370303fc8a req-f31fc106-0f08-4d79-8382-695618a519e9 service nova] Creating event network-vif-deleted:052d471a-aa51-4515-8e0c-5f51ce6b0d51 for instance 490552dd-4509-4c3b-95ed-ad31429a3eca on nch2-master-1 Mar 26 21:21:12.464725 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-519adfe6-a477-4a88-920f-41370303fc8a req-f31fc106-0f08-4d79-8382-695618a519e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036558 Mar 26 21:21:12.465401 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2899/5533] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:12.814228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:12.814963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:12.822940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:12.823513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:12.824451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:12.824971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:12.857836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:12.858331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:12.858847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lazy-loading 'fault' on Instance uuid 490552dd-4509-4c3b-95ed-ad31429a3eca {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:21:12.900396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:12.907885 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6fab50b3-8316-428f-bb94-24c567ec5b0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 200 len: 1193 microversion: 2.1 time: 0.098081 Mar 26 21:21:12.908503 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2635/5534] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:12 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:13.926006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:13.926789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:13.933502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:13.933995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:13.934770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:13.935219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:13.948167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. Mar 26 21:21:13.948757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:21:13.949582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-93cf2a66-671f-43cd-abf7-fcd61fdd8cb8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 404 len: 111 microversion: 2.1 time: 0.028112 Mar 26 21:21:13.950133 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2900/5535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:13 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:21:13.979680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:13.980213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:13.987171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:13.987662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:13.988469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:13.988916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:14.002040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. Mar 26 21:21:14.002634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:21:14.003463 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-956ec7a4-3d3e-4eb2-af2e-e6310be1cb58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 404 len: 111 microversion: 2.1 time: 0.028440 Mar 26 21:21:14.004013 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2636/5536] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:21:13 2022] DELETE /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:21:14.012155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:14.012781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 490552dd-4509-4c3b-95ed-ad31429a3eca] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:14.018837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:14.019302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:14.020126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:14.020575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:14.034559 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. Mar 26 21:21:14.035159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 490552dd-4509-4c3b-95ed-ad31429a3eca could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:21:14.036022 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ff1733f4-e461-44fd-8b47-3cecfd244164 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca" status: 404 len: 111 microversion: 2.1 time: 0.027836 Mar 26 21:21:14.036557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2901/5537] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:14 2022] GET /compute/v2.1/servers/490552dd-4509-4c3b-95ed-ad31429a3eca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:21:19.856826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1680691367", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:19.914845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:21:20.274579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:21:20.274947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:21:20.275424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:21:20.275835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:21:20.276281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:21:20.284953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:20.285405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:20.286202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:20.286674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:20.303673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:21:20.309010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:21:20.364752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:21:20.366867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f',volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:21:20.487159 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ffde56c-da82-4431-a386-c759f612225c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634169 Mar 26 21:21:20.487803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2637/5538] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:21:20.497797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0974044-6a6c-45cf-b1e2-fd09a56603f9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:20.498531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0974044-6a6c-45cf-b1e2-fd09a56603f9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:20.552651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0974044-6a6c-45cf-b1e2-fd09a56603f9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:20.561700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0974044-6a6c-45cf-b1e2-fd09a56603f9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1071 microversion: 2.1 time: 0.067818 Mar 26 21:21:20.562280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2902/5539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:20 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1071 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:21.579870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:21.585411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:21.593623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:21.594097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:21.595338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:21.595790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:21.661644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:21.669930 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcf77ce5-eb76-4874-9429-f569a55ba97a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1187 microversion: 2.1 time: 0.094892 Mar 26 21:21:21.671017 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2638/5540] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:21 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:22.687420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:22.688757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:22.697540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:22.698041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:22.698830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:22.699314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:22.716884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d7ff03ce-85ae-449b-9ff1-b9a14c683b4e req-1748fe3c-8bff-4c1f-8bb9-f863cf8eedcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966b1c71-ea56-4e76-ac0b-7178592bf3cd", "tag": "4da0d94e-acad-408d-a0ea-93c2360988ea"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:22.738718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d7ff03ce-85ae-449b-9ff1-b9a14c683b4e req-1748fe3c-8bff-4c1f-8bb9-f863cf8eedcb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:22.739339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d7ff03ce-85ae-449b-9ff1-b9a14c683b4e req-1748fe3c-8bff-4c1f-8bb9-f863cf8eedcb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:22.757301 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d7ff03ce-85ae-449b-9ff1-b9a14c683b4e req-1748fe3c-8bff-4c1f-8bb9-f863cf8eedcb service nova] Creating event network-changed:4da0d94e-acad-408d-a0ea-93c2360988ea for instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd on nch2-master-1 Mar 26 21:21:22.767206 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d7ff03ce-85ae-449b-9ff1-b9a14c683b4e req-1748fe3c-8bff-4c1f-8bb9-f863cf8eedcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060730 Mar 26 21:21:22.768684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2639/5541] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:22.884830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:22.892673 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7a2e2c6-bcdc-4cf1-9bf2-9b29ce684dda tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.209292 Mar 26 21:21:22.893478 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2903/5542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:22 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:23.911367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:23.912127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:23.918225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:23.918687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:23.919463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:23.920190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:24.062236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:24.069683 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-738d9b18-df27-4628-9980-7b01b38ba6fe tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.163630 Mar 26 21:21:24.070252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2640/5543] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:23 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:25.086666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:25.087285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:25.093835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:25.094289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:25.095059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:25.095503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:25.226094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:25.233902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb870983-29e5-44eb-b72f-d284e1d059a0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.151209 Mar 26 21:21:25.234467 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2904/5544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:25 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:26.250388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:26.250995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:26.257604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:26.258067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:26.258898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:26.259562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:26.391513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:26.399703 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a33dfdd5-86c7-4139-8e1b-b49509dac707 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.153010 Mar 26 21:21:26.400332 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2641/5545] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:26 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:27.416605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:27.417154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:27.424325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:27.424791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:27.425572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:27.426027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:27.562026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:27.569452 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5f5b9afa-33a3-4b68-999d-d41949c70a33 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.157446 Mar 26 21:21:27.570018 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2905/5546] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:27 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:28.193774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-cd32308d-15d5-49e8-8cf7-c7dfb4a530d8 req-1fdee4c8-dd56-4dc3-beb1-f3a1321bc486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966b1c71-ea56-4e76-ac0b-7178592bf3cd", "name": "network-vif-plugged", "status": "completed", "tag": "4da0d94e-acad-408d-a0ea-93c2360988ea"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:28.203599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cd32308d-15d5-49e8-8cf7-c7dfb4a530d8 req-1fdee4c8-dd56-4dc3-beb1-f3a1321bc486 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:28.204081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-cd32308d-15d5-49e8-8cf7-c7dfb4a530d8 req-1fdee4c8-dd56-4dc3-beb1-f3a1321bc486 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:28.216492 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-cd32308d-15d5-49e8-8cf7-c7dfb4a530d8 req-1fdee4c8-dd56-4dc3-beb1-f3a1321bc486 service nova] Creating event network-vif-plugged:4da0d94e-acad-408d-a0ea-93c2360988ea for instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd on nch2-master-1 Mar 26 21:21:28.221354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-cd32308d-15d5-49e8-8cf7-c7dfb4a530d8 req-1fdee4c8-dd56-4dc3-beb1-f3a1321bc486 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Mar 26 21:21:28.221956 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2642/5547] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:28.586071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:28.586641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:28.593895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:28.594365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:28.595152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:28.595729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:28.726474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:28.734667 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-80816d04-6728-453a-9096-776a7817b21a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1217 microversion: 2.1 time: 0.152583 Mar 26 21:21:28.735258 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2906/5548] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:28 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:29.265953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:29.266972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:29.273204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.273660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:29.274486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.274885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:29.328309 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84144f82-a7aa-4afd-bcfd-08f20e8fc588 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action" status: 200 len: 24569 microversion: 2.1 time: 0.138233 Mar 26 21:21:29.329253 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2643/5549] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:21:29 2022] POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action => generated 24569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:21:29.751397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:29.752062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:29.758822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.759294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:29.760099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.760547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:29.895339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:29.903412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0bceb7b1-feef-45fb-8494-59f2bb56a596 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1403 microversion: 2.1 time: 0.156112 Mar 26 21:21:29.904008 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2907/5550] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:29 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:29.920680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:29.921412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:29.928344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.928809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:29.929577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:29.930020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:30.067051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:30.074486 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ae32ce7a-0866-4f0f-86c2-fdff0897b2ff tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1403 microversion: 2.1 time: 0.158929 Mar 26 21:21:30.075236 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2644/5551] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:29 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:30.090896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1383423910"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:30.091965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:30.097931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:30.098398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:30.099184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:30.099634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:30.189201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Attempting to quiesce instance before volume snapshot. Mar 26 21:21:30.261307 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Mar 26 21:21:30.331564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Creating snapshot from volume 24cd469b-16eb-4bd9-9baa-d6e3cfb58f0f. {{(pid=141581) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Mar 26 21:21:31.179235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-298bd474-d672-44d2-afe7-68ff04b05f0a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd/action" status: 202 len: 0 microversion: 2.1 time: 1.092702 Mar 26 21:21:31.180040 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2908/5552] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:21:30 2022] POST /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd/action => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:21:31.295944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-614472730", "imageRef": "2b988396-85d7-4bd6-8a35-a06eaa0fe884", "flavorRef": "452", "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:31.347492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:21:31.706516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:21:31.706943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:21:31.707423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:21:31.707833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:21:31.708295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:21:31.717616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:31.718091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:31.718877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:31.719324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:31.736179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:21:31.741389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:21:31.753442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:21:31.755929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d5ea77ae-fd20-49d0-abbf-03de84a2e7da',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:21:31.833222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c30dc8c-a259-42dc-ae2a-b951b0a78b16 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541905 Mar 26 21:21:31.834095 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2645/5553] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:21:31.845515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d46c3b1-27aa-43cd-a1f2-043f278c38ce tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:31.846230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4d46c3b1-27aa-43cd-a1f2-043f278c38ce tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:31.897088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d46c3b1-27aa-43cd-a1f2-043f278c38ce tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:31.904402 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d46c3b1-27aa-43cd-a1f2-043f278c38ce tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1229 microversion: 2.1 time: 0.063854 Mar 26 21:21:31.905262 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2909/5554] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:31 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1229 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:32.923205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:32.924075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:32.930484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:32.931051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:32.932050 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:32.932601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:32.997591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:33.006451 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a724e97c-772c-4fc0-984d-81e3619b8eb6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1299 microversion: 2.1 time: 0.088982 Mar 26 21:21:33.016600 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2646/5555] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:32 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:34.025872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:34.028152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:34.037082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:34.037559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:34.038365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:34.038822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:34.199719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4c81db36-ebee-4053-9f39-23f1288dfde4 req-bf513288-3f17-4cce-9889-cd845eb6e14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097010f7-9ecf-4055-9bbd-82e9b5b6428a", "tag": "f7606cd0-7797-46c7-a951-3b87fcee2f57"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:34.213553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4c81db36-ebee-4053-9f39-23f1288dfde4 req-bf513288-3f17-4cce-9889-cd845eb6e14d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:34.214022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4c81db36-ebee-4053-9f39-23f1288dfde4 req-bf513288-3f17-4cce-9889-cd845eb6e14d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:34.234970 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4c81db36-ebee-4053-9f39-23f1288dfde4 req-bf513288-3f17-4cce-9889-cd845eb6e14d service nova] Creating event network-changed:f7606cd0-7797-46c7-a951-3b87fcee2f57 for instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a on nch1-master-1 Mar 26 21:21:34.241038 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4c81db36-ebee-4053-9f39-23f1288dfde4 req-bf513288-3f17-4cce-9889-cd845eb6e14d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045052 Mar 26 21:21:34.242025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2647/5556] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:34.298029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:34.305847 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d483c175-bfbc-4891-9d5b-c75bfa6feef4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1341 microversion: 2.1 time: 0.285502 Mar 26 21:21:34.306453 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2910/5557] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:34 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1341 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:35.323275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:35.324007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:35.331395 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:35.331851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:35.332639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:35.333078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:35.462596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:35.469881 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e0d0af5-62dd-4a48-8d6d-1f2001f45ca6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1341 microversion: 2.1 time: 0.150910 Mar 26 21:21:35.470451 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2648/5558] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:35 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1341 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:36.486489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:36.487234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:36.494080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:36.494516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:36.495307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:36.495769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:36.637379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:36.644849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64b57a80-de35-4f56-a8b6-280acb4b6015 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1341 microversion: 2.1 time: 0.162243 Mar 26 21:21:36.645429 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2911/5559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:36 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:37.661571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:37.662128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:37.669070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:37.669786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:37.670565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:37.671012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:37.805684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:37.813131 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4865c9fb-50dd-41b1-a78d-d32493c5177e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.155597 Mar 26 21:21:37.813710 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2649/5560] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:37 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:38.830321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:38.830956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:38.837942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:38.838361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:38.839142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:38.839601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:38.974890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:38.982898 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-065be2fb-6670-496d-822a-74537beeded4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.156531 Mar 26 21:21:38.983474 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2912/5561] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:38 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:39.999438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:40.000097 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:40.007621 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.008120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.008950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.009406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.144939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:40.160462 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77b7b32b-53ba-447f-b993-1010f4251152 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.164914 Mar 26 21:21:40.161680 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2650/5562] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:39 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:40.274941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:40.275520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:40.283380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.283859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.284705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.285172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.425957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:40.433432 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0367611-dfc8-4a20-9e48-19824df54d02 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1683 microversion: 2.1 time: 0.162568 Mar 26 21:21:40.434513 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2913/5563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:40 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:40.545158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:40.546000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:40.552017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.552471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.553238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.553682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.605282 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7197cb26-370f-4ae5-8cc4-3aed25836243 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action" status: 200 len: 32638 microversion: 2.1 time: 0.064232 Mar 26 21:21:40.606464 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2651/5564] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:21:40 2022] POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:21:40.960005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:40.960644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:40.967448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.967955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:40.968752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:40.969215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:41.103306 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0eb722b4-b46d-4486-b3e3-20efb23a9a4b tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1834 microversion: 2.1 time: 0.259230 Mar 26 21:21:41.103973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2914/5565] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:40 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1834 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:41.120852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:41.122073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:41.130053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:41.130595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:41.131387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:41.131820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:41.178319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:41.178953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:41.185104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:41.185632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:41.186361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:41.186862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:41.227063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lazy-loading 'flavor' on Instance uuid de346557-be6e-46c7-94fd-7e64c0983060 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:21:41.240685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Going to try to live migrate instance to another host {{(pid=141580) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 26 21:21:41.342709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:41.350514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69d1a132-e451-40e2-9d9d-fede3a7a9f51 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.176225 Mar 26 21:21:41.351091 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2915/5566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:41 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:42.368213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:42.368835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:42.375775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:42.376302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:42.377108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:42.377571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:42.482085 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-00475d41-212d-4120-8ae7-b53a875cc264 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action" status: 202 len: 0 microversion: 2.1 time: 1.365194 Mar 26 21:21:42.482850 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2652/5567] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:21:41 2022] POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:21:42.491044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:42.491761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:42.500499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:42.501055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:42.501926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:42.502416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:42.518954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:42.527374 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4041ba57-09eb-438f-b061-0e13d84885ea tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.163013 Mar 26 21:21:42.528704 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2916/5568] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:42 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:42.689769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:42.697169 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d31975ad-038b-481b-b887-7c3af710a7cd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.210149 Mar 26 21:21:42.697746 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2653/5569] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:42 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:43.545785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:43.546799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:43.553559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.554037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.554837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.555307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.572961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e3b45ca8-2873-465a-9b46-3c5fde9c3e43 req-42e5fd08-3d2e-4204-bb6f-70f6aeb46683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "name": "network-vif-unplugged", "status": "completed", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:43.583524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e3b45ca8-2873-465a-9b46-3c5fde9c3e43 req-42e5fd08-3d2e-4204-bb6f-70f6aeb46683 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.584137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e3b45ca8-2873-465a-9b46-3c5fde9c3e43 req-42e5fd08-3d2e-4204-bb6f-70f6aeb46683 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.601334 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e3b45ca8-2873-465a-9b46-3c5fde9c3e43 req-42e5fd08-3d2e-4204-bb6f-70f6aeb46683 service nova] Creating event network-vif-unplugged:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:43.607420 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e3b45ca8-2873-465a-9b46-3c5fde9c3e43 req-42e5fd08-3d2e-4204-bb6f-70f6aeb46683 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038830 Mar 26 21:21:43.608722 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2654/5570] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:43.714879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:43.716281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:43.716987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:43.724091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.724773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.725722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.726461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.730377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2ec795ce-74f4-4dd5-943b-5e23cc790238 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.189159 Mar 26 21:21:43.743553 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2917/5571] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:43 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:43.885629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8fde43b3-db03-498a-9161-a2c88be87d76 req-90a65db5-a95e-46be-a06f-70a46d3cb1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097010f7-9ecf-4055-9bbd-82e9b5b6428a", "name": "network-vif-plugged", "status": "completed", "tag": "f7606cd0-7797-46c7-a951-3b87fcee2f57"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:43.900570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8fde43b3-db03-498a-9161-a2c88be87d76 req-90a65db5-a95e-46be-a06f-70a46d3cb1e8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:43.901718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8fde43b3-db03-498a-9161-a2c88be87d76 req-90a65db5-a95e-46be-a06f-70a46d3cb1e8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:43.914431 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8fde43b3-db03-498a-9161-a2c88be87d76 req-90a65db5-a95e-46be-a06f-70a46d3cb1e8 service nova] Creating event network-vif-plugged:f7606cd0-7797-46c7-a951-3b87fcee2f57 for instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a on nch1-master-1 Mar 26 21:21:43.920235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8fde43b3-db03-498a-9161-a2c88be87d76 req-90a65db5-a95e-46be-a06f-70a46d3cb1e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039990 Mar 26 21:21:43.921237 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2918/5572] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:44.041312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:44.054412 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4eb43723-244e-4628-9afc-a6286418880d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.342839 Mar 26 21:21:44.066762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2655/5573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:43 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:44.751346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:44.752024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:44.759375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:44.759859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:44.760678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:44.761147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:44.894609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:44.902112 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d2bb44b-2a3b-4de5-9076-b29e6eaccec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1375 microversion: 2.1 time: 0.155608 Mar 26 21:21:44.902696 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2919/5574] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:44 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:45.072688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:45.073303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:45.080930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.081411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.082199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.082650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.220641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:45.228136 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-10f8e57c-50ee-4cdb-a892-0f8c0c33ac8c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.159261 Mar 26 21:21:45.228719 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2656/5575] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:45 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:45.635376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-05b5e5d7-0fad-47b8-8841-1849549a3a6b req-94e0bbcc-8508-4ace-9fec-25d3d8a0bb23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:45.643304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05b5e5d7-0fad-47b8-8841-1849549a3a6b req-94e0bbcc-8508-4ace-9fec-25d3d8a0bb23 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.643767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-05b5e5d7-0fad-47b8-8841-1849549a3a6b req-94e0bbcc-8508-4ace-9fec-25d3d8a0bb23 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.654906 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-05b5e5d7-0fad-47b8-8841-1849549a3a6b req-94e0bbcc-8508-4ace-9fec-25d3d8a0bb23 service nova] Creating event network-changed:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:45.660176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-05b5e5d7-0fad-47b8-8841-1849549a3a6b req-94e0bbcc-8508-4ace-9fec-25d3d8a0bb23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028417 Mar 26 21:21:45.660772 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2920/5576] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:45.919591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:45.920303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:45.926556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.927014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.927805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.928784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.943415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fdc1b0f0-4927-4011-833c-dbcd1b753ba3 req-0b308ce9-022d-4823-9edb-6ce8cd3f60b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "name": "network-vif-plugged", "status": "completed", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:45.955596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fdc1b0f0-4927-4011-833c-dbcd1b753ba3 req-0b308ce9-022d-4823-9edb-6ce8cd3f60b7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:45.956235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fdc1b0f0-4927-4011-833c-dbcd1b753ba3 req-0b308ce9-022d-4823-9edb-6ce8cd3f60b7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:45.971715 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fdc1b0f0-4927-4011-833c-dbcd1b753ba3 req-0b308ce9-022d-4823-9edb-6ce8cd3f60b7 service nova] Creating event network-vif-plugged:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:45.977625 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fdc1b0f0-4927-4011-833c-dbcd1b753ba3 req-0b308ce9-022d-4823-9edb-6ce8cd3f60b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038970 Mar 26 21:21:45.978561 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2921/5577] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:21:46.081865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:46.089828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d561b6ee-79c1-4b13-9b84-c5ebb789d105 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1562 microversion: 2.1 time: 0.174957 Mar 26 21:21:46.090994 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2657/5578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:45 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:46.107404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:46.108165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:46.114606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.115076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.115875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.116424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.246203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:46.247624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:46.253779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.254437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.255409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.256040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.382976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:46.391061 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7ebf76a-db34-48e1-8329-80d65fe03519 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1562 microversion: 2.1 time: 0.288028 Mar 26 21:21:46.391643 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2922/5579] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:46 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1562 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:46.392298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:46.400952 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cb70f695-7fb4-4acf-bd25-58b163df333b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.159005 Mar 26 21:21:46.410631 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2658/5580] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:46 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:46.467295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:46.467784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:46.473669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.474143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.474940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.475402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.500518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:21:46.575342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d31f6dae-d093-44b3-8798-7136d986ec83 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 204 len: 0 microversion: 2.1 time: 0.111306 Mar 26 21:21:46.575972 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2923/5581] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:21:46 2022] DELETE /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:21:46.584258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:46.584880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:46.591262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.591974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.593249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:46.593703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:46.732028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:46.739448 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8eceeb07-07e5-46f0-a9fb-4688d3fca437 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1568 microversion: 2.1 time: 0.159175 Mar 26 21:21:46.740067 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2659/5582] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:46 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:47.418706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:47.419624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:47.426453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:47.426931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:47.427724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:47.428216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:47.562485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:47.570069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85f49e20-6337-46cb-be41-57401e33ecf2 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.155775 Mar 26 21:21:47.570647 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2924/5583] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:47 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:47.757089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:47.757707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:47.765183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:47.765643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:47.766417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:47.766865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:47.899484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:47.906951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02855f49-1e6b-4d63-a352-42f59105fb41 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1568 microversion: 2.1 time: 0.153827 Mar 26 21:21:47.907523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2660/5584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:47 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:48.588168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:48.588814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:48.596634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:48.597486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:48.598306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:48.598778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:48.850987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:48.861700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f1952f37-1705-4c50-972e-2f520a4d61b7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.277655 Mar 26 21:21:48.876376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2925/5585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:48 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:48.917522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b4ef6480-578f-49ca-ada3-d6fc61b1c278 req-a58b57a5-6577-4ab1-b809-548f36edd314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097010f7-9ecf-4055-9bbd-82e9b5b6428a", "name": "network-vif-deleted", "tag": "f7606cd0-7797-46c7-a951-3b87fcee2f57"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:48.925919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:48.927015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:48.941169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:48.941750 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:48.942927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:48.943629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:48.945264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b4ef6480-578f-49ca-ada3-d6fc61b1c278 req-a58b57a5-6577-4ab1-b809-548f36edd314 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:48.945783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b4ef6480-578f-49ca-ada3-d6fc61b1c278 req-a58b57a5-6577-4ab1-b809-548f36edd314 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:48.962893 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b4ef6480-578f-49ca-ada3-d6fc61b1c278 req-a58b57a5-6577-4ab1-b809-548f36edd314 service nova] Creating event network-vif-deleted:f7606cd0-7797-46c7-a951-3b87fcee2f57 for instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a on nch1-master-1 Mar 26 21:21:48.969596 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b4ef6480-578f-49ca-ada3-d6fc61b1c278 req-a58b57a5-6577-4ab1-b809-548f36edd314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055814 Mar 26 21:21:48.970955 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2661/5586] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:49.037336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:49.045883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11f8e3fe-cc25-4d06-89ca-3085a7359222 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 200 len: 1360 microversion: 2.1 time: 0.125242 Mar 26 21:21:49.046569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2926/5587] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:48 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 1360 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:49.880739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:49.881629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:49.887844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:49.888417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:49.889209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:49.889666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:50.033191 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:50.041603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-886032ad-dde0-4a31-9223-1844050fbfdb tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.165353 Mar 26 21:21:50.042184 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2662/5588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:49 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:50.062628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:50.063558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:50.070967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:50.071444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:50.072272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:50.072732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:50.088908 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. Mar 26 21:21:50.089529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:21:50.090912 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d762db90-cfbb-47dc-bb88-3ea52dcdd992 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 404 len: 111 microversion: 2.1 time: 0.032341 Mar 26 21:21:50.091471 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2927/5589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:50 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:21:50.984479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a209ecc6-23a8-4bb8-96b0-8b05e66e78c7 req-84ce471c-4d44-4162-996b-f7e01b91eb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "name": "network-vif-unplugged", "status": "completed", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:50.994293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a209ecc6-23a8-4bb8-96b0-8b05e66e78c7 req-84ce471c-4d44-4162-996b-f7e01b91eb7d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:50.994763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a209ecc6-23a8-4bb8-96b0-8b05e66e78c7 req-84ce471c-4d44-4162-996b-f7e01b91eb7d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:51.007443 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a209ecc6-23a8-4bb8-96b0-8b05e66e78c7 req-84ce471c-4d44-4162-996b-f7e01b91eb7d service nova] Creating event network-vif-unplugged:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch1-master-1 Mar 26 21:21:51.013289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a209ecc6-23a8-4bb8-96b0-8b05e66e78c7 req-84ce471c-4d44-4162-996b-f7e01b91eb7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032415 Mar 26 21:21:51.013962 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2663/5590] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:51.060638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:51.061421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:51.068260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:51.068914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:51.069541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:51.070011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:51.263689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:51.271241 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4bb6f74f-80d3-4633-9e8f-0fb89f0bb2c4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1693 microversion: 2.1 time: 0.215287 Mar 26 21:21:51.271834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2928/5591] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:51 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:52.292112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:52.292824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:52.299512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.300004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.300782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.301230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.442017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:52.450820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5aa11693-3a4a-4a8b-89d5-88dd0109e473 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1683 microversion: 2.1 time: 0.163877 Mar 26 21:21:52.451386 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2664/5592] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:52 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:52.467382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:52.468301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:52.475906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.475906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.476839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.477302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.617930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3479ae09-698a-436d-9665-3557d2aeea71 tempest-TestNetworkAdvancedServerOps-812976424 tempest-TestNetworkAdvancedServerOps-812976424-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1834 microversion: 2.1 time: 0.154436 Mar 26 21:21:52.618504 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2929/5593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:52 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1834 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:52.634547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:52.635162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:52.641184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.641641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.642631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.643078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.781253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:52.789775 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bab786aa-e11d-4a54-abe1-20e857342442 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1683 microversion: 2.1 time: 0.159163 Mar 26 21:21:52.790433 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2665/5594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:52 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:21:52.892432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:52.893425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:52.900337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.900810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.901597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:52.902052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:52.951513 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3860cd47-7754-4299-a328-7995662afeb4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action" status: 200 len: 38512 microversion: 2.1 time: 0.062909 Mar 26 21:21:52.952629 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2930/5595] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:21:52 2022] POST /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060/action => generated 38512 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:21:54.224150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:54.224642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:54.233928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ce1c1d4a-da28-47b1-8fc4-0215dbb9bb97 req-be9c8c6b-c034-416e-9d23-8c240b23cc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:54.242695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:54.243160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:54.243976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:54.244428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:54.245127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ce1c1d4a-da28-47b1-8fc4-0215dbb9bb97 req-be9c8c6b-c034-416e-9d23-8c240b23cc6f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:54.245723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ce1c1d4a-da28-47b1-8fc4-0215dbb9bb97 req-be9c8c6b-c034-416e-9d23-8c240b23cc6f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:54.257854 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ce1c1d4a-da28-47b1-8fc4-0215dbb9bb97 req-be9c8c6b-c034-416e-9d23-8c240b23cc6f service nova] Creating event network-changed:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch2-master-1 Mar 26 21:21:54.263345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ce1c1d4a-da28-47b1-8fc4-0215dbb9bb97 req-be9c8c6b-c034-416e-9d23-8c240b23cc6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033940 Mar 26 21:21:54.264491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2931/5596] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:54.274831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:21:54.369421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b869a0bf-5ed4-4dff-a899-1f169ed252b1 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 204 len: 0 microversion: 2.1 time: 0.149194 Mar 26 21:21:54.370301 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2666/5597] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:21:54 2022] DELETE /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:21:54.380398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:54.381263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:54.388156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:54.388765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:54.389669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:54.390317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:54.548457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:21:54.557007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8afcc3c0-c23b-4a70-a10b-366f88e9b9d0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 200 len: 1689 microversion: 2.1 time: 0.181494 Mar 26 21:21:54.557954 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2932/5598] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:54 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:21:55.352342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ed090a84-ccfa-409e-9648-f84d6560ebf2 req-7200265a-8e14-410f-a638-69a5a7f28144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de346557-be6e-46c7-94fd-7e64c0983060", "name": "network-vif-deleted", "tag": "870e9f5f-5fba-4e76-945e-fd9962d128d3"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:55.368323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ed090a84-ccfa-409e-9648-f84d6560ebf2 req-7200265a-8e14-410f-a638-69a5a7f28144 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:55.369676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ed090a84-ccfa-409e-9648-f84d6560ebf2 req-7200265a-8e14-410f-a638-69a5a7f28144 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:55.390327 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ed090a84-ccfa-409e-9648-f84d6560ebf2 req-7200265a-8e14-410f-a638-69a5a7f28144 service nova] Creating event network-vif-deleted:870e9f5f-5fba-4e76-945e-fd9962d128d3 for instance de346557-be6e-46c7-94fd-7e64c0983060 on nch2-master-1 Mar 26 21:21:55.398243 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ed090a84-ccfa-409e-9648-f84d6560ebf2 req-7200265a-8e14-410f-a638-69a5a7f28144 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050268 Mar 26 21:21:55.399175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2667/5599] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:21:55.577287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:55.577997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: de346557-be6e-46c7-94fd-7e64c0983060] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:21:55.586235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:55.587134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:55.588313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:21:55.589178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:21:55.608380 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] HTTP exception thrown: Instance de346557-be6e-46c7-94fd-7e64c0983060 could not be found. Mar 26 21:21:55.609212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Returning 404 to user: Instance de346557-be6e-46c7-94fd-7e64c0983060 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:21:55.610328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d6273e4d-94ac-4208-9099-f03ffcc7271b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060" status: 404 len: 111 microversion: 2.1 time: 0.039044 Mar 26 21:21:55.610875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2933/5600] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:21:55 2022] GET /compute/v2.1/servers/de346557-be6e-46c7-94fd-7e64c0983060 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:21:59.102901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca266ad5-dad0-4fe8-81d7-b5955baa57f4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '.version_select at 0x7f6e586663a0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:21:59.130588 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca266ad5-dad0-4fe8-81d7-b5955baa57f4 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804487334" status: 202 len: 0 microversion: 2.1 time: 0.034291 Mar 26 21:21:59.131670 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2668/5601] 10.222.0.16 () {58 vars in 1283 bytes} [Sat Mar 26 21:21:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804487334 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:21:59.163648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: .version_select at 0x7f6e595acf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1183311719"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:21:59.187298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:21:59.193375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:21:59.371892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:21:59.377589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:21:59.394326 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bc7e9e41-6681-4ec6-a865-ccd8bdb2eb99 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.235006 Mar 26 21:21:59.394941 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2934/5602] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:21:59 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:05.685619 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1567988623", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "8d19480d-396b-42d7-aba1-8968f1adc286"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1183311719", "security_groups": [{"name": "tempest-secgroup-smoke-1257154972"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:05.845349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] validate_networks() for [('8d19480d-396b-42d7-aba1-8968f1adc286', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:22:06.375872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:22:06.376352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:22:06.376834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:22:06.377318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:22:06.377814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:22:06.389165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:06.389909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:06.390970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:06.391657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:06.413948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:22:06.420757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Getting quotas for user 2ce0a0696d1244589ef6242917432858 and project 39045df80a6f442b972ee88f13343d34. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:22:06.443007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:22:06.447068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:22:06.522049 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab6fd80b-598c-4d36-9b57-001f0a04ef4a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841212 Mar 26 21:22:06.524475 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2669/5603] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:22:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:22:06.536154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f1c8dcbd-56f7-41ba-9297-4450569bb5ea tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:06.536969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f1c8dcbd-56f7-41ba-9297-4450569bb5ea tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:06.672091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f1c8dcbd-56f7-41ba-9297-4450569bb5ea tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:06.683195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f1c8dcbd-56f7-41ba-9297-4450569bb5ea tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1267 microversion: 2.1 time: 0.151435 Mar 26 21:22:06.684354 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2935/5604] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:06 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:07.702176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:07.702827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:07.712941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:07.713939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:07.715007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:07.715800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:07.820187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:07.828154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-332a3763-10c9-45e9-b04a-f404a117dbfa tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1319 microversion: 2.1 time: 0.131114 Mar 26 21:22:07.828729 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2670/5605] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:07 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1319 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:08.847148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:08.848412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:08.858319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:08.859070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:08.859887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:08.860383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:09.257618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:09.266250 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9da38ad2-cbcf-4645-ace0-006e7504f308 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.423648 Mar 26 21:22:09.267038 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2936/5606] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:08 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:22:09.696941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-38461069-7a32-4f6c-9fe5-858d0f27b6dc req-34e6e8a0-dffe-48b0-83df-5c447a16a461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:09.716110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-38461069-7a32-4f6c-9fe5-858d0f27b6dc req-34e6e8a0-dffe-48b0-83df-5c447a16a461 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:09.716599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-38461069-7a32-4f6c-9fe5-858d0f27b6dc req-34e6e8a0-dffe-48b0-83df-5c447a16a461 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:09.735567 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-38461069-7a32-4f6c-9fe5-858d0f27b6dc req-34e6e8a0-dffe-48b0-83df-5c447a16a461 service nova] Creating event network-changed:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:22:09.741631 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-38461069-7a32-4f6c-9fe5-858d0f27b6dc req-34e6e8a0-dffe-48b0-83df-5c447a16a461 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054976 Mar 26 21:22:09.742667 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2671/5607] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:10.283177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:10.284416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:10.291070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:10.291505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:10.292409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:10.292851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:10.579153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:10.587904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-964bc2c1-943a-4e15-b418-be784a689f0a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.308942 Mar 26 21:22:10.588753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2937/5608] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:10 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:11.606588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:11.607322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:11.615818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:11.616409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:11.617481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:11.618089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:11.766318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:11.774236 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b3a78a4-f29c-465e-bb7e-3a58a2e7bf22 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.171994 Mar 26 21:22:11.774825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2672/5609] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:11 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:12.792475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:12.793106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:12.800642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:12.801117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:12.801904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:12.802365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:12.948227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:12.957016 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-92133c9d-d213-4101-a731-af4d1936a103 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.168504 Mar 26 21:22:12.958226 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2938/5610] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:12 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:13.975159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:13.975786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:13.984443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:13.984869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:13.985737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:13.986261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:14.127313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:14.134609 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5d78b819-cfa8-41f7-959e-facae8c41bd7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.163848 Mar 26 21:22:14.135207 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2673/5611] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:13 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:15.152080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:15.153334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:15.160151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:15.160622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:15.161404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:15.161859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:15.300449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:15.307767 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c9961ad-9a41-40e9-853f-3fc13c8d4f2d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.159635 Mar 26 21:22:15.308376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2939/5612] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:15 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:15.972327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-782ccd06-a9b6-4610-8803-15cb44640255 req-fac45980-35eb-4d07-8617-d524c41e73f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "name": "network-vif-plugged", "status": "completed", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:15.981421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-782ccd06-a9b6-4610-8803-15cb44640255 req-fac45980-35eb-4d07-8617-d524c41e73f3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:15.981877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-782ccd06-a9b6-4610-8803-15cb44640255 req-fac45980-35eb-4d07-8617-d524c41e73f3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:15.994884 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-782ccd06-a9b6-4610-8803-15cb44640255 req-fac45980-35eb-4d07-8617-d524c41e73f3 service nova] Creating event network-vif-plugged:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:22:16.000889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-782ccd06-a9b6-4610-8803-15cb44640255 req-fac45980-35eb-4d07-8617-d524c41e73f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032274 Mar 26 21:22:16.001699 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2674/5613] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:16.324825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:16.325379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:16.332265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:16.332742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:16.333570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:16.334033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:16.471498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:16.479213 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc249894-ab2d-4566-adc6-ce1c5a8a0556 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1393 microversion: 2.1 time: 0.158428 Mar 26 21:22:16.479798 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2940/5614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:16 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:17.496775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:17.497477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:17.504833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:17.505407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:17.506323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:17.506832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:17.644997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:17.652400 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96b8d69f-75b7-4c23-b034-e3f1031974f6 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1564 microversion: 2.1 time: 0.159909 Mar 26 21:22:17.653487 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2675/5615] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:17 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:17.669819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:17.670451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:17.677191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:17.677672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:17.678466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:17.678931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:17.812574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:17.819944 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0af7e285-98f2-40e5-b787-26d13e18fc70 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1564 microversion: 2.1 time: 0.154923 Mar 26 21:22:17.820519 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2941/5616] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:17 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:19.803959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:19.803959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:19.808137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3dc91168-f949-464a-ba82-948d6c20400b req-0b05f43d-f138-4b07-b791-512dc0164f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:19.810836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:19.812884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:19.814074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:19.814825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:19.817633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3dc91168-f949-464a-ba82-948d6c20400b req-0b05f43d-f138-4b07-b791-512dc0164f92 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:19.818149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3dc91168-f949-464a-ba82-948d6c20400b req-0b05f43d-f138-4b07-b791-512dc0164f92 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:19.831577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3dc91168-f949-464a-ba82-948d6c20400b req-0b05f43d-f138-4b07-b791-512dc0164f92 service nova] Creating event network-changed:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:22:19.842030 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3dc91168-f949-464a-ba82-948d6c20400b req-0b05f43d-f138-4b07-b791-512dc0164f92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042855 Mar 26 21:22:19.842893 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2942/5617] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:19.976937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:19.986638 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a2abba0c-c565-4579-b33e-bc93773eb67a tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1564 microversion: 2.1 time: 0.189427 Mar 26 21:22:19.987791 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2676/5618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:19 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:21.166755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:21.167630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:21.175653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:21.176159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:21.177176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:21.177783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:21.207513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:22:21.292145 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d0a66c3a-f737-4fce-ad67-b111f489339e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 204 len: 0 microversion: 2.1 time: 0.130039 Mar 26 21:22:21.292714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2943/5619] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:22:21 2022] DELETE /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:22:21.302386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:21.303010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:21.311133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:21.311599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:21.312455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:21.312913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:21.465887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:21.473532 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6692fdb-1bc0-4dae-a85e-513c4d9f21e0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1409 microversion: 2.1 time: 0.175522 Mar 26 21:22:21.474332 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2677/5620] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:21 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1409 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:22:22.491355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:22.492112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:22.498921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:22.499401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:22.500214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:22.500674 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:22.634434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:22.643564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8c75da5-8b0b-4f92-b21f-4d2fd8103735 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1409 microversion: 2.1 time: 0.156576 Mar 26 21:22:22.644217 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2944/5621] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:22 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:23.397853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-966b487e-9a0d-4d19-98c4-32cb8dcf108f req-6cc60a0d-6b95-42e5-9585-a7385b1715db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966b1c71-ea56-4e76-ac0b-7178592bf3cd", "name": "network-vif-deleted", "tag": "4da0d94e-acad-408d-a0ea-93c2360988ea"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:23.407638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-966b487e-9a0d-4d19-98c4-32cb8dcf108f req-6cc60a0d-6b95-42e5-9585-a7385b1715db service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:23.408133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-966b487e-9a0d-4d19-98c4-32cb8dcf108f req-6cc60a0d-6b95-42e5-9585-a7385b1715db service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:23.420899 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-966b487e-9a0d-4d19-98c4-32cb8dcf108f req-6cc60a0d-6b95-42e5-9585-a7385b1715db service nova] Creating event network-vif-deleted:4da0d94e-acad-408d-a0ea-93c2360988ea for instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd on nch2-master-1 Mar 26 21:22:23.425700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-966b487e-9a0d-4d19-98c4-32cb8dcf108f req-6cc60a0d-6b95-42e5-9585-a7385b1715db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031537 Mar 26 21:22:23.426294 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2678/5622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:23.662007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:23.663416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:23.675513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:23.676048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:23.677170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:23.677717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:23.712732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:23.713206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:23.713686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lazy-loading 'fault' on Instance uuid 966b1c71-ea56-4e76-ac0b-7178592bf3cd {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:22:23.758712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:23.767475 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-66a8dcb0-3bb5-4ad3-914b-90259370af26 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 200 len: 1207 microversion: 2.1 time: 0.110185 Mar 26 21:22:23.777181 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2945/5623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:23 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 1207 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:24.786037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:24.786780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:24.793330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:24.793818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:24.795098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:24.795534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:24.808686 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. Mar 26 21:22:24.809284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:22:24.810771 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40609d49-0b3d-464f-9831-517bdae32594 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 404 len: 111 microversion: 2.1 time: 0.029968 Mar 26 21:22:24.811311 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2679/5624] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:24 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:25.895332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:25.895869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:25.902846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:25.903322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:25.904184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:25.904642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:25.918258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. Mar 26 21:22:25.918904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:22:25.919760 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8279ad7b-a523-41a9-ac0e-bc0b1b8aa44b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 404 len: 111 microversion: 2.1 time: 0.028450 Mar 26 21:22:25.920337 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2946/5625] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:22:25 2022] DELETE /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:25.928591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:25.929241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 097010f7-9ecf-4055-9bbd-82e9b5b6428a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:25.937082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:25.937538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:25.938312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:25.938765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:25.952063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. Mar 26 21:22:25.952649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 097010f7-9ecf-4055-9bbd-82e9b5b6428a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:22:25.953461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-078284c4-3039-4d5a-ac05-eaf0ef1ae3a1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a" status: 404 len: 111 microversion: 2.1 time: 0.028860 Mar 26 21:22:25.953978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2680/5626] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:25 2022] GET /compute/v2.1/servers/097010f7-9ecf-4055-9bbd-82e9b5b6428a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:26.308315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:26.308829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:26.315393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:26.315862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:26.316683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:26.317136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:26.330472 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. Mar 26 21:22:26.331073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:22:26.331944 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-63f29317-b5a7-4087-9e22-8a06e4d9f7f3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 404 len: 111 microversion: 2.1 time: 0.027652 Mar 26 21:22:26.332497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2947/5627] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:22:26 2022] DELETE /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:26.341434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:26.342086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 966b1c71-ea56-4e76-ac0b-7178592bf3cd] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:26.349306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:26.349763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:26.350537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:26.350981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:26.366850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. Mar 26 21:22:26.367443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 966b1c71-ea56-4e76-ac0b-7178592bf3cd could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:22:26.368309 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-716cddd0-4ae4-493c-b222-57d544564afb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd" status: 404 len: 111 microversion: 2.1 time: 0.031549 Mar 26 21:22:26.368839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2681/5628] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:26 2022] GET /compute/v2.1/servers/966b1c71-ea56-4e76-ac0b-7178592bf3cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:26.431774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: .version_select at 0x7f6e4bff5a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-343139743"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:26.445683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:22:26.450839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:22:26.528734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:22:26.533762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:22:26.549125 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-016cfaee-7fba-439d-9c60-55d4f4455dd1 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.121303 Mar 26 21:22:26.549730 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2948/5629] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:22:26 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:27.817114 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:22:27.817797 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:22:29.954437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1853738282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343139743", "security_groups": [{"name": "tempest-secgroup-smoke-1244663080"}], "block_device_mapping_v2": [{"uuid": "44eb25a7-2179-422f-a764-436f790469c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:30.066037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:22:30.428208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:22:30.428667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:22:30.429143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:22:30.429555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:22:30.429970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:22:30.439202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:30.439660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:30.440492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:30.440932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:30.457042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:22:30.462194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:22:30.518204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:22:30.520335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44eb25a7-2179-422f-a764-436f790469c5',volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:22:30.643259 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-14cfb66c-d955-41c1-b0df-0f2b2694541d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693312 Mar 26 21:22:30.644182 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2682/5630] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:22:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:22:30.654178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-32878c9e-9428-4e7f-b18a-1099d8f92678 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:30.654806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-32878c9e-9428-4e7f-b18a-1099d8f92678 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:30.710921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-32878c9e-9428-4e7f-b18a-1099d8f92678 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:30.717522 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-32878c9e-9428-4e7f-b18a-1099d8f92678 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1094 microversion: 2.1 time: 0.067521 Mar 26 21:22:30.718106 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2949/5631] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:30 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:31.735255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:31.735858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:31.742708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:31.743389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:31.744415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:31.745047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:31.816925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:31.828620 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fecb7cc9-24b0-4f8a-88c4-60e4b88359d2 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1210 microversion: 2.1 time: 0.097992 Mar 26 21:22:31.829821 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2683/5632] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:31 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:32.846785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:32.847488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:32.856545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:32.857025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:32.858067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:32.858679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:32.896733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ac5d2688-dbca-4ee5-b2a8-9c46d99615fe req-b50a7ec7-9a24-44cc-8a7f-33a284626518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e941d26-c67c-4ea5-a0ff-a71ba089f643", "tag": "cd08295b-fb42-421d-beb0-e607252972c8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:32.912817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac5d2688-dbca-4ee5-b2a8-9c46d99615fe req-b50a7ec7-9a24-44cc-8a7f-33a284626518 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:32.915284 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac5d2688-dbca-4ee5-b2a8-9c46d99615fe req-b50a7ec7-9a24-44cc-8a7f-33a284626518 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:32.928406 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ac5d2688-dbca-4ee5-b2a8-9c46d99615fe req-b50a7ec7-9a24-44cc-8a7f-33a284626518 service nova] Creating event network-changed:cd08295b-fb42-421d-beb0-e607252972c8 for instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 on nch2-master-1 Mar 26 21:22:32.933891 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ac5d2688-dbca-4ee5-b2a8-9c46d99615fe req-b50a7ec7-9a24-44cc-8a7f-33a284626518 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045799 Mar 26 21:22:32.934819 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2684/5633] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:33.153490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:33.161037 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-202d453d-bfca-42ef-8284-cb94edefabd0 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.319333 Mar 26 21:22:33.161591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2950/5634] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:32 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:34.178541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:34.179238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:34.186200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:34.186654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:34.187418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:34.187860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:34.324673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:34.332621 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-96c891a8-effa-420f-b441-02a9e43742d4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.158369 Mar 26 21:22:34.333194 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2685/5635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:34 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:35.350213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:35.350771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:35.358465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:35.358944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:35.359740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:35.360232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:35.497938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:35.505465 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d25e8e18-9b28-48bb-b32b-3a2fe249b2c9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.159423 Mar 26 21:22:35.506030 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2951/5636] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:35 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:36.521826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:36.522454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:36.529327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:36.529787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:36.530573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:36.531015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:36.667433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:36.675663 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-16ddca6e-3664-41c7-97f2-6089779e102e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.157776 Mar 26 21:22:36.676276 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2686/5637] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:36 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:37.691944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:37.692589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:37.699477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:37.699991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:37.701426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:37.701890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:37.833537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:37.841072 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-913084a4-f136-499b-9b09-d24be7b5761e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.153072 Mar 26 21:22:37.841652 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2952/5638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:37 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:38.566758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b08ce9db-c47b-48b6-9c2e-823bc94ea8ca req-1619aa01-cc95-4789-84ef-c07cd9fc625d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e941d26-c67c-4ea5-a0ff-a71ba089f643", "name": "network-vif-plugged", "status": "completed", "tag": "cd08295b-fb42-421d-beb0-e607252972c8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:38.575819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b08ce9db-c47b-48b6-9c2e-823bc94ea8ca req-1619aa01-cc95-4789-84ef-c07cd9fc625d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:38.576323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b08ce9db-c47b-48b6-9c2e-823bc94ea8ca req-1619aa01-cc95-4789-84ef-c07cd9fc625d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:38.587128 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b08ce9db-c47b-48b6-9c2e-823bc94ea8ca req-1619aa01-cc95-4789-84ef-c07cd9fc625d service nova] Creating event network-vif-plugged:cd08295b-fb42-421d-beb0-e607252972c8 for instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 on nch2-master-1 Mar 26 21:22:38.592598 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b08ce9db-c47b-48b6-9c2e-823bc94ea8ca req-1619aa01-cc95-4789-84ef-c07cd9fc625d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029597 Mar 26 21:22:38.593344 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2687/5639] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:38.857986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:38.858625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:38.865448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:38.865923 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:38.866715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:38.867180 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:39.005916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:39.015230 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac56d8da-d93c-4415-932f-75e891a79c3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1266 microversion: 2.1 time: 0.161202 Mar 26 21:22:39.015806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2953/5640] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:38 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:40.033974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:40.034684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:40.041154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:40.041609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:40.042376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:40.043081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:40.189891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:40.197551 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61c05acd-9f4d-4cfc-8ba9-13d60b23df3b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1452 microversion: 2.1 time: 0.169414 Mar 26 21:22:40.198127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2688/5641] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:40 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:40.213890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:40.214512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:40.221975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:40.222446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:40.223234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:40.223696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:40.357830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:40.365580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d9374ee-f54e-424e-823c-f33cf0407f62 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1452 microversion: 2.1 time: 0.155601 Mar 26 21:22:40.366158 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2954/5642] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:40 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:42.355541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4eadee4c-fddf-4542-beb3-fcaf9e7694fe req-dc2d327f-6eaf-4927-b2a9-14dd9949c793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e941d26-c67c-4ea5-a0ff-a71ba089f643", "tag": "cd08295b-fb42-421d-beb0-e607252972c8"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:42.364736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4eadee4c-fddf-4542-beb3-fcaf9e7694fe req-dc2d327f-6eaf-4927-b2a9-14dd9949c793 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:42.365183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4eadee4c-fddf-4542-beb3-fcaf9e7694fe req-dc2d327f-6eaf-4927-b2a9-14dd9949c793 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:42.379154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4eadee4c-fddf-4542-beb3-fcaf9e7694fe req-dc2d327f-6eaf-4927-b2a9-14dd9949c793 service nova] Creating event network-changed:cd08295b-fb42-421d-beb0-e607252972c8 for instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 on nch2-master-1 Mar 26 21:22:42.384734 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4eadee4c-fddf-4542-beb3-fcaf9e7694fe req-dc2d327f-6eaf-4927-b2a9-14dd9949c793 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032556 Mar 26 21:22:42.385530 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2689/5643] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:22:45.272289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:45.273297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:45.280384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:45.280804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:45.281600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:45.282062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:45.336358 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1145da1-4273-4fd9-9886-a1a1e0a35625 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action" status: 200 len: 24568 microversion: 2.1 time: 0.068096 Mar 26 21:22:45.336986 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2955/5644] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:22:45 2022] POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action => generated 24568 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 21:22:56.462531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:22:56.464091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:56.471289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.471751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.472557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.473001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.549047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:22:56.549480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:22:56.549965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:22:56.550389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:22:56.550819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:22:56.610984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:56.616951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.617415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.618200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.618668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.650850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7aba729f-65a2-4127-a67f-4b49bd1cd48b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action" status: 202 len: 1137 microversion: 2.1 time: 0.192910 Mar 26 21:22:56.651508 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2690/5645] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:22:56 2022] POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action => generated 1137 bytes in 195 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 26 21:22:56.667509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:56.668258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:56.676095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.676572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.677370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:56.677830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:56.827816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:56.835850 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4ede7ef-094b-453c-b3df-0dfa86e432bd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.173198 Mar 26 21:22:56.836456 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2956/5646] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:56 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:57.853855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:57.854477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:57.861927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:57.862390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:57.863187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:57.863623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:58.010267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:58.018755 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-949e1996-1648-4550-840e-e3ccf288ac3b tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.168797 Mar 26 21:22:58.028344 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2691/5647] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:57 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:22:59.036725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:22:59.037361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:22:59.045290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:59.045767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:59.046558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:22:59.047027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:22:59.187350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:22:59.201782 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4c05e1d9-6ab0-4e5d-b835-de2c7f0af65d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.168581 Mar 26 21:22:59.202948 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2957/5648] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:22:59 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:00.225445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:00.226222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:00.234095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:00.234669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:00.235565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:00.236357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:00.382832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:00.390405 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-992e98b3-8480-4798-9b9e-bbf66cd43cab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.169100 Mar 26 21:23:00.391031 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2692/5649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:00 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:01.408428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:01.409080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:01.416617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:01.417345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:01.418138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:01.418600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:01.571867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:01.579776 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-713aab62-6a83-4f5b-a84b-94fce02dde2f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.175800 Mar 26 21:23:01.580459 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2958/5650] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:01 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:02.597200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:02.597809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:02.604667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:02.605123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:02.605894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:02.606334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:02.743465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:02.751654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2a84b60-06f5-4ee0-86f3-958c729647cf tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.157769 Mar 26 21:23:02.752278 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2693/5651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:02 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:03.769212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:03.769917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:03.776805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:03.777285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:03.778088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:03.778566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:03.934742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:03.942982 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-840fd360-5afa-491e-bfa4-6a4f74ae01af tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.178539 Mar 26 21:23:03.943565 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2959/5652] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:03 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:04.960107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:04.960705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:04.967643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:04.968173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:04.969035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:04.969599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:05.114005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:05.122750 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-492b1984-6561-4174-84c5-c48fe1aa7aab tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.166483 Mar 26 21:23:05.123399 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2694/5653] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:04 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:06.142888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:06.143610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:06.150995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:06.151491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:06.155013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:06.155013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:06.308832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:06.317978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1a2eb22-717c-45d1-b20c-d82743c0173f tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.180364 Mar 26 21:23:06.318597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2960/5654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:06 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:07.336824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:07.337428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:07.344416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:07.344880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:07.346314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:07.346761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:07.484159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:07.491624 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a516267-4a06-4d7b-b3cf-c573986254d7 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.158795 Mar 26 21:23:07.492247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2695/5655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:07 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:08.510241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:08.510913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:08.517811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:08.518296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:08.519095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:08.519563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:08.658965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:08.666436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e18e5062-9292-44f6-81d7-99695da87560 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1692 microversion: 2.1 time: 0.160182 Mar 26 21:23:08.667296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2961/5656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:08 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:09.684398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:09.685112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:09.692955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:09.693930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:09.694828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:09.695319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:09.850787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:09.859083 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f3a5384-fb28-43e1-874f-b016232798c5 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1698 microversion: 2.1 time: 0.178849 Mar 26 21:23:09.859731 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2696/5657] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:09 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:10.878853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:10.879597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:10.888269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:10.888773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:10.889727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:10.890377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:11.049537 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:11.057422 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8ae303bd-2a66-4fb9-9e78-d96803031093 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1698 microversion: 2.1 time: 0.182563 Mar 26 21:23:11.058015 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2962/5658] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:10 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:12.074807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:12.075455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:12.082840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:12.083372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:12.084185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:12.084642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:12.176928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-95e95a9d-3ab0-4755-b281-04d9d0b70d29 req-cfb69a80-343b-41cc-bf58-1a7f5c6d3bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "name": "network-vif-unplugged", "status": "completed", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:23:12.187435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-95e95a9d-3ab0-4755-b281-04d9d0b70d29 req-cfb69a80-343b-41cc-bf58-1a7f5c6d3bdc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:12.188020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-95e95a9d-3ab0-4755-b281-04d9d0b70d29 req-cfb69a80-343b-41cc-bf58-1a7f5c6d3bdc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:12.201748 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-95e95a9d-3ab0-4755-b281-04d9d0b70d29 req-cfb69a80-343b-41cc-bf58-1a7f5c6d3bdc service nova] Creating event network-vif-unplugged:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:23:12.207630 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-95e95a9d-3ab0-4755-b281-04d9d0b70d29 req-cfb69a80-343b-41cc-bf58-1a7f5c6d3bdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034912 Mar 26 21:23:12.208618 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2963/5659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:23:12.229176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:12.241082 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-39d63c0f-bbeb-42fb-9171-10dda9928166 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1683 microversion: 2.1 time: 0.170257 Mar 26 21:23:12.252622 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2697/5660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:12 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:23:14.227783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-aaaac74b-2e2e-4a24-b354-041b90dfdce9 req-b3147dfc-508a-4d51-861c-4fbb7100e794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "name": "network-vif-plugged", "status": "completed", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:23:14.237233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aaaac74b-2e2e-4a24-b354-041b90dfdce9 req-b3147dfc-508a-4d51-861c-4fbb7100e794 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:14.237977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-aaaac74b-2e2e-4a24-b354-041b90dfdce9 req-b3147dfc-508a-4d51-861c-4fbb7100e794 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:14.254075 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-aaaac74b-2e2e-4a24-b354-041b90dfdce9 req-b3147dfc-508a-4d51-861c-4fbb7100e794 service nova] Creating event network-vif-plugged:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:23:14.259498 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-aaaac74b-2e2e-4a24-b354-041b90dfdce9 req-b3147dfc-508a-4d51-861c-4fbb7100e794 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037514 Mar 26 21:23:14.260306 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2964/5661] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:23:38.458352 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:23:38.459330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:38.465623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:38.466084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:38.466854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:38.467296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:38.516006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4a65ae9-40f8-4f5b-a36a-1ac070dd616c tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action" status: 200 len: 24577 microversion: 2.1 time: 0.060810 Mar 26 21:23:38.516628 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2698/5662] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:23:38 2022] POST /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a/action => generated 24577 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:23:50.501072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:50.501855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:50.502755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-eeb76c89-4795-4820-9961-ad42a0ea7ce0 req-f7829f42-8613-46bb-b396-765d1496aec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:23:50.509889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:50.510466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:50.511416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:50.512033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:50.512620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-eeb76c89-4795-4820-9961-ad42a0ea7ce0 req-f7829f42-8613-46bb-b396-765d1496aec1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:50.513082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-eeb76c89-4795-4820-9961-ad42a0ea7ce0 req-f7829f42-8613-46bb-b396-765d1496aec1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:50.524955 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-eeb76c89-4795-4820-9961-ad42a0ea7ce0 req-f7829f42-8613-46bb-b396-765d1496aec1 service nova] Creating event network-changed:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:23:50.530380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-eeb76c89-4795-4820-9961-ad42a0ea7ce0 req-f7829f42-8613-46bb-b396-765d1496aec1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Mar 26 21:23:50.531533 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2699/5663] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:23:50.539603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:23:50.622940 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4f073de-3060-451e-8786-a9f0659f2aed tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 204 len: 0 microversion: 2.1 time: 0.126696 Mar 26 21:23:50.623544 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2965/5664] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:23:50 2022] DELETE /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:23:50.633348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:50.634482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:50.641540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:50.641995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:50.642777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:50.643218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:50.792526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:50.800408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-789ad76f-f14e-409b-b9d3-431651867fad tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1689 microversion: 2.1 time: 0.171531 Mar 26 21:23:50.801205 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2700/5665] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:50 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:51.818781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:51.819506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:51.826294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:51.826767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:51.827594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:51.831021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:51.968698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:51.976247 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a5906c5-6ea5-4bd6-b357-cf59420a1efd tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1570 microversion: 2.1 time: 0.161817 Mar 26 21:23:51.976828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2966/5666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:51 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:52.858103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-88451c08-e6c4-41a5-ad31-6b7839a50f39 req-88a2b941-08fe-4934-96bd-aa44c0d90b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a491fcd-b0b8-4190-a227-be1477ba0c1a", "name": "network-vif-deleted", "tag": "b4c8a4bf-92b7-4abf-89ca-f80a9d881b54"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:23:52.867881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-88451c08-e6c4-41a5-ad31-6b7839a50f39 req-88a2b941-08fe-4934-96bd-aa44c0d90b24 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:52.868387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-88451c08-e6c4-41a5-ad31-6b7839a50f39 req-88a2b941-08fe-4934-96bd-aa44c0d90b24 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:52.882828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-88451c08-e6c4-41a5-ad31-6b7839a50f39 req-88a2b941-08fe-4934-96bd-aa44c0d90b24 service nova] Creating event network-vif-deleted:b4c8a4bf-92b7-4abf-89ca-f80a9d881b54 for instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a on nch1-master-1 Mar 26 21:23:52.888637 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-88451c08-e6c4-41a5-ad31-6b7839a50f39 req-88a2b941-08fe-4934-96bd-aa44c0d90b24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034308 Mar 26 21:23:52.889249 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2701/5667] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:23:52.994360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:52.994992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:53.001774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:53.002249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:53.003035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:53.003497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:53.035016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:53.035489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:53.035986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lazy-loading 'fault' on Instance uuid 6a491fcd-b0b8-4190-a227-be1477ba0c1a {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:23:53.075901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce0a0696d1244589ef6242917432858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39045df80a6f442b972ee88f13343d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:23:53.083757 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6bfd68f0-256e-44ee-be43-134500d01fc0 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 200 len: 1357 microversion: 2.1 time: 0.093407 Mar 26 21:23:53.084373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2967/5668] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:52 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 1357 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:23:54.102051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:54.102750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] [instance: 6a491fcd-b0b8-4190-a227-be1477ba0c1a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:23:54.109655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:54.110114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:54.110889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:23:54.111329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:23:54.124355 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] HTTP exception thrown: Instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a could not be found. Mar 26 21:23:54.124934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Returning 404 to user: Instance 6a491fcd-b0b8-4190-a227-be1477ba0c1a could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:23:54.125773 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-855d9f34-38b5-43b1-a116-efe9c617743d tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a" status: 404 len: 111 microversion: 2.1 time: 0.028801 Mar 26 21:23:54.126292 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2702/5669] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:23:54 2022] GET /compute/v2.1/servers/6a491fcd-b0b8-4190-a227-be1477ba0c1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:23:57.456245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17819cbf-f453-473a-983e-769c905d7607 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] Calling method '.version_select at 0x7f6e595068b0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:23:57.491438 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17819cbf-f453-473a-983e-769c905d7607 tempest-TestNetworkAdvancedServerOps-1112333763 tempest-TestNetworkAdvancedServerOps-1112333763-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1183311719" status: 202 len: 0 microversion: 2.1 time: 0.039840 Mar 26 21:23:57.492244 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2968/5670] 10.222.0.16 () {58 vars in 1283 bytes} [Sat Mar 26 21:23:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1183311719 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:24:05.255304 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:24:05.255827 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:24:05.299718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: .version_select at 0x7f6e586b0550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1080616821"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:05.315145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:05.321847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:05.549384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:05.554513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:05.569552 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b9affa7-dd19-4b99-9141-c550acbf9d78 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.273900 Mar 26 21:24:05.570160 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2703/5671] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:24:05 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:06.754436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1129485816", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "3edc8806-1159-4b34-b886-edf38ff13783"}], "key_name": "tempest-TestNetworkBasicOps-1080616821", "security_groups": [{"name": "tempest-secgroup-smoke-1764841245"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:06.868951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] validate_networks() for [('3edc8806-1159-4b34-b886-edf38ff13783', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:24:07.408075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:24:07.408520 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:24:07.409013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:24:07.409444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:24:07.409905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:24:07.419582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:07.420110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:07.421551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:07.422006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:07.439056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:07.444456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:07.457453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:24:07.459769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:24:07.508717 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37d84a8e-2c72-45c3-9875-65b98a717792 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759884 Mar 26 21:24:07.509627 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2969/5672] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:24:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:24:07.520457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c21483a-33c5-42f9-8120-54c9085fae06 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:07.521085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c21483a-33c5-42f9-8120-54c9085fae06 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:07.578132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c21483a-33c5-42f9-8120-54c9085fae06 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:07.585072 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c21483a-33c5-42f9-8120-54c9085fae06 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1249 microversion: 2.1 time: 0.069585 Mar 26 21:24:07.585662 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2704/5673] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:07 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:08.604039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:08.605315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:08.612863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:08.613347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:08.614375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:08.614885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:08.701485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:08.709570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-29d2d561-2ed1-49de-aeee-1c6373722565 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1319 microversion: 2.1 time: 0.110565 Mar 26 21:24:08.710341 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2970/5674] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:08 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1319 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:09.727181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:09.727616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:09.735492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:09.735966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:09.736936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:09.737378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:09.908978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-25ae2956-9e01-4029-9184-947145970a01 req-b613cb54-54f3-475f-a4e9-03dea93d13aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34b2c88-f864-40d2-b731-203f64e9dcce", "tag": "28972668-2ff3-4362-a80b-0129c3efdc78"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:09.926992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:09.935861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-25ae2956-9e01-4029-9184-947145970a01 req-b613cb54-54f3-475f-a4e9-03dea93d13aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:09.936096 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb34bd72-f915-416b-b316-c3a6a962de86 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.213200 Mar 26 21:24:09.936997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2705/5675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:09 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:09.938394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-25ae2956-9e01-4029-9184-947145970a01 req-b613cb54-54f3-475f-a4e9-03dea93d13aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:09.951593 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-25ae2956-9e01-4029-9184-947145970a01 req-b613cb54-54f3-475f-a4e9-03dea93d13aa service nova] Creating event network-changed:28972668-2ff3-4362-a80b-0129c3efdc78 for instance e34b2c88-f864-40d2-b731-203f64e9dcce on nch1-master-1 Mar 26 21:24:09.957392 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-25ae2956-9e01-4029-9184-947145970a01 req-b613cb54-54f3-475f-a4e9-03dea93d13aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057786 Mar 26 21:24:09.958412 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2971/5676] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:24:10.953570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:10.954232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:10.960896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:10.961355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:10.962116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:10.962555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:11.095538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:11.102731 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aabb69ab-f0a3-41c4-9606-911c234a71cd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.153090 Mar 26 21:24:11.103303 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2706/5677] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:10 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:12.121451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:12.122181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:12.128680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:12.129156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:12.129954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:12.130594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:12.273316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:12.281471 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f8f9f9c-5998-42a0-95b5-8028a48a3433 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.165178 Mar 26 21:24:12.282002 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2972/5678] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:12 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:13.298970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:13.299503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:13.306245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:13.306699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:13.307460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:13.307899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:13.440459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:13.447736 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ece39dbf-3b87-41cd-a06f-91084e1f41e5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.153259 Mar 26 21:24:13.448327 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2707/5679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:13 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:14.414530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ace9c41c-879e-4749-be0e-08c919b31e04 req-5111531d-bd2b-495b-b25f-79769c3f27b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34b2c88-f864-40d2-b731-203f64e9dcce", "name": "network-vif-plugged", "status": "completed", "tag": "28972668-2ff3-4362-a80b-0129c3efdc78"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:14.426382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ace9c41c-879e-4749-be0e-08c919b31e04 req-5111531d-bd2b-495b-b25f-79769c3f27b8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:14.427203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ace9c41c-879e-4749-be0e-08c919b31e04 req-5111531d-bd2b-495b-b25f-79769c3f27b8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:14.438760 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ace9c41c-879e-4749-be0e-08c919b31e04 req-5111531d-bd2b-495b-b25f-79769c3f27b8 service nova] Creating event network-vif-plugged:28972668-2ff3-4362-a80b-0129c3efdc78 for instance e34b2c88-f864-40d2-b731-203f64e9dcce on nch1-master-1 Mar 26 21:24:14.443881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ace9c41c-879e-4749-be0e-08c919b31e04 req-5111531d-bd2b-495b-b25f-79769c3f27b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Mar 26 21:24:14.444512 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2973/5680] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:24:14.464362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:14.465685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:14.472658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:14.473327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:14.474274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:14.474890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:14.615008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:14.622628 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d19ae10-162a-4924-8815-8c8b0d3f669d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.162210 Mar 26 21:24:14.623202 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2708/5681] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:14 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:15.641193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:15.641917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:15.648916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:15.649391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:15.650191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:15.650650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:15.787985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:15.796011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d3c8f6e1-5577-4b02-aaf5-81e84aa334f6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1375 microversion: 2.1 time: 0.159679 Mar 26 21:24:15.796602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2974/5682] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:15 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:24:16.812062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:16.812681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:16.819491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:16.819976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:16.820752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:16.821192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:16.954855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:16.962186 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-746d23eb-e741-4493-bad9-7a75bf2416b6 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1547 microversion: 2.1 time: 0.154133 Mar 26 21:24:16.962771 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2709/5683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:16 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:16.978703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:16.979341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:16.986174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:16.986596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:16.987390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:16.987854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:17.128966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:17.136394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e2f1f501-4177-4761-844f-7d30b6b92d00 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1547 microversion: 2.1 time: 0.161623 Mar 26 21:24:17.136970 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2975/5684] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:16 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:19.066057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a505da48-4fec-46ed-8344-41cd646721e8 req-20c486e6-dc75-48e5-a1f5-cdad11652267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34b2c88-f864-40d2-b731-203f64e9dcce", "tag": "28972668-2ff3-4362-a80b-0129c3efdc78"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:19.075315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a505da48-4fec-46ed-8344-41cd646721e8 req-20c486e6-dc75-48e5-a1f5-cdad11652267 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:19.075774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a505da48-4fec-46ed-8344-41cd646721e8 req-20c486e6-dc75-48e5-a1f5-cdad11652267 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:19.086959 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a505da48-4fec-46ed-8344-41cd646721e8 req-20c486e6-dc75-48e5-a1f5-cdad11652267 service nova] Creating event network-changed:28972668-2ff3-4362-a80b-0129c3efdc78 for instance e34b2c88-f864-40d2-b731-203f64e9dcce on nch1-master-1 Mar 26 21:24:19.092959 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a505da48-4fec-46ed-8344-41cd646721e8 req-20c486e6-dc75-48e5-a1f5-cdad11652267 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031319 Mar 26 21:24:19.093922 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2710/5685] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:24:42.308253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:42.309122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:42.316475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:42.316953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:42.317751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:42.318216 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:42.368376 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-26fa48ff-7a8f-4ed5-9197-10d13f39084f tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce/action" status: 200 len: 24569 microversion: 2.1 time: 0.064137 Mar 26 21:24:42.369024 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2976/5686] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:24:42 2022] POST /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce/action => generated 24569 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:24:47.046340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:47.046926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:47.053935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:47.054388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:47.055153 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:47.055593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:47.079048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:24:47.155331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8a337ce4-ab3c-4c11-8e5e-dd59d56d7a45 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 204 len: 0 microversion: 2.1 time: 0.113306 Mar 26 21:24:47.156007 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2711/5687] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:24:47 2022] DELETE /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:24:47.165687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:47.166408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:47.174022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:47.174484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:47.175260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:47.175713 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:47.429087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:47.441970 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e91445ef-4320-4f05-bf45-574ddf7605a7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1577 microversion: 2.1 time: 0.280875 Mar 26 21:24:47.442720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2977/5688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:47 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:48.460735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:48.461445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:48.468232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:48.468689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:48.469462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:48.470543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:48.664857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:48.672331 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77344c84-6cc9-46f3-b4a5-a23f0eb2f985 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1577 microversion: 2.1 time: 0.215883 Mar 26 21:24:48.673641 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2712/5689] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:48 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:49.570689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-5ae884e4-73cc-46b6-ad3f-027619c69f0a req-e6596bef-13f3-4936-9ef5-fb46b7700ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e941d26-c67c-4ea5-a0ff-a71ba089f643", "name": "network-vif-deleted", "tag": "cd08295b-fb42-421d-beb0-e607252972c8"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:49.583038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5ae884e4-73cc-46b6-ad3f-027619c69f0a req-e6596bef-13f3-4936-9ef5-fb46b7700ed0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:49.583788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-5ae884e4-73cc-46b6-ad3f-027619c69f0a req-e6596bef-13f3-4936-9ef5-fb46b7700ed0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:49.595327 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-5ae884e4-73cc-46b6-ad3f-027619c69f0a req-e6596bef-13f3-4936-9ef5-fb46b7700ed0 service nova] Creating event network-vif-deleted:cd08295b-fb42-421d-beb0-e607252972c8 for instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 on nch2-master-1 Mar 26 21:24:49.600270 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-5ae884e4-73cc-46b6-ad3f-027619c69f0a req-e6596bef-13f3-4936-9ef5-fb46b7700ed0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Mar 26 21:24:49.600892 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2978/5690] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:24:49.693054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:49.694679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:49.707801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:49.708807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:49.711707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:49.712371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:49.798735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:49.811832 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ec2d372-96e0-48a3-aff6-822a913e2243 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 200 len: 1225 microversion: 2.1 time: 0.124471 Mar 26 21:24:49.815972 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2713/5691] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:49 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:50.830680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:50.831401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:50.838394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:50.838865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:50.839658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:50.840159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:50.853787 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. Mar 26 21:24:50.854339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:24:50.855179 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-65ddc3b2-7f1f-4512-a82c-74bd0462be29 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 404 len: 111 microversion: 2.1 time: 0.029717 Mar 26 21:24:50.855778 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2979/5692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:50 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:24:50.949829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-476020510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343139743", "security_groups": [{"name": "tempest-secgroup-smoke-1244663080"}], "block_device_mapping_v2": [{"uuid": "44eb25a7-2179-422f-a764-436f790469c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:51.059827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:24:51.434796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:24:51.435339 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:24:51.436094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:24:51.436703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:24:51.437123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:24:51.447668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:51.448162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:51.448995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:51.449437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:51.465617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:51.471028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:51.527329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:24:51.529494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44eb25a7-2179-422f-a764-436f790469c5',volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:24:51.648793 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b6205b43-861a-42cd-88a9-d10f92080276 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703456 Mar 26 21:24:51.649447 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2714/5693] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:24:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:24:51.660077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a6d6c1fb-30ca-4e4b-b7f0-621e3a96387b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:51.660717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a6d6c1fb-30ca-4e4b-b7f0-621e3a96387b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:51.716798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a6d6c1fb-30ca-4e4b-b7f0-621e3a96387b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:51.724005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a6d6c1fb-30ca-4e4b-b7f0-621e3a96387b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1093 microversion: 2.1 time: 0.068409 Mar 26 21:24:51.724577 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2980/5694] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:51 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:52.742378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:52.743286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:52.750703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:52.751341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:52.752401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:52.753074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:52.819311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:52.827335 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e35c775a-67e7-4f36-be1e-6c61f951fe76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1209 microversion: 2.1 time: 0.090151 Mar 26 21:24:52.828079 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2715/5695] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:52 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:53.845598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:53.847191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:53.858205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:53.858692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:53.859707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:53.859983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:53.952452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-55af7332-7a71-4d62-bada-1051e9fcbf40 req-3202748a-dfdb-499b-82eb-a74dbe2562ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926b8d8d-180b-4dd6-b047-f5a5f8e750a9", "tag": "5f9fcc88-2637-43e1-8b33-1497b86cc140"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:53.964506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-55af7332-7a71-4d62-bada-1051e9fcbf40 req-3202748a-dfdb-499b-82eb-a74dbe2562ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:53.965175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-55af7332-7a71-4d62-bada-1051e9fcbf40 req-3202748a-dfdb-499b-82eb-a74dbe2562ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:53.980251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-55af7332-7a71-4d62-bada-1051e9fcbf40 req-3202748a-dfdb-499b-82eb-a74dbe2562ea service nova] Creating event network-changed:5f9fcc88-2637-43e1-8b33-1497b86cc140 for instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 on nch2-master-1 Mar 26 21:24:53.986034 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-55af7332-7a71-4d62-bada-1051e9fcbf40 req-3202748a-dfdb-499b-82eb-a74dbe2562ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037605 Mar 26 21:24:53.987220 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2716/5696] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:24:54.460591 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:54.468158 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c49722ce-65fc-4fb9-89ac-fec948a8510e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.626784 Mar 26 21:24:54.468756 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2981/5697] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:53 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:55.484844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:55.485540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:55.493319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:55.493776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:55.494540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:55.494975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:55.634289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:55.642241 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0c21a5da-b13c-49f3-90a4-39a0d41f53e5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.161665 Mar 26 21:24:55.643297 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2717/5698] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:55 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:56.660739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:56.661457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:56.669378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:56.669958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:56.670949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:56.671571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:56.812524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:56.820676 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9eadf7c-d17a-432f-88cc-b46364a5e902 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.164610 Mar 26 21:24:56.821255 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2982/5699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:56 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:57.372789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: .version_select at 0x7f6e586859d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-780995428"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:57.388367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:57.393484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:57.587629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:57.592669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:57.608769 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-25a03622-85c5-4818-b9a9-e1801bd4541d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.239736 Mar 26 21:24:57.610357 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2718/5700] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:24:57 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:57.839525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:57.840977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:57.851108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:57.852000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:57.853041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:57.853736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:58.090235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:58.100235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-63bbff72-87d5-4205-a4aa-342a9ccbd18b tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.265653 Mar 26 21:24:58.114455 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2983/5701] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:57 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:24:58.679209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-254403029", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "5b671c81-bb21-43cc-bdfe-51cea0312779"}], "key_name": "tempest-TestNetworkBasicOps-780995428", "security_groups": [{"name": "tempest-secgroup-smoke-1824953633"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:24:58.786538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] validate_networks() for [('5b671c81-bb21-43cc-bdfe-51cea0312779', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:24:59.117325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:59.117985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:59.126887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:59.127865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:59.128862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:59.129864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:59.182115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:24:59.182775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:24:59.183431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:24:59.186386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:24:59.186908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:24:59.211129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:59.212098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:59.213254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:24:59.213904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:24:59.236182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:24:59.244170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:24:59.259241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:24:59.262941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:24:59.314994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:59.324407 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3fa9c0ed-2074-48a7-81c6-11c60afceac4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650488 Mar 26 21:24:59.325377 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2719/5702] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:24:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:24:59.326068 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aad76786-f49a-4e83-a531-949a1d85b641 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.212488 Mar 26 21:24:59.327539 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2984/5703] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:59 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:24:59.341203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15752265-ebba-4a86-902b-060fd9e7a910 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:24:59.341925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15752265-ebba-4a86-902b-060fd9e7a910 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:24:59.398349 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15752265-ebba-4a86-902b-060fd9e7a910 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:24:59.405768 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15752265-ebba-4a86-902b-060fd9e7a910 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1247 microversion: 2.1 time: 0.068485 Mar 26 21:24:59.407012 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2720/5704] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:24:59 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:00.342724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:00.343372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:00.350774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:00.351257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:00.352096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:00.352566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:00.424430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:00.425687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:00.432593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:00.433297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:00.434335 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:00.434942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:00.497312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:00.504815 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc237adb-baaa-4ee0-a376-9c0962d5492c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1317 microversion: 2.1 time: 0.084223 Mar 26 21:25:00.505720 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2721/5705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:00 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:00.589476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:00.596861 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27549911-7c07-443e-a3cd-6d16a753720c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.258029 Mar 26 21:25:00.597456 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2985/5706] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:00 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:01.525701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c3ad11c8-7187-4a15-a7f7-54b950b450ae req-126358f7-4b8b-428f-87c7-04ae61b36a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926b8d8d-180b-4dd6-b047-f5a5f8e750a9", "name": "network-vif-plugged", "status": "completed", "tag": "5f9fcc88-2637-43e1-8b33-1497b86cc140"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:01.530732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:01.531373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:01.542622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:01.543101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:01.543955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:01.544424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:01.552234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c3ad11c8-7187-4a15-a7f7-54b950b450ae req-126358f7-4b8b-428f-87c7-04ae61b36a2f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:01.552692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c3ad11c8-7187-4a15-a7f7-54b950b450ae req-126358f7-4b8b-428f-87c7-04ae61b36a2f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:01.565033 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c3ad11c8-7187-4a15-a7f7-54b950b450ae req-126358f7-4b8b-428f-87c7-04ae61b36a2f service nova] Creating event network-vif-plugged:5f9fcc88-2637-43e1-8b33-1497b86cc140 for instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 on nch2-master-1 Mar 26 21:25:01.570169 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c3ad11c8-7187-4a15-a7f7-54b950b450ae req-126358f7-4b8b-428f-87c7-04ae61b36a2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052253 Mar 26 21:25:01.571417 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2722/5707] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:01.615625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:01.616657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:01.625047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:01.625574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:01.626574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:01.627556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:01.792826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:01.803870 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c3d89ca6-3c6c-42f0-9433-ec1e54e21d55 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.193506 Mar 26 21:25:01.804484 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2723/5708] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:01 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:25:01.916168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:01.923596 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae1d5af0-bbe7-421a-bdcf-5cbaf12cf1e1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.404059 Mar 26 21:25:01.924748 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2986/5709] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:01 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:02.008495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-44721639-5f3e-46ce-b3de-3d816796f9e8 req-e48cc6cd-058e-4482-bb76-c97f6f752a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8022d5c8-8e7e-4b1a-918c-16633f58a356", "tag": "0a5f301c-5f41-44e5-b98c-c237294bb767"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:02.017105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-44721639-5f3e-46ce-b3de-3d816796f9e8 req-e48cc6cd-058e-4482-bb76-c97f6f752a3b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:02.017862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-44721639-5f3e-46ce-b3de-3d816796f9e8 req-e48cc6cd-058e-4482-bb76-c97f6f752a3b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:02.039616 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-44721639-5f3e-46ce-b3de-3d816796f9e8 req-e48cc6cd-058e-4482-bb76-c97f6f752a3b service nova] Creating event network-changed:0a5f301c-5f41-44e5-b98c-c237294bb767 for instance 8022d5c8-8e7e-4b1a-918c-16633f58a356 on nch1-master-1 Mar 26 21:25:02.045612 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-44721639-5f3e-46ce-b3de-3d816796f9e8 req-e48cc6cd-058e-4482-bb76-c97f6f752a3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040571 Mar 26 21:25:02.046410 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2724/5710] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:02.820928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:02.821557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:02.828599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:02.829069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:02.829856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:02.830377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:02.943819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:02.945215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:02.951484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:02.952163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:02.953123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:02.953718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:03.052243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:03.059962 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-23d6039e-e386-472b-93cd-ef74955252fb tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1265 microversion: 2.1 time: 0.242948 Mar 26 21:25:03.060569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2987/5711] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:02 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:03.101199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:03.108627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a43bf5b-4ccd-4071-8e63-d6b005db8dd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.170789 Mar 26 21:25:03.109196 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2725/5712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:02 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:04.077010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:04.077650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:04.085273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.085753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.086577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.087047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.125564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:04.126251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:04.132978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.133433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.134207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.134650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.226008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:04.233656 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a0b003fe-3e10-4c8a-a4dd-b48470de7ea5 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1451 microversion: 2.1 time: 0.160587 Mar 26 21:25:04.234230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2988/5713] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:04 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:04.249234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:04.249860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:04.255654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.256174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.256963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:04.257423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:04.273033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:04.280489 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca923c24-2765-42ee-b2a8-00fa8b1bc2c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.158679 Mar 26 21:25:04.281004 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2726/5714] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:04 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:25:04.388948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:04.397184 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f8d4f469-7a6f-40b5-8ea9-4a086c26579c tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1451 microversion: 2.1 time: 0.151616 Mar 26 21:25:04.397776 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2989/5715] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:04 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:05.298126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:05.298950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:05.305855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:05.306327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:05.307114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:05.307565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:05.443652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:05.451370 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0852a97f-79b5-452f-9956-63c3cb170eae tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.157056 Mar 26 21:25:05.451999 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2727/5716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:05 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:06.419807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2c252aa1-e010-4ad5-895f-9b3fbde79f7b req-9a3c64e1-5e63-4887-b5ee-a001df284f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926b8d8d-180b-4dd6-b047-f5a5f8e750a9", "tag": "5f9fcc88-2637-43e1-8b33-1497b86cc140"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:06.431075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2c252aa1-e010-4ad5-895f-9b3fbde79f7b req-9a3c64e1-5e63-4887-b5ee-a001df284f6b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:06.431660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2c252aa1-e010-4ad5-895f-9b3fbde79f7b req-9a3c64e1-5e63-4887-b5ee-a001df284f6b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:06.445194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2c252aa1-e010-4ad5-895f-9b3fbde79f7b req-9a3c64e1-5e63-4887-b5ee-a001df284f6b service nova] Creating event network-changed:5f9fcc88-2637-43e1-8b33-1497b86cc140 for instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 on nch2-master-1 Mar 26 21:25:06.452360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2c252aa1-e010-4ad5-895f-9b3fbde79f7b req-9a3c64e1-5e63-4887-b5ee-a001df284f6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039685 Mar 26 21:25:06.453627 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2990/5717] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:06.471131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:06.472608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:06.480540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:06.481456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:06.482407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:06.483011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:06.694964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:06.705129 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c58b9818-689e-4ddb-b0e7-7d259d4ddf6d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.240595 Mar 26 21:25:06.715582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2728/5718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:06 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:06.782307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a438fdad-9b8d-434b-a9bb-b1ab9e95aa5b req-049724df-6165-4e6f-87b2-0d5ee63f789c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8022d5c8-8e7e-4b1a-918c-16633f58a356", "name": "network-vif-plugged", "status": "completed", "tag": "0a5f301c-5f41-44e5-b98c-c237294bb767"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:06.802580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a438fdad-9b8d-434b-a9bb-b1ab9e95aa5b req-049724df-6165-4e6f-87b2-0d5ee63f789c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:06.803325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a438fdad-9b8d-434b-a9bb-b1ab9e95aa5b req-049724df-6165-4e6f-87b2-0d5ee63f789c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:06.816008 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a438fdad-9b8d-434b-a9bb-b1ab9e95aa5b req-049724df-6165-4e6f-87b2-0d5ee63f789c service nova] Creating event network-vif-plugged:0a5f301c-5f41-44e5-b98c-c237294bb767 for instance 8022d5c8-8e7e-4b1a-918c-16633f58a356 on nch1-master-1 Mar 26 21:25:06.823059 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a438fdad-9b8d-434b-a9bb-b1ab9e95aa5b req-049724df-6165-4e6f-87b2-0d5ee63f789c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044489 Mar 26 21:25:06.823680 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2991/5719] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:07.722791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:07.723566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:07.730463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:07.731006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:07.731871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:07.732381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:07.864709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:07.871985 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7ab7ba6f-0322-4e55-806e-bbd3324492b4 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1373 microversion: 2.1 time: 0.153748 Mar 26 21:25:07.872555 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2729/5720] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:07 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:08.890483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:08.891150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:08.898018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:08.898494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:08.899272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:08.899741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:09.039009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:09.046390 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-837303ab-3693-46c2-b4b3-39dd9bba8be7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1546 microversion: 2.1 time: 0.161431 Mar 26 21:25:09.046960 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2992/5721] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:08 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:09.062157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:09.062774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:09.070099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:09.070551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:09.071319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:09.071762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:09.203503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:09.211039 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b2a208b-cf82-4564-b4f6-dc79124302ee tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1546 microversion: 2.1 time: 0.152756 Mar 26 21:25:09.211615 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2730/5722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:09 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:36.625111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:36.625648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:36.631940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:36.632275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:36.633061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:36.633513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:36.658547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:25:36.735292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba6b96fc-d33b-4bc3-8ce2-a8623ea7a3db tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 204 len: 0 microversion: 2.1 time: 0.113739 Mar 26 21:25:36.736038 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2993/5723] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:25:36 2022] DELETE /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:25:36.744409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:36.745027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:36.761647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:36.762127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:36.762972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:36.763382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:36.905403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:36.913162 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-27a7e24a-06c9-4bbb-b49c-608288cc2985 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1552 microversion: 2.1 time: 0.172604 Mar 26 21:25:36.913760 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2731/5724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:36 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:37.930441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:37.931300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:37.938139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:37.938611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:37.939413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:37.939897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:38.083355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:38.091703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84cb67dc-7148-4a60-a563-4c3f7a550113 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1552 microversion: 2.1 time: 0.165603 Mar 26 21:25:38.092308 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2994/5725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:37 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:38.744575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9e8b33f3-83d4-4657-820c-5f3b262ca726 req-b1b6e9c0-df4d-4770-bea2-80887a1baa3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8022d5c8-8e7e-4b1a-918c-16633f58a356", "name": "network-vif-deleted", "tag": "0a5f301c-5f41-44e5-b98c-c237294bb767"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:38.752728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9e8b33f3-83d4-4657-820c-5f3b262ca726 req-b1b6e9c0-df4d-4770-bea2-80887a1baa3f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:38.753180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9e8b33f3-83d4-4657-820c-5f3b262ca726 req-b1b6e9c0-df4d-4770-bea2-80887a1baa3f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:38.764973 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9e8b33f3-83d4-4657-820c-5f3b262ca726 req-b1b6e9c0-df4d-4770-bea2-80887a1baa3f service nova] Creating event network-vif-deleted:0a5f301c-5f41-44e5-b98c-c237294bb767 for instance 8022d5c8-8e7e-4b1a-918c-16633f58a356 on nch1-master-1 Mar 26 21:25:38.769821 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9e8b33f3-83d4-4657-820c-5f3b262ca726 req-b1b6e9c0-df4d-4770-bea2-80887a1baa3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099622 Mar 26 21:25:38.770474 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2732/5726] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:39.109246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:39.109871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:39.117308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:39.117999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:39.118784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:39.119400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:39.149602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:39.150068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:39.150542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lazy-loading 'fault' on Instance uuid 8022d5c8-8e7e-4b1a-918c-16633f58a356 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:25:39.195417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:39.202614 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a051444-3104-4fbe-80ec-9ccf2a7d7c2b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 200 len: 1337 microversion: 2.1 time: 0.097435 Mar 26 21:25:39.203136 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2995/5727] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:39 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:40.220466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:40.221181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: 8022d5c8-8e7e-4b1a-918c-16633f58a356] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:40.228403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:40.228871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:40.229664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:40.230119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:40.245016 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] HTTP exception thrown: Instance 8022d5c8-8e7e-4b1a-918c-16633f58a356 could not be found. Mar 26 21:25:40.245631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Returning 404 to user: Instance 8022d5c8-8e7e-4b1a-918c-16633f58a356 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:25:40.246458 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-abf39546-3f0b-4a25-a064-c977e54ef8af tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356" status: 404 len: 111 microversion: 2.1 time: 0.031142 Mar 26 21:25:40.247009 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2733/5728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:40 2022] GET /compute/v2.1/servers/8022d5c8-8e7e-4b1a-918c-16633f58a356 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:25:40.405672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e844b63-87ba-4009-a9da-d6a2e6c905f1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '.version_select at 0x7f6e5926ab80>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:40.430367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e844b63-87ba-4009-a9da-d6a2e6c905f1 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-780995428" status: 202 len: 0 microversion: 2.1 time: 0.028728 Mar 26 21:25:40.431406 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2996/5729] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-780995428 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:25:42.390301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:42.390815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:42.399545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:42.400112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:42.400981 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:42.401631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:42.428490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:25:42.468191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7d0cdab1-ed13-4617-9557-61ceb07cef4f req-951c262b-affb-41f4-95db-237411bdf440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34b2c88-f864-40d2-b731-203f64e9dcce", "tag": "28972668-2ff3-4362-a80b-0129c3efdc78"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:42.480274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7d0cdab1-ed13-4617-9557-61ceb07cef4f req-951c262b-affb-41f4-95db-237411bdf440 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:42.480748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7d0cdab1-ed13-4617-9557-61ceb07cef4f req-951c262b-affb-41f4-95db-237411bdf440 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:42.494758 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7d0cdab1-ed13-4617-9557-61ceb07cef4f req-951c262b-affb-41f4-95db-237411bdf440 service nova] Creating event network-changed:28972668-2ff3-4362-a80b-0129c3efdc78 for instance e34b2c88-f864-40d2-b731-203f64e9dcce on nch1-master-1 Mar 26 21:25:42.500852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7d0cdab1-ed13-4617-9557-61ceb07cef4f req-951c262b-affb-41f4-95db-237411bdf440 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112461 Mar 26 21:25:42.501696 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2997/5730] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:25:42.518571 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-122fbecd-cafe-48be-9c02-a185c0a0105d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 204 len: 0 microversion: 2.1 time: 0.132406 Mar 26 21:25:42.519481 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2734/5731] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:25:42 2022] DELETE /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:25:42.533632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:42.534683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:42.542100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:42.542596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:42.543441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:42.543878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:42.765104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:42.773194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-409897ff-8a5e-4b0d-8b89-c7bf9a1c0fd8 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1672 microversion: 2.1 time: 0.246946 Mar 26 21:25:42.773961 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2998/5732] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:42 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:43.791261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:43.792005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:43.798885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:43.799350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:43.800173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:43.800624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:43.938563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:43.946584 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f6c4e99-b616-4e78-ad07-61fd473f52fa tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1553 microversion: 2.1 time: 0.159883 Mar 26 21:25:43.947161 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2735/5733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:43 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:44.521845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1cd280c2-83dd-4b36-8e7e-8fdecdfa5bba req-08a4a5dd-f40b-4971-a33d-59e8f82011e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34b2c88-f864-40d2-b731-203f64e9dcce", "name": "network-vif-deleted", "tag": "28972668-2ff3-4362-a80b-0129c3efdc78"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:44.531844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1cd280c2-83dd-4b36-8e7e-8fdecdfa5bba req-08a4a5dd-f40b-4971-a33d-59e8f82011e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:44.532366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1cd280c2-83dd-4b36-8e7e-8fdecdfa5bba req-08a4a5dd-f40b-4971-a33d-59e8f82011e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:44.544535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1cd280c2-83dd-4b36-8e7e-8fdecdfa5bba req-08a4a5dd-f40b-4971-a33d-59e8f82011e5 service nova] Creating event network-vif-deleted:28972668-2ff3-4362-a80b-0129c3efdc78 for instance e34b2c88-f864-40d2-b731-203f64e9dcce on nch1-master-1 Mar 26 21:25:44.550072 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1cd280c2-83dd-4b36-8e7e-8fdecdfa5bba req-08a4a5dd-f40b-4971-a33d-59e8f82011e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 Mar 26 21:25:44.550714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 2999/5734] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:25:44.963223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:44.963843 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:44.970583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:44.971045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:44.971823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:44.972327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:45.003439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:45.003993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:45.004479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lazy-loading 'fault' on Instance uuid e34b2c88-f864-40d2-b731-203f64e9dcce {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:25:45.052355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:45.059065 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-749d226d-0515-425a-a543-443ac22da110 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 200 len: 1339 microversion: 2.1 time: 0.100345 Mar 26 21:25:45.059634 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2736/5735] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:44 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:46.077339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:46.078066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: e34b2c88-f864-40d2-b731-203f64e9dcce] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:46.084416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:46.084889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:46.085678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:46.086141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:46.099714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] HTTP exception thrown: Instance e34b2c88-f864-40d2-b731-203f64e9dcce could not be found. Mar 26 21:25:46.100348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Returning 404 to user: Instance e34b2c88-f864-40d2-b731-203f64e9dcce could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:25:46.101180 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6206b5e2-e7d6-4183-9bf7-65046c5cb64e tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce" status: 404 len: 111 microversion: 2.1 time: 0.029051 Mar 26 21:25:46.101708 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3000/5736] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:46 2022] GET /compute/v2.1/servers/e34b2c88-f864-40d2-b731-203f64e9dcce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:25:46.256140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aacfe0d2-bd2e-4af2-ba11-8b4f1c4fb475 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '.version_select at 0x7f6e590889d0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:46.282012 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aacfe0d2-bd2e-4af2-ba11-8b4f1c4fb475 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1080616821" status: 202 len: 0 microversion: 2.1 time: 0.029688 Mar 26 21:25:46.282594 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2737/5737] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:25:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1080616821 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:25:55.288395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: .version_select at 0x7f6e5eb7c430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1355877749"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:55.308938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:25:55.315630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:25:55.592343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:25:55.598167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:25:55.615982 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-37ca8299-a050-4dbe-aafc-9dc9b75f8fef tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.332709 Mar 26 21:25:55.616706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3001/5738] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:25:55 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:56.882743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1301741422", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "0398be08-596d-4b17-9cda-aeb7b742eb00"}], "key_name": "tempest-TestNetworkBasicOps-1355877749", "security_groups": [{"name": "tempest-secgroup-smoke-88356306"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:25:57.026698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] validate_networks() for [('0398be08-596d-4b17-9cda-aeb7b742eb00', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:25:57.496766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:25:57.497413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:25:57.498213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:25:57.498705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:25:57.499313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:25:57.510662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:57.511443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:57.512418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:57.513251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:57.535478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:25:57.542776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Getting quotas for user 1f67809d45cf4f8b9139c5acbd7a046b and project b26aef9ef8394051ae733c44969f31ff. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:25:57.556416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:25:57.558736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:25:57.611253 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02ebbbe0-666f-49b7-b3e2-51c9ae7183d5 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.734705 Mar 26 21:25:57.614407 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2738/5739] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:25:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:25:57.623944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2563c8f-33ff-4d16-9e57-f601df75049b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:57.625212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2563c8f-33ff-4d16-9e57-f601df75049b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:57.696368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2563c8f-33ff-4d16-9e57-f601df75049b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:57.704377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2563c8f-33ff-4d16-9e57-f601df75049b tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1249 microversion: 2.1 time: 0.085435 Mar 26 21:25:57.704969 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3002/5740] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:57 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:58.725004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:58.725662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:58.732246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:58.732749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:58.733678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:58.734143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:58.801496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:25:58.810191 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ee27d911-e47d-4cb2-8be5-bb7b2c236dcb tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1301 microversion: 2.1 time: 0.091129 Mar 26 21:25:58.810767 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2739/5741] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:58 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:25:59.830780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:25:59.831707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:25:59.841244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:59.842387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:25:59.843290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:25:59.844005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:00.104920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:00.112529 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-758e027e-24a2-47c0-b74f-cfe034b1ae8c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.287659 Mar 26 21:26:00.113038 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3003/5742] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:25:59 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:00.438964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ee6ea860-c07c-4bd4-9892-b59e69a9057d req-f9fe6bc5-c1c4-4785-8584-84b82a6fb323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d", "tag": "e6793859-e2be-45e4-bd22-79e8b95c06d2"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:00.450182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee6ea860-c07c-4bd4-9892-b59e69a9057d req-f9fe6bc5-c1c4-4785-8584-84b82a6fb323 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:00.450653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ee6ea860-c07c-4bd4-9892-b59e69a9057d req-f9fe6bc5-c1c4-4785-8584-84b82a6fb323 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:00.482719 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ee6ea860-c07c-4bd4-9892-b59e69a9057d req-f9fe6bc5-c1c4-4785-8584-84b82a6fb323 service nova] Creating event network-changed:e6793859-e2be-45e4-bd22-79e8b95c06d2 for instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d on nch1-master-1 Mar 26 21:26:00.489076 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ee6ea860-c07c-4bd4-9892-b59e69a9057d req-f9fe6bc5-c1c4-4785-8584-84b82a6fb323 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055689 Mar 26 21:26:00.490042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2740/5743] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:26:01.130869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:01.131497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:01.138259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:01.138726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:01.139513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:01.140020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:01.391660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:01.399219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f08ffda5-d20f-4c81-9da1-ce637f53c953 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.272826 Mar 26 21:26:01.399837 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3004/5744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:01 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:02.418614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:02.419300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:02.425577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:02.426031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:02.426828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:02.427273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:02.560492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:02.568426 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-79ea4224-31a9-4866-a951-0f30c2492884 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.155046 Mar 26 21:26:02.568997 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2741/5745] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:02 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:03.585468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:03.586106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:03.593090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:03.593568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:03.594363 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:03.594825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:03.733859 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:03.741336 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90889056-5215-44ff-abc6-2b082105c293 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.160335 Mar 26 21:26:03.741912 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3005/5746] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:03 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:04.758210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:04.758940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:04.765788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:04.766246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:04.767021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:04.767603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:04.908623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:04.919898 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-358a8120-63b3-4c1c-b4be-ac2aafd5d09d tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.165488 Mar 26 21:26:04.920825 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2742/5747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:04 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:04.980084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fed7aa30-2d41-418b-8c9e-e1ec1143eb57 req-e6939dba-9a09-4df2-89bd-58566b9152f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d", "name": "network-vif-plugged", "status": "completed", "tag": "e6793859-e2be-45e4-bd22-79e8b95c06d2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:04.990735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fed7aa30-2d41-418b-8c9e-e1ec1143eb57 req-e6939dba-9a09-4df2-89bd-58566b9152f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:04.991209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fed7aa30-2d41-418b-8c9e-e1ec1143eb57 req-e6939dba-9a09-4df2-89bd-58566b9152f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:05.002860 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fed7aa30-2d41-418b-8c9e-e1ec1143eb57 req-e6939dba-9a09-4df2-89bd-58566b9152f0 service nova] Creating event network-vif-plugged:e6793859-e2be-45e4-bd22-79e8b95c06d2 for instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d on nch1-master-1 Mar 26 21:26:05.007982 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fed7aa30-2d41-418b-8c9e-e1ec1143eb57 req-e6939dba-9a09-4df2-89bd-58566b9152f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098191 Mar 26 21:26:05.008690 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3006/5748] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:26:05.939187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:05.939800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:05.947939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:05.948482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:05.949511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:05.950111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:06.100653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:06.108232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ba447c05-7f5d-48aa-8f8b-875b3eb1f4c9 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1373 microversion: 2.1 time: 0.174003 Mar 26 21:26:06.108803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2743/5749] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:05 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:07.125969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:07.126830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:07.134970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:07.135438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:07.136244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:07.136701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:07.282081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:07.289968 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62237d37-cf38-4001-b6db-aa1afca2a821 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1546 microversion: 2.1 time: 0.169017 Mar 26 21:26:07.290547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3007/5750] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:07 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:07.307172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:07.307806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:07.315017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:07.315543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:07.316432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:07.317528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:07.458829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:07.468132 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e2fa0f3-316e-47cd-a5e8-3ecb40129b77 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1546 microversion: 2.1 time: 0.164886 Mar 26 21:26:07.469087 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2744/5751] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:07 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:26:09.484707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2f973eba-a07a-4968-92f1-2f570b275a3c req-34eccab8-bc7c-4e7c-8a49-fe931de17c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d", "tag": "e6793859-e2be-45e4-bd22-79e8b95c06d2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:09.496577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2f973eba-a07a-4968-92f1-2f570b275a3c req-34eccab8-bc7c-4e7c-8a49-fe931de17c53 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:09.497009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2f973eba-a07a-4968-92f1-2f570b275a3c req-34eccab8-bc7c-4e7c-8a49-fe931de17c53 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:09.508966 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2f973eba-a07a-4968-92f1-2f570b275a3c req-34eccab8-bc7c-4e7c-8a49-fe931de17c53 service nova] Creating event network-changed:e6793859-e2be-45e4-bd22-79e8b95c06d2 for instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d on nch1-master-1 Mar 26 21:26:09.514747 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2f973eba-a07a-4968-92f1-2f570b275a3c req-34eccab8-bc7c-4e7c-8a49-fe931de17c53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 Mar 26 21:26:09.518384 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3008/5752] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:26:33.818657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:33.819583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:33.825709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:33.826256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:33.827030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:33.827469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:33.877570 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0490d7b-7acc-4638-8a99-9540e1ca07dd tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d/action" status: 200 len: 24565 microversion: 2.1 time: 0.063597 Mar 26 21:26:33.878210 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2745/5753] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:26:33 2022] POST /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d/action => generated 24565 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:26:44.862583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:44.863653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:44.869906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:44.870376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:44.871148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:44.871601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:44.923110 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a8c6d271-fcd4-4925-a66a-826ad138b635 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "POST /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d/action" status: 200 len: 32639 microversion: 2.1 time: 0.065770 Mar 26 21:26:44.923735 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3009/5754] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:26:44 2022] POST /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:26:46.260709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-33672cba-6322-4f8f-aa92-df8a2116f633 req-43f42b70-c087-498b-9faf-5dba37b6ead5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d", "tag": "e6793859-e2be-45e4-bd22-79e8b95c06d2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:46.263170 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:46.263772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:46.270419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33672cba-6322-4f8f-aa92-df8a2116f633 req-43f42b70-c087-498b-9faf-5dba37b6ead5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:46.270898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-33672cba-6322-4f8f-aa92-df8a2116f633 req-43f42b70-c087-498b-9faf-5dba37b6ead5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:46.271883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:46.272382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:46.273160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:46.273601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:46.283424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-33672cba-6322-4f8f-aa92-df8a2116f633 req-43f42b70-c087-498b-9faf-5dba37b6ead5 service nova] Creating event network-changed:e6793859-e2be-45e4-bd22-79e8b95c06d2 for instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d on nch1-master-1 Mar 26 21:26:46.289538 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-33672cba-6322-4f8f-aa92-df8a2116f633 req-43f42b70-c087-498b-9faf-5dba37b6ead5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033013 Mar 26 21:26:46.290265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3010/5755] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:26:46.305877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:26:46.393758 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f17b9ee6-f8db-42e1-9537-ec948f354ff7 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 204 len: 0 microversion: 2.1 time: 0.139782 Mar 26 21:26:46.394751 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2746/5756] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:26:46 2022] DELETE /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:26:46.404453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:46.405199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:46.413014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:46.413494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:46.414300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:46.414952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:46.642961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:46.654360 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcd79a4c-8808-4931-9c4d-cb3a8e682794 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1670 microversion: 2.1 time: 0.254399 Mar 26 21:26:46.664871 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3011/5757] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:46 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1670 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:47.673142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:47.673871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:47.681382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:47.681833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:47.682594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:47.683034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:47.816448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:47.823866 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-61c0075b-2455-43b7-8faf-79bd870ab809 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1552 microversion: 2.1 time: 0.155017 Mar 26 21:26:47.824466 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2747/5758] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:47 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:48.368719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6ae44995-8521-4578-9d1b-627b2de17afa req-185e9a53-2f90-40f0-ad42-41a7910aa567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d", "name": "network-vif-deleted", "tag": "e6793859-e2be-45e4-bd22-79e8b95c06d2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:48.379247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ae44995-8521-4578-9d1b-627b2de17afa req-185e9a53-2f90-40f0-ad42-41a7910aa567 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:48.380253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6ae44995-8521-4578-9d1b-627b2de17afa req-185e9a53-2f90-40f0-ad42-41a7910aa567 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:48.396988 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6ae44995-8521-4578-9d1b-627b2de17afa req-185e9a53-2f90-40f0-ad42-41a7910aa567 service nova] Creating event network-vif-deleted:e6793859-e2be-45e4-bd22-79e8b95c06d2 for instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d on nch1-master-1 Mar 26 21:26:48.402201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6ae44995-8521-4578-9d1b-627b2de17afa req-185e9a53-2f90-40f0-ad42-41a7910aa567 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037810 Mar 26 21:26:48.402814 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3012/5759] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:26:48.841036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:48.841687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:48.849044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:48.849997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:48.851088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:48.851569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:48.884865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:48.885245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:48.885706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lazy-loading 'fault' on Instance uuid c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:26:48.925466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f67809d45cf4f8b9139c5acbd7a046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b26aef9ef8394051ae733c44969f31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:48.932869 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38eade31-dbd6-4371-a07d-6f3fbb3509b3 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 200 len: 1339 microversion: 2.1 time: 0.095751 Mar 26 21:26:48.933437 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2748/5760] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:48 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:26:49.950401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:49.951117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] [instance: c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:49.958106 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:49.958573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:49.959404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:49.959857 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:49.972798 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] HTTP exception thrown: Instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d could not be found. Mar 26 21:26:49.973393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Returning 404 to user: Instance c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:26:49.974223 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a97d7567-4daa-4cc2-a5fb-52e55267870c tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d" status: 404 len: 111 microversion: 2.1 time: 0.028201 Mar 26 21:26:49.974764 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3013/5761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:49 2022] GET /compute/v2.1/servers/c34a7fdb-2ebc-4e8b-bcdf-afaf1e74156d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:26:50.135540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce1b045e-8292-49a6-8445-2319811a3712 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] Calling method '.version_select at 0x7f6e58598820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:50.160275 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce1b045e-8292-49a6-8445-2319811a3712 tempest-TestNetworkBasicOps-658177694 tempest-TestNetworkBasicOps-658177694-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1355877749" status: 202 len: 0 microversion: 2.1 time: 0.030489 Mar 26 21:26:50.161004 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2749/5762] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1355877749 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:26:58.027110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55929097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343139743", "security_groups": [{"name": "tempest-secgroup-smoke-1244663080"}], "block_device_mapping_v2": [{"uuid": "0bbb91d4-daf0-4273-8d8b-4c9431888ae4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7091f05e-f6df-41a5-b1c8-5c475ec2f5b4"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:26:58.205739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] validate_networks() for [('7091f05e-f6df-41a5-b1c8-5c475ec2f5b4', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:26:59.242768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:26:59.243396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:26:59.243736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:26:59.244196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:26:59.244637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:26:59.254659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:59.255689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:59.258689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:26:59.259165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:26:59.280597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:26:59.286893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Getting quotas for user 39d6d477fac5463a944d918490b7117f and project c621f87120ad402a9d52cf6426f0cf1f. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:26:59.349129 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:26:59.351261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bbb91d4-daf0-4273-8d8b-4c9431888ae4',volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:26:59.486386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa043602-883b-4b21-82b7-2afb03950dc9 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.465750 Mar 26 21:26:59.487639 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3014/5763] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:26:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:26:59.498343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aeca5c53-9efb-4afd-b9f4-d3de44a98b58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:26:59.499689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aeca5c53-9efb-4afd-b9f4-d3de44a98b58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:26:59.558223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aeca5c53-9efb-4afd-b9f4-d3de44a98b58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:26:59.567168 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aeca5c53-9efb-4afd-b9f4-d3de44a98b58 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1092 microversion: 2.1 time: 0.072545 Mar 26 21:26:59.569478 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2750/5764] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:26:59 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:00.587602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:00.589883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:00.597415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:00.598609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:00.600625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:00.601315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:00.722281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:00.734234 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a05cb04-cfdf-4d0c-a3ea-0f058a504204 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1198 microversion: 2.1 time: 0.153080 Mar 26 21:27:00.743965 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3015/5765] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:00 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1198 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:01.751068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:01.752457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:01.764665 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:01.768435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:01.772003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:01.775021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:02.039564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:02.053409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1d95d82d-b076-4be6-a5ad-d45fe126cf56 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1276 microversion: 2.1 time: 0.306566 Mar 26 21:27:02.065253 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2751/5766] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:01 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:02.773097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d4a593b5-ef4f-4eb7-b0e0-edeee05646a5 req-bebe9940-76d1-4337-a1b3-2b33806e20a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7adf46-4e81-4d66-b0f8-5742d93a404b", "tag": "eafe8959-a835-4ea4-8ff9-4dea6929f400"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:02.783561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d4a593b5-ef4f-4eb7-b0e0-edeee05646a5 req-bebe9940-76d1-4337-a1b3-2b33806e20a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:02.784328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d4a593b5-ef4f-4eb7-b0e0-edeee05646a5 req-bebe9940-76d1-4337-a1b3-2b33806e20a1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:02.813570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d4a593b5-ef4f-4eb7-b0e0-edeee05646a5 req-bebe9940-76d1-4337-a1b3-2b33806e20a1 service nova] Creating event network-changed:eafe8959-a835-4ea4-8ff9-4dea6929f400 for instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b on nch1-master-1 Mar 26 21:27:02.826929 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d4a593b5-ef4f-4eb7-b0e0-edeee05646a5 req-bebe9940-76d1-4337-a1b3-2b33806e20a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058238 Mar 26 21:27:02.828407 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3016/5767] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:03.071781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:03.073737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:03.081559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:03.090539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:03.091740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:03.094316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:03.370279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:03.378488 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4774ca84-6b94-413a-b859-7706585159d6 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.310541 Mar 26 21:27:03.379425 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2752/5768] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:03 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:04.398351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:04.399774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:04.408369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:04.409119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:04.410405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:04.411039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:04.688692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:04.703577 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2b46f73-23a0-406c-a508-fc2f9ec5c353 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.306043 Mar 26 21:27:04.711642 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3017/5769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:04 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:05.722340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:05.724068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:05.736057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:05.736897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:05.737907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:05.738360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:06.072523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:06.081104 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c19e88a-bf87-43c2-a433-583c28ce6840 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.363753 Mar 26 21:27:06.090675 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2753/5770] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:05 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:06.668950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:06.669740 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:27:06.669740 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:27:06.670909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:06.671374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:06.672225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:06.672746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:06.697774 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a55d148-1377-40a7-954c-323e03f7b6ae tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.175916 Mar 26 21:27:06.707846 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3018/5771] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Mar 26 21:27:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:06.838509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1342581139", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "96040088-769d-4ca9-a694-0db7b281db4c"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:06.899566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] validate_networks() for [('96040088-769d-4ca9-a694-0db7b281db4c', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:27:07.098073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:07.099188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:07.105711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:07.106191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:07.107274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:07.107732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:07.266824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:07.277274 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7f59711-2de8-4d46-8b20-3fea24b1cf6e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.183096 Mar 26 21:27:07.278791 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3019/5772] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:07 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:07.418978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:27:07.419409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:27:07.419890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:27:07.420337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:27:07.420763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:27:07.430147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:07.430606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:07.431411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:07.431858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:07.448862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Getting quotas for project 0458950035d548d8803ea0db9d8f1f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:27:07.454340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Getting quotas for user 2a332796519b45989490098bf7a44637 and project 0458950035d548d8803ea0db9d8f1f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:27:07.467029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:27:07.469282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:27:07.517320 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5836a313-c732-4d63-a715-d307d2ce2faf tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682956 Mar 26 21:27:07.517985 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2754/5773] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:27:07.527607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec71089f-52af-4725-abd6-966f43f117dc tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:07.528248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec71089f-52af-4725-abd6-966f43f117dc tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:07.596866 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec71089f-52af-4725-abd6-966f43f117dc tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1329 microversion: 2.1 time: 0.072936 Mar 26 21:27:07.597661 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3020/5774] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:07 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1329 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:08.296282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:08.296900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:08.303467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:08.303946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:08.304712 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:08.305154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:08.443699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:08.451841 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-822758af-943e-45dd-a764-2d0d76d82a76 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.160285 Mar 26 21:27:08.453127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2755/5775] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:08 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:08.614595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:08.615379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:08.626730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:08.627210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:08.628066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:08.628915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:08.744615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b32802f-184d-40c8-b62e-03188d7f8fb8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1424 microversion: 2.1 time: 0.134038 Mar 26 21:27:08.755546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3021/5776] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:08 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1424 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:09.468747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:09.477115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:09.484673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:09.485387 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:09.486355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:09.487031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:09.626559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c0e450f0-2b60-4ea8-a587-cb5aa07f27e3 req-9273e5df-f65a-4c9a-9029-96db3a953652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7adf46-4e81-4d66-b0f8-5742d93a404b", "name": "network-vif-plugged", "status": "completed", "tag": "eafe8959-a835-4ea4-8ff9-4dea6929f400"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:09.635958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:09.636188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c0e450f0-2b60-4ea8-a587-cb5aa07f27e3 req-9273e5df-f65a-4c9a-9029-96db3a953652 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:09.637465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c0e450f0-2b60-4ea8-a587-cb5aa07f27e3 req-9273e5df-f65a-4c9a-9029-96db3a953652 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:09.644101 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-65785f09-4c53-45f3-ad94-615759bbd552 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.179303 Mar 26 21:27:09.644701 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2756/5777] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:09 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:27:09.656606 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c0e450f0-2b60-4ea8-a587-cb5aa07f27e3 req-9273e5df-f65a-4c9a-9029-96db3a953652 service nova] Creating event network-vif-plugged:eafe8959-a835-4ea4-8ff9-4dea6929f400 for instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b on nch1-master-1 Mar 26 21:27:09.662742 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c0e450f0-2b60-4ea8-a587-cb5aa07f27e3 req-9273e5df-f65a-4c9a-9029-96db3a953652 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039961 Mar 26 21:27:09.663351 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3022/5778] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:27:09.788765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:09.789519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:09.814073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:09.814652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:09.816879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:09.833718 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:10.076692 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b9e0e42-6a77-495e-9357-256023c9351d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.318155 Mar 26 21:27:10.095372 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2757/5779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:09 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:10.115698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-afec8cd5-8975-4d64-9c39-cd6e95872a72 req-a752fa1a-9928-4564-9808-1fb68ad3b7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25bcb605-7095-4b7d-b140-91acf2b10db9", "tag": "4ab9cd42-bddc-414f-afcd-052060378093"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:10.126944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-afec8cd5-8975-4d64-9c39-cd6e95872a72 req-a752fa1a-9928-4564-9808-1fb68ad3b7bb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:10.127696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-afec8cd5-8975-4d64-9c39-cd6e95872a72 req-a752fa1a-9928-4564-9808-1fb68ad3b7bb service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:10.140137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-afec8cd5-8975-4d64-9c39-cd6e95872a72 req-a752fa1a-9928-4564-9808-1fb68ad3b7bb service nova] Creating event network-changed:4ab9cd42-bddc-414f-afcd-052060378093 for instance 25bcb605-7095-4b7d-b140-91acf2b10db9 on nch1-master-1 Mar 26 21:27:10.146588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-afec8cd5-8975-4d64-9c39-cd6e95872a72 req-a752fa1a-9928-4564-9808-1fb68ad3b7bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Mar 26 21:27:10.147801 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3023/5780] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:10.661186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:10.661775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:10.668775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:10.669231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:10.670017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:10.670601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:10.823045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:10.831485 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1114f3bc-add1-427f-b7fb-d6795078c7c3 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1264 microversion: 2.1 time: 0.174703 Mar 26 21:27:10.832545 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2758/5781] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:10 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:11.095079 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:11.096433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:11.103489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:11.103979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:11.104782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:11.105248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:11.377957 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85ec65fe-459c-413d-8258-15f4a5d55df8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.286965 Mar 26 21:27:11.378535 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3024/5782] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:11 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:11.848279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:11.848808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:11.855540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:11.856024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:11.856794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:11.857239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:11.997626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:12.005041 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d97d2316-0b6d-4405-b1b2-7cace2aab527 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1450 microversion: 2.1 time: 0.160764 Mar 26 21:27:12.005638 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2759/5783] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:11 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:12.021305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:12.021972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:12.028015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:12.028492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:12.029283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:12.029748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:12.163517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:27:12.170918 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fdac00a4-0087-4889-b935-53eeda1c25d8 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1450 microversion: 2.1 time: 0.153675 Mar 26 21:27:12.171491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3025/5784] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:12 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:12.395130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:12.396332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:12.402633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:12.403076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:12.403856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:12.404563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:12.546217 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b177c340-75af-4a46-8590-a74aba016c78 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.154775 Mar 26 21:27:12.555286 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2760/5785] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:12 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:13.563419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:13.566510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:13.572375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:13.573071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:13.574190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:13.574820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:13.862180 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c3369e70-7cc3-46b0-afcb-1f20d06b3bde tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.303181 Mar 26 21:27:13.862894 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3026/5786] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:13 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:14.073770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3d787e5a-5d2b-4772-a842-2f1e0243d810 req-9cd3bb6a-3390-4ff0-a572-7cbb4d3d2626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7adf46-4e81-4d66-b0f8-5742d93a404b", "tag": "eafe8959-a835-4ea4-8ff9-4dea6929f400"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:14.083966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d787e5a-5d2b-4772-a842-2f1e0243d810 req-9cd3bb6a-3390-4ff0-a572-7cbb4d3d2626 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:14.084437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3d787e5a-5d2b-4772-a842-2f1e0243d810 req-9cd3bb6a-3390-4ff0-a572-7cbb4d3d2626 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:14.095458 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3d787e5a-5d2b-4772-a842-2f1e0243d810 req-9cd3bb6a-3390-4ff0-a572-7cbb4d3d2626 service nova] Creating event network-changed:eafe8959-a835-4ea4-8ff9-4dea6929f400 for instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b on nch1-master-1 Mar 26 21:27:14.100541 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3d787e5a-5d2b-4772-a842-2f1e0243d810 req-9cd3bb6a-3390-4ff0-a572-7cbb4d3d2626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030796 Mar 26 21:27:14.101303 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2761/5787] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:14.878778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:14.879516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:14.887801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:14.888445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:14.889269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:14.889836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:15.051564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f06e9c10-82a2-4e01-834e-3dde821875f5 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.176665 Mar 26 21:27:15.052183 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3027/5788] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:14 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:15.325124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-096bc469-5d28-48d5-a147-c44d6e8534a4 req-dea89333-93e0-4225-829e-b526354f1f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bcb605-7095-4b7d-b140-91acf2b10db9", "name": "network-vif-plugged", "status": "completed", "tag": "4ab9cd42-bddc-414f-afcd-052060378093"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:15.334418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-096bc469-5d28-48d5-a147-c44d6e8534a4 req-dea89333-93e0-4225-829e-b526354f1f55 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:15.334878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-096bc469-5d28-48d5-a147-c44d6e8534a4 req-dea89333-93e0-4225-829e-b526354f1f55 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:15.346156 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-096bc469-5d28-48d5-a147-c44d6e8534a4 req-dea89333-93e0-4225-829e-b526354f1f55 service nova] Creating event network-vif-plugged:4ab9cd42-bddc-414f-afcd-052060378093 for instance 25bcb605-7095-4b7d-b140-91acf2b10db9 on nch1-master-1 Mar 26 21:27:15.351136 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-096bc469-5d28-48d5-a147-c44d6e8534a4 req-dea89333-93e0-4225-829e-b526354f1f55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Mar 26 21:27:15.351996 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2762/5789] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:16.069337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:16.070160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:16.076970 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:16.077440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:16.078263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:16.078731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:16.217904 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d7c81699-ff5d-4016-9584-69b3ad752f9b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1464 microversion: 2.1 time: 0.152350 Mar 26 21:27:16.218529 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3028/5790] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:16 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:17.237235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:17.237933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:17.245746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.246200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.246966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.247407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.375594 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ecf6c1e4-c4cf-4990-91fc-96fc04129a28 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1650 microversion: 2.1 time: 0.143219 Mar 26 21:27:17.376196 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2763/5791] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:17 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:17.391376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:17.392054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:17.398933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.399406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.400229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.400690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.549875 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24834da7-8bd3-4390-9688-6f65793e1203 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1650 microversion: 2.1 time: 0.162107 Mar 26 21:27:17.550579 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3029/5792] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:17 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1650 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:17.566381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:17.566986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:17.572951 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.573451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.574168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:17.574603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:17.714828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-48783420-805c-4402-ac9e-e0ff33eec593 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1650 microversion: 2.1 time: 0.152056 Mar 26 21:27:17.715404 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2764/5793] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:17 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1650 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:17.772554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1197761434", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "96040088-769d-4ca9-a694-0db7b281db4c"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:17.838689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] validate_networks() for [('96040088-769d-4ca9-a694-0db7b281db4c', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:27:18.229196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:27:18.229655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:27:18.230153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:27:18.230588 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:27:18.231025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:27:18.240949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:18.241424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:18.242283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:18.242753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:18.260218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Getting quotas for project 0458950035d548d8803ea0db9d8f1f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:27:18.265495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Getting quotas for user 2a332796519b45989490098bf7a44637 and project 0458950035d548d8803ea0db9d8f1f3e. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:27:18.278399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:27:18.280746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:27:18.325003 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-087eea1a-f1ef-41d3-a334-7d098755a06a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556971 Mar 26 21:27:18.325653 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3030/5794] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:27:18.336034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a92147d1-6a99-4928-a834-e313e7e4075f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:18.336652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a92147d1-6a99-4928-a834-e313e7e4075f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:18.399093 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a92147d1-6a99-4928-a834-e313e7e4075f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1329 microversion: 2.1 time: 0.067282 Mar 26 21:27:18.399681 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2765/5795] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:18 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:19.417788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:19.418556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:19.425770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:19.426302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:19.427212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:19.427798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:19.504440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33dcea46-f9ab-4f0d-ba8f-5217b247adbb tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1422 microversion: 2.1 time: 0.091265 Mar 26 21:27:19.505746 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3031/5796] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:19 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:20.522004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:20.522837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:20.530944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:20.531403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:20.532217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:20.532666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:20.632325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8fa16c10-fd5c-49aa-90f1-8aba4aa66009 req-9d12e7b8-458e-45b0-af59-0dd756b63944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e103b0-f1dd-4507-aae7-99c74c4ec652", "tag": "5cd5c6e7-acbd-4f2e-b272-9488dbe737b2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:20.646534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8fa16c10-fd5c-49aa-90f1-8aba4aa66009 req-9d12e7b8-458e-45b0-af59-0dd756b63944 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:20.647606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8fa16c10-fd5c-49aa-90f1-8aba4aa66009 req-9d12e7b8-458e-45b0-af59-0dd756b63944 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:20.662700 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8fa16c10-fd5c-49aa-90f1-8aba4aa66009 req-9d12e7b8-458e-45b0-af59-0dd756b63944 service nova] Creating event network-changed:5cd5c6e7-acbd-4f2e-b272-9488dbe737b2 for instance a6e103b0-f1dd-4507-aae7-99c74c4ec652 on nch2-master-1 Mar 26 21:27:20.668816 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8fa16c10-fd5c-49aa-90f1-8aba4aa66009 req-9d12e7b8-458e-45b0-af59-0dd756b63944 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050290 Mar 26 21:27:20.670460 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3032/5797] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:27:20.696274 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6750117d-a1b1-459f-ba98-cea12b33237f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.177849 Mar 26 21:27:20.697052 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2766/5798] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:20 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:21.713572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:21.714297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:21.721340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:21.721817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:21.722608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:21.723069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:21.857277 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a56d47b-fd76-4c9e-9cea-898b944de5e3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.147740 Mar 26 21:27:21.857865 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3033/5799] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:21 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:22.874956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:22.875565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:22.886620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:22.886620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:22.886620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:22.886620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:23.012436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4af53dcf-1e17-40fd-8d22-1d0f9ad5eba8 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.141543 Mar 26 21:27:23.013027 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2767/5800] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:22 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:27:24.029733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:24.030368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:24.037455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:24.038185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:24.039306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:24.039809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:24.280313 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9ff0895a-eecf-46ce-a642-69c86d5aaad7 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.254219 Mar 26 21:27:24.280908 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3034/5801] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:24 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:25.297025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:25.297555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:25.304414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:25.304860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:25.305625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:25.306073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:25.432388 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2b760477-cf27-434c-8265-495f93494f5b tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.139052 Mar 26 21:27:25.432964 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2768/5802] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:25 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:26.158424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-836b6197-9e27-4da5-ab42-47f5c718dcf2 req-c58ece52-4d63-498c-a59d-ab7e674f3016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e103b0-f1dd-4507-aae7-99c74c4ec652", "name": "network-vif-plugged", "status": "completed", "tag": "5cd5c6e7-acbd-4f2e-b272-9488dbe737b2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:26.186869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-836b6197-9e27-4da5-ab42-47f5c718dcf2 req-c58ece52-4d63-498c-a59d-ab7e674f3016 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:26.187425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-836b6197-9e27-4da5-ab42-47f5c718dcf2 req-c58ece52-4d63-498c-a59d-ab7e674f3016 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:26.202547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-836b6197-9e27-4da5-ab42-47f5c718dcf2 req-c58ece52-4d63-498c-a59d-ab7e674f3016 service nova] Creating event network-vif-plugged:5cd5c6e7-acbd-4f2e-b272-9488dbe737b2 for instance a6e103b0-f1dd-4507-aae7-99c74c4ec652 on nch2-master-1 Mar 26 21:27:26.208453 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-836b6197-9e27-4da5-ab42-47f5c718dcf2 req-c58ece52-4d63-498c-a59d-ab7e674f3016 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053655 Mar 26 21:27:26.209079 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3035/5803] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:27:26.449274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:26.450203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:26.456726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:26.457190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:26.457971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:26.458415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:26.590715 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8939d968-55bd-46d4-9091-55e02d21d84a tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1464 microversion: 2.1 time: 0.145279 Mar 26 21:27:26.591282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2769/5804] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:26 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:27.608988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:27.609703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:27.615983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.617032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:27.617834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.618292 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:27.750185 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f79ece8f-6fd1-4d73-b008-3b92e1746806 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1649 microversion: 2.1 time: 0.146183 Mar 26 21:27:27.750776 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3036/5805] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:27 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1649 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:27.766289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:27.766904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:27.773839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.774304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:27.775118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.775569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:27.903965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4235a1e-82ca-4fd8-84a2-69bd2e94f314 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1649 microversion: 2.1 time: 0.141656 Mar 26 21:27:27.904551 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2770/5806] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:27 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:27.920404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:27.921102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:27.927049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.927512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:27.928316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:27.928767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:28.061296 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7146fe95-c63e-4337-af09-6a6d372e394f tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1649 microversion: 2.1 time: 0.144558 Mar 26 21:27:28.061873 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3037/5807] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:27 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1649 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:28.077231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:28.077805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:28.084139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:28.084599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:28.085855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:28.086298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:28.110505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:27:28.182389 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7967c26f-a5bc-47eb-9fec-7efdab574c85 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 204 len: 0 microversion: 2.1 time: 0.108850 Mar 26 21:27:28.183229 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2771/5808] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:27:28 2022] DELETE /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:27:28.191937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:28.192607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:28.199372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:28.199850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:28.200749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:28.201215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:28.327737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5b3aaff-a8e7-4d68-850d-e4f539c3b7a3 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1655 microversion: 2.1 time: 0.139925 Mar 26 21:27:28.328349 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3038/5809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:28 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:29.346166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:29.346879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:29.354238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:29.354703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:29.355489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:29.355947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:29.490708 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a842310b-ffc4-4f6d-a090-3f4baf3ab106 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 200 len: 1655 microversion: 2.1 time: 0.148850 Mar 26 21:27:29.491301 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2772/5810] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:29 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:29.916650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d02c684b-1118-45a5-b3cb-b95466493063 req-9cdf71a7-8a91-436a-b943-f6eb35c55007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e103b0-f1dd-4507-aae7-99c74c4ec652", "name": "network-vif-deleted", "tag": "5cd5c6e7-acbd-4f2e-b272-9488dbe737b2"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:29.926487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d02c684b-1118-45a5-b3cb-b95466493063 req-9cdf71a7-8a91-436a-b943-f6eb35c55007 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:29.926960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d02c684b-1118-45a5-b3cb-b95466493063 req-9cdf71a7-8a91-436a-b943-f6eb35c55007 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:29.942382 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d02c684b-1118-45a5-b3cb-b95466493063 req-9cdf71a7-8a91-436a-b943-f6eb35c55007 service nova] Creating event network-vif-deleted:5cd5c6e7-acbd-4f2e-b272-9488dbe737b2 for instance a6e103b0-f1dd-4507-aae7-99c74c4ec652 on nch2-master-1 Mar 26 21:27:29.948299 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d02c684b-1118-45a5-b3cb-b95466493063 req-9cdf71a7-8a91-436a-b943-f6eb35c55007 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Mar 26 21:27:29.949153 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3039/5811] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:27:30.508410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:30.509061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: a6e103b0-f1dd-4507-aae7-99c74c4ec652] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:30.515894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.516366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.517378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.517819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.531345 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] HTTP exception thrown: Instance a6e103b0-f1dd-4507-aae7-99c74c4ec652 could not be found. Mar 26 21:27:30.531956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Returning 404 to user: Instance a6e103b0-f1dd-4507-aae7-99c74c4ec652 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:27:30.532770 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87192efc-a824-401b-af4c-edd00d875fe1 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652" status: 404 len: 111 microversion: 2.1 time: 0.028341 Mar 26 21:27:30.533302 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2773/5812] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:30 2022] GET /compute/v2.1/servers/a6e103b0-f1dd-4507-aae7-99c74c4ec652 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:27:30.544118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:30.544875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:30.551432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.551903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.552730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.553182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.576804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:27:30.655183 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0d5cf73c-fea3-45ee-8d2b-ca1da4f71c5d tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 204 len: 0 microversion: 2.1 time: 0.116532 Mar 26 21:27:30.655782 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3040/5813] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:27:30 2022] DELETE /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:27:30.665180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:30.665805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:30.673510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.673966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.674739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:30.675184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:30.806431 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c4b6e3d4-e597-4dd5-8ad4-65c8a8e01228 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1656 microversion: 2.1 time: 0.146064 Mar 26 21:27:30.807247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2774/5814] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:30 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:31.824633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:31.825350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:31.833078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:31.833550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:31.834338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:31.834798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:31.969703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a827052-9074-4bcc-97ef-461612d5c500 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1656 microversion: 2.1 time: 0.149112 Mar 26 21:27:31.970280 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3041/5815] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:31 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:32.865342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2535d657-d2b0-4be3-a791-09ebcd243352 req-62b8bf02-bca5-47da-acc0-994a91e51e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bcb605-7095-4b7d-b140-91acf2b10db9", "name": "network-vif-deleted", "tag": "4ab9cd42-bddc-414f-afcd-052060378093"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:27:32.875466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2535d657-d2b0-4be3-a791-09ebcd243352 req-62b8bf02-bca5-47da-acc0-994a91e51e4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:32.875950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2535d657-d2b0-4be3-a791-09ebcd243352 req-62b8bf02-bca5-47da-acc0-994a91e51e4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:32.890854 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2535d657-d2b0-4be3-a791-09ebcd243352 req-62b8bf02-bca5-47da-acc0-994a91e51e4e service nova] Creating event network-vif-deleted:4ab9cd42-bddc-414f-afcd-052060378093 for instance 25bcb605-7095-4b7d-b140-91acf2b10db9 on nch1-master-1 Mar 26 21:27:32.899608 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2535d657-d2b0-4be3-a791-09ebcd243352 req-62b8bf02-bca5-47da-acc0-994a91e51e4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038131 Mar 26 21:27:32.900264 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2775/5816] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:27:32.988563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:32.989838 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:32.998880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:32.999362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:33.000266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:33.000851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:33.031417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:33.031887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:33.032381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lazy-loading 'fault' on Instance uuid 25bcb605-7095-4b7d-b140-91acf2b10db9 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:27:33.079166 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-580cdb41-f498-4f8a-8781-09a9fdd51156 tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 200 len: 1454 microversion: 2.1 time: 0.094485 Mar 26 21:27:33.079683 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3042/5817] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:32 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:27:34.096620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:27:34.097353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] [instance: 25bcb605-7095-4b7d-b140-91acf2b10db9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:27:34.104528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:34.104984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:34.105750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:27:34.106218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:27:34.119442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] HTTP exception thrown: Instance 25bcb605-7095-4b7d-b140-91acf2b10db9 could not be found. Mar 26 21:27:34.120053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] Returning 404 to user: Instance 25bcb605-7095-4b7d-b140-91acf2b10db9 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:27:34.120864 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4eba9936-0cdc-4f63-a8d0-d6398fe1937e tempest-TestServerMultinode-2047479086 tempest-TestServerMultinode-2047479086-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9" status: 404 len: 111 microversion: 2.1 time: 0.028406 Mar 26 21:27:34.121398 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2776/5818] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:27:34 2022] GET /compute/v2.1/servers/25bcb605-7095-4b7d-b140-91acf2b10db9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:28:18.630922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Action: 'create', calling method: .version_select at 0x7f6e594eaaf0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-958369899"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:18.645404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for project d7d600597d044d62bfa72df67a61c0bb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:28:18.650484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for user d2954748f375411b87550803a8b2d3ad and project d7d600597d044d62bfa72df67a61c0bb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:28:18.857015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for project d7d600597d044d62bfa72df67a61c0bb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:28:18.862697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for user d2954748f375411b87550803a8b2d3ad and project d7d600597d044d62bfa72df67a61c0bb. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:28:18.879793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c059d010-9954-4c00-956a-ba133afbbae1 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.252832 Mar 26 21:28:18.880446 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3043/5819] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:28:18 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:19.843045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1889690499", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bfbd40d8-0fc0-42c7-a34d-717f8a141508", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-958369899", "security_groups": [{"name": "tempest-secgroup-smoke-1252106748"}], "networks": [{"uuid": "62e2173f-7be1-40ba-875d-2bef3cdb4b72"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:19.959024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] validate_networks() for [('62e2173f-7be1-40ba-875d-2bef3cdb4b72', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:28:20.332190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:28:20.332616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:28:20.333116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:28:20.333525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:28:20.333957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:28:20.342903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:20.343364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:20.344212 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:20.344648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:20.361816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for project d7d600597d044d62bfa72df67a61c0bb. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:28:20.367065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Getting quotas for user d2954748f375411b87550803a8b2d3ad and project d7d600597d044d62bfa72df67a61c0bb. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:28:20.424601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:28:20.426938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfbd40d8-0fc0-42c7-a34d-717f8a141508',volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:28:20.550729 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e18fa66-9a3b-46d2-8dd2-12a2e171baad tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711947 Mar 26 21:28:20.551367 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2777/5820] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:28:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:28:20.561466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ecc31cf0-4e73-4a3c-a2ac-c8ec1aa1ff9f tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:20.562245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ecc31cf0-4e73-4a3c-a2ac-c8ec1aa1ff9f tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:20.621784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ecc31cf0-4e73-4a3c-a2ac-c8ec1aa1ff9f tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:20.629803 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ecc31cf0-4e73-4a3c-a2ac-c8ec1aa1ff9f tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1098 microversion: 2.1 time: 0.072385 Mar 26 21:28:20.630374 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3044/5821] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:20 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1098 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:21.647183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:21.647800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:21.655872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:21.656353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:21.657413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:21.657849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:21.732856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:21.742249 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af1a4d6e-6aa3-4f4c-b703-548acb3fd471 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1214 microversion: 2.1 time: 0.099091 Mar 26 21:28:21.743067 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2778/5822] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:21 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:22.762479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:22.763118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:22.771667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:22.772172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:22.773700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:22.774368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:23.019673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:23.034014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-24d62050-e4d4-4d60-82c9-aa0346ed191b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.275372 Mar 26 21:28:23.034620 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3045/5823] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:22 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:23.146192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9184762a-be1d-42fd-a99b-c5c6fe5ed430 req-ecc6f63c-f737-4fe3-9576-72394189a283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:23.165579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9184762a-be1d-42fd-a99b-c5c6fe5ed430 req-ecc6f63c-f737-4fe3-9576-72394189a283 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:23.166117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9184762a-be1d-42fd-a99b-c5c6fe5ed430 req-ecc6f63c-f737-4fe3-9576-72394189a283 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:23.185414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9184762a-be1d-42fd-a99b-c5c6fe5ed430 req-ecc6f63c-f737-4fe3-9576-72394189a283 service nova] Creating event network-changed:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:28:23.193289 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9184762a-be1d-42fd-a99b-c5c6fe5ed430 req-ecc6f63c-f737-4fe3-9576-72394189a283 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057261 Mar 26 21:28:23.194629 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2779/5824] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:28:24.054289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:24.056200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:24.065529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:24.066245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:24.067221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:24.067846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:24.275575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:24.284959 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-381f3c89-b960-4f6e-9bbd-a15a61a89105 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.236188 Mar 26 21:28:24.286064 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3046/5825] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:24 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:25.303242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:25.303961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:25.311658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:25.312152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:25.312939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:25.313392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:25.445829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:25.453666 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40bd6b27-239c-4b67-a01a-bd7ec9974bed tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.154940 Mar 26 21:28:25.454244 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2780/5826] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:25 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:26.472343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:26.473000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:26.479741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:26.480246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:26.481023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:26.481476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:26.619352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:26.627110 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4826fc11-259b-45ba-834c-e2f53c739af4 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.158749 Mar 26 21:28:26.627687 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3047/5827] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:26 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:27.643626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:27.644288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:27.650805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:27.651266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:27.652071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:27.652517 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:27.787329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:27.794846 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e7e70a62-1de8-4ce9-90e1-c186e94a1276 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.155176 Mar 26 21:28:27.797083 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2781/5828] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:27 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:28.813579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:28.814118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:28.821020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:28.821498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:28.822319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:28.822782 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:28.959447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:28.966873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ff34910-e88e-4dc7-bf43-5cb8ea1ba4d8 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.157948 Mar 26 21:28:28.967499 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3048/5829] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:28 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:29.983943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:29.984555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:29.991290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:29.991746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:29.992540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:29.993008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:30.130610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:30.138040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b202c0f-d1bd-4e62-b2dd-1ae79b870702 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.158178 Mar 26 21:28:30.138608 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2782/5830] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:29 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:30.342279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-86634048-152d-4fa8-b818-55eb48deb0b5 req-f8b3471d-3522-4a10-aea9-37b6332720e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "name": "network-vif-plugged", "status": "completed", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:30.351521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86634048-152d-4fa8-b818-55eb48deb0b5 req-f8b3471d-3522-4a10-aea9-37b6332720e6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:30.351945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86634048-152d-4fa8-b818-55eb48deb0b5 req-f8b3471d-3522-4a10-aea9-37b6332720e6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:30.363061 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-86634048-152d-4fa8-b818-55eb48deb0b5 req-f8b3471d-3522-4a10-aea9-37b6332720e6 service nova] Creating event network-vif-plugged:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:28:30.368486 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-86634048-152d-4fa8-b818-55eb48deb0b5 req-f8b3471d-3522-4a10-aea9-37b6332720e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029766 Mar 26 21:28:30.369517 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3049/5831] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:28:31.155432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:31.156603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:31.163455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:31.164208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:31.164992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:31.165445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:31.303322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:31.310770 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2e755535-f18a-4806-b430-53b6997a7412 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1270 microversion: 2.1 time: 0.159267 Mar 26 21:28:31.311392 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2783/5832] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:31 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:32.329879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:32.330635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:32.336926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:32.337398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:32.338184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:32.338642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:32.471212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:32.478722 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd1565cd-6c4b-4c1f-8b81-0fe2b2540f79 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1459 microversion: 2.1 time: 0.154580 Mar 26 21:28:32.479298 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3050/5833] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:32 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:32.494864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:28:32.495494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:28:32.502954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:32.503417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:32.504288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:32.504760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:32.637351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:28:32.647618 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-250c3d4d-40f1-4d0a-9c1c-2baf05885b20 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1459 microversion: 2.1 time: 0.156649 Mar 26 21:28:32.648449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2784/5834] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:28:32 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:28:34.681241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b87451ed-60a5-4315-bc18-02f926ae4fbf req-1b713283-6b01-47a0-a75d-08610f32217e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:34.690773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b87451ed-60a5-4315-bc18-02f926ae4fbf req-1b713283-6b01-47a0-a75d-08610f32217e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:34.691876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b87451ed-60a5-4315-bc18-02f926ae4fbf req-1b713283-6b01-47a0-a75d-08610f32217e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:34.706542 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b87451ed-60a5-4315-bc18-02f926ae4fbf req-1b713283-6b01-47a0-a75d-08610f32217e service nova] Creating event network-changed:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:28:34.712080 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b87451ed-60a5-4315-bc18-02f926ae4fbf req-1b713283-6b01-47a0-a75d-08610f32217e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Mar 26 21:28:34.712771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3051/5835] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:28:36.098709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-370b34c8-c81c-432c-babb-ade1b2b360eb req-9bc147a8-7fd5-4141-a1df-f13bbb40681e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:36.114793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-370b34c8-c81c-432c-babb-ade1b2b360eb req-9bc147a8-7fd5-4141-a1df-f13bbb40681e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:36.115570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-370b34c8-c81c-432c-babb-ade1b2b360eb req-9bc147a8-7fd5-4141-a1df-f13bbb40681e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:36.135627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-370b34c8-c81c-432c-babb-ade1b2b360eb req-9bc147a8-7fd5-4141-a1df-f13bbb40681e service nova] Creating event network-changed:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:28:36.143489 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-370b34c8-c81c-432c-babb-ade1b2b360eb req-9bc147a8-7fd5-4141-a1df-f13bbb40681e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055036 Mar 26 21:28:36.144130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2785/5836] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:28:38.160016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-275601c9-7cb0-49da-8938-7762f131e515 req-13b89e5e-8150-4f4a-838a-efb50375fd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:28:38.168499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-275601c9-7cb0-49da-8938-7762f131e515 req-13b89e5e-8150-4f4a-838a-efb50375fd6a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:28:38.168965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-275601c9-7cb0-49da-8938-7762f131e515 req-13b89e5e-8150-4f4a-838a-efb50375fd6a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:28:38.182367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-275601c9-7cb0-49da-8938-7762f131e515 req-13b89e5e-8150-4f4a-838a-efb50375fd6a service nova] Creating event network-changed:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:28:38.187377 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-275601c9-7cb0-49da-8938-7762f131e515 req-13b89e5e-8150-4f4a-838a-efb50375fd6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032971 Mar 26 21:28:38.188295 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3052/5837] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:03.499088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b10815a8-0b74-49fe-8bf7-5f64ab1ae9d7 req-6db152b0-5e41-43c1-884d-43d0b0e0ba41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7adf46-4e81-4d66-b0f8-5742d93a404b", "tag": "eafe8959-a835-4ea4-8ff9-4dea6929f400"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:03.504258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:03.504864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:03.512117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:03.512585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:03.513408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:03.513913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:03.514817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b10815a8-0b74-49fe-8bf7-5f64ab1ae9d7 req-6db152b0-5e41-43c1-884d-43d0b0e0ba41 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:03.515290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b10815a8-0b74-49fe-8bf7-5f64ab1ae9d7 req-6db152b0-5e41-43c1-884d-43d0b0e0ba41 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:03.526526 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b10815a8-0b74-49fe-8bf7-5f64ab1ae9d7 req-6db152b0-5e41-43c1-884d-43d0b0e0ba41 service nova] Creating event network-changed:eafe8959-a835-4ea4-8ff9-4dea6929f400 for instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b on nch1-master-1 Mar 26 21:29:03.532564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b10815a8-0b74-49fe-8bf7-5f64ab1ae9d7 req-6db152b0-5e41-43c1-884d-43d0b0e0ba41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038173 Mar 26 21:29:03.533407 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3053/5838] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:03.544855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:29:03.640421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-480f8c7f-e780-40b7-9811-2314c31b3950 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 204 len: 0 microversion: 2.1 time: 0.149484 Mar 26 21:29:03.641316 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2786/5839] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:29:03 2022] DELETE /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 21:29:03.651141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:03.652032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:03.661058 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:03.661878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:03.662734 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:03.663268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:04.228211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:04.237349 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3de1b514-6efb-45e3-9d75-fe08a9d58a6f tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1574 microversion: 2.1 time: 0.591043 Mar 26 21:29:04.238257 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3054/5840] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:03 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1574 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:05.256103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:05.256861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:05.263710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:05.264202 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:05.265036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:05.265500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:05.269228 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:29:05.270714 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b (ip 10.222.0.16) !!! Mar 26 21:29:05.406907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:05.415698 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3229edcd-aa7a-4d93-9384-d1502265bf07 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1456 microversion: 2.1 time: 0.163661 Mar 26 21:29:05.416617 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2787/5841] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:05 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1456 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:05.937379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-07820136-e51a-4335-82e3-a5c1356a6c73 req-29eac247-e1e0-41b6-b273-43660724b418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7adf46-4e81-4d66-b0f8-5742d93a404b", "name": "network-vif-deleted", "tag": "eafe8959-a835-4ea4-8ff9-4dea6929f400"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:05.949274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-07820136-e51a-4335-82e3-a5c1356a6c73 req-29eac247-e1e0-41b6-b273-43660724b418 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:05.950021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-07820136-e51a-4335-82e3-a5c1356a6c73 req-29eac247-e1e0-41b6-b273-43660724b418 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:05.962683 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-07820136-e51a-4335-82e3-a5c1356a6c73 req-29eac247-e1e0-41b6-b273-43660724b418 service nova] Creating event network-vif-deleted:eafe8959-a835-4ea4-8ff9-4dea6929f400 for instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b on nch1-master-1 Mar 26 21:29:05.968430 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-07820136-e51a-4335-82e3-a5c1356a6c73 req-29eac247-e1e0-41b6-b273-43660724b418 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035051 Mar 26 21:29:05.969045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3055/5842] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:06.434770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:06.436165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:06.444270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:06.445032 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:06.445832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:06.446327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:06.482079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:06.482469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:06.482975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lazy-loading 'fault' on Instance uuid 1e7adf46-4e81-4d66-b0f8-5742d93a404b {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:29:06.537378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:06.547952 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36eeb0b2-2f61-423b-8480-45bf587d912a tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 200 len: 1228 microversion: 2.1 time: 0.118176 Mar 26 21:29:06.548700 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2788/5843] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:06 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:07.566680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:07.567383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 1e7adf46-4e81-4d66-b0f8-5742d93a404b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:07.573823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:07.574291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:07.575105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:07.576092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:07.589954 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b could not be found. Mar 26 21:29:07.590572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 1e7adf46-4e81-4d66-b0f8-5742d93a404b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:29:07.592164 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f04e9124-4e7d-45fb-a7c5-e886047509fc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b" status: 404 len: 111 microversion: 2.1 time: 0.030625 Mar 26 21:29:07.592931 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3056/5844] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:07 2022] GET /compute/v2.1/servers/1e7adf46-4e81-4d66-b0f8-5742d93a404b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:29:17.540057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:17.540707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:17.543733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8689458d-0606-4dde-aacd-31ed8bb881d0 req-999f0346-ce7b-4778-b9ff-a2f425994d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:17.550160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:17.551176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:17.551441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:17.551993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:17.556247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8689458d-0606-4dde-aacd-31ed8bb881d0 req-999f0346-ce7b-4778-b9ff-a2f425994d65 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:17.556868 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8689458d-0606-4dde-aacd-31ed8bb881d0 req-999f0346-ce7b-4778-b9ff-a2f425994d65 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:17.571580 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8689458d-0606-4dde-aacd-31ed8bb881d0 req-999f0346-ce7b-4778-b9ff-a2f425994d65 service nova] Creating event network-changed:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:29:17.578946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8689458d-0606-4dde-aacd-31ed8bb881d0 req-999f0346-ce7b-4778-b9ff-a2f425994d65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041163 Mar 26 21:29:17.579862 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3057/5845] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:17.584691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:29:17.681332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7587908e-96b6-46e4-8090-3568f7b6bdef tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 204 len: 0 microversion: 2.1 time: 0.146046 Mar 26 21:29:17.682732 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2789/5846] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:29:17 2022] DELETE /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:29:17.693678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:17.694845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:17.702154 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:17.703144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:17.705066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:17.705741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:17.883692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:17.894922 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d57cf7a5-ea25-4de1-9f13-7c803742e455 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1582 microversion: 2.1 time: 0.206573 Mar 26 21:29:17.895560 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3058/5847] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:17 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1582 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:18.915398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:18.916293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:18.923543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:18.924029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:18.924804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:18.925248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:19.063356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:19.070792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98ab370b-d16b-4b6c-aef5-b5b29cebc426 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1465 microversion: 2.1 time: 0.159867 Mar 26 21:29:19.071362 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2790/5848] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:18 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:19.717778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2634ee90-29fc-490f-bd2d-7bb8d6c20826 req-c2898c34-ef0c-4389-9dfe-3ffaff7be656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd186e60-c44e-4bad-88ee-e96ed400c67a", "name": "network-vif-deleted", "tag": "96a8ac15-3ec8-4462-b742-a0a005501c03"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:19.728259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2634ee90-29fc-490f-bd2d-7bb8d6c20826 req-c2898c34-ef0c-4389-9dfe-3ffaff7be656 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:19.728751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2634ee90-29fc-490f-bd2d-7bb8d6c20826 req-c2898c34-ef0c-4389-9dfe-3ffaff7be656 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:19.741386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2634ee90-29fc-490f-bd2d-7bb8d6c20826 req-c2898c34-ef0c-4389-9dfe-3ffaff7be656 service nova] Creating event network-vif-deleted:96a8ac15-3ec8-4462-b742-a0a005501c03 for instance dd186e60-c44e-4bad-88ee-e96ed400c67a on nch2-master-1 Mar 26 21:29:19.747091 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2634ee90-29fc-490f-bd2d-7bb8d6c20826 req-c2898c34-ef0c-4389-9dfe-3ffaff7be656 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Mar 26 21:29:19.747881 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3059/5849] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:20.087872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:20.088661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:20.095639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:20.096143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:20.096926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:20.097370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:20.130891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:20.131343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:20.131802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lazy-loading 'fault' on Instance uuid dd186e60-c44e-4bad-88ee-e96ed400c67a {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:29:20.179885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2954748f375411b87550803a8b2d3ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d600597d044d62bfa72df67a61c0bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:20.187949 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac916a29-e6a6-4f6a-90b6-051b84bf66ae tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 200 len: 1234 microversion: 2.1 time: 0.104015 Mar 26 21:29:20.188523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2791/5850] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:20 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:21.206008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:21.206736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] [instance: dd186e60-c44e-4bad-88ee-e96ed400c67a] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:21.213722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:21.214196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:21.214987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:21.215446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:21.229127 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] HTTP exception thrown: Instance dd186e60-c44e-4bad-88ee-e96ed400c67a could not be found. Mar 26 21:29:21.229732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Returning 404 to user: Instance dd186e60-c44e-4bad-88ee-e96ed400c67a could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:29:21.230573 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-83b45b6b-7543-4c77-8b32-b72e27cdabd3 tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a" status: 404 len: 111 microversion: 2.1 time: 0.029429 Mar 26 21:29:21.231108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3060/5851] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:21 2022] GET /compute/v2.1/servers/dd186e60-c44e-4bad-88ee-e96ed400c67a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:29:21.390637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fd7afa7c-d518-445a-92a2-6f1748320b7b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] Calling method '.version_select at 0x7f6e585bc1f0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:21.412891 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fd7afa7c-d518-445a-92a2-6f1748320b7b tempest-TestVolumeBackupRestore-1318254806 tempest-TestVolumeBackupRestore-1318254806-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-958369899" status: 202 len: 0 microversion: 2.1 time: 0.027601 Mar 26 21:29:21.413487 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2792/5852] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 21:29:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-958369899 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:29:40.805978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:40.806514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:40.809102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0628ba7a-739b-446c-99f6-59c6f98f543d req-099ef844-76e0-4420-a8c2-e1f00f018648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926b8d8d-180b-4dd6-b047-f5a5f8e750a9", "tag": "5f9fcc88-2637-43e1-8b33-1497b86cc140"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:40.814677 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:40.814900 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:40.815703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:40.816190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:40.818630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0628ba7a-739b-446c-99f6-59c6f98f543d req-099ef844-76e0-4420-a8c2-e1f00f018648 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:40.819075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0628ba7a-739b-446c-99f6-59c6f98f543d req-099ef844-76e0-4420-a8c2-e1f00f018648 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:40.830342 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0628ba7a-739b-446c-99f6-59c6f98f543d req-099ef844-76e0-4420-a8c2-e1f00f018648 service nova] Creating event network-changed:5f9fcc88-2637-43e1-8b33-1497b86cc140 for instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 on nch2-master-1 Mar 26 21:29:40.835745 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0628ba7a-739b-446c-99f6-59c6f98f543d req-099ef844-76e0-4420-a8c2-e1f00f018648 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031678 Mar 26 21:29:40.836469 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2793/5853] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:40.846226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:29:40.944130 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0ede652b-a494-433a-ab88-9c8e5d1fb74e tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 204 len: 0 microversion: 2.1 time: 0.142112 Mar 26 21:29:40.947799 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3061/5854] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:29:40 2022] DELETE /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:29:40.954406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:40.955131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:40.961400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:40.961863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:40.962699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:40.963150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:41.192342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:41.200627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ce76ef1b-a1f8-44ae-bb80-27683240fb6d tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1575 microversion: 2.1 time: 0.251272 Mar 26 21:29:41.210768 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2794/5855] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:40 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:42.219235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:42.220499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:42.227311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:42.227779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:42.228590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:42.229045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:42.365272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:42.372767 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94a1e930-7c28-43a2-b217-432fcbbca654 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1457 microversion: 2.1 time: 0.157847 Mar 26 21:29:42.373344 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3062/5856] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:42 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:42.918706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-470ff2e1-6312-42f0-9fa7-2a5fb0dec695 req-df8fbe68-4d85-40bd-9d82-4046aabcc86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926b8d8d-180b-4dd6-b047-f5a5f8e750a9", "name": "network-vif-deleted", "tag": "5f9fcc88-2637-43e1-8b33-1497b86cc140"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:29:42.927826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-470ff2e1-6312-42f0-9fa7-2a5fb0dec695 req-df8fbe68-4d85-40bd-9d82-4046aabcc86e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:42.928318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-470ff2e1-6312-42f0-9fa7-2a5fb0dec695 req-df8fbe68-4d85-40bd-9d82-4046aabcc86e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:42.940619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-470ff2e1-6312-42f0-9fa7-2a5fb0dec695 req-df8fbe68-4d85-40bd-9d82-4046aabcc86e service nova] Creating event network-vif-deleted:5f9fcc88-2637-43e1-8b33-1497b86cc140 for instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 on nch2-master-1 Mar 26 21:29:42.945558 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-470ff2e1-6312-42f0-9fa7-2a5fb0dec695 req-df8fbe68-4d85-40bd-9d82-4046aabcc86e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030764 Mar 26 21:29:42.946163 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2795/5857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:29:43.389807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:43.390441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:43.397278 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:43.397755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:43.398553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:43.399020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:43.431110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:43.431528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:43.432028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lazy-loading 'fault' on Instance uuid 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:29:43.472483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d6d477fac5463a944d918490b7117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c621f87120ad402a9d52cf6426f0cf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:29:43.479232 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-248bca5c-a2de-4d45-8a9b-d82b0e3f2603 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 200 len: 1183 microversion: 2.1 time: 0.093689 Mar 26 21:29:43.479797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3063/5858] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:43 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 1183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:29:44.498463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:44.499203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 926b8d8d-180b-4dd6-b047-f5a5f8e750a9] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:44.505991 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:44.506445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:44.507218 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:44.507683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:44.521153 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 could not be found. Mar 26 21:29:44.521749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 926b8d8d-180b-4dd6-b047-f5a5f8e750a9 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:29:44.522559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5c8e6975-7d57-4962-b933-975b7fb88bc7 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9" status: 404 len: 111 microversion: 2.1 time: 0.029223 Mar 26 21:29:44.523081 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2796/5859] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:44 2022] GET /compute/v2.1/servers/926b8d8d-180b-4dd6-b047-f5a5f8e750a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:29:44.973911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:44.974430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:44.981253 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:44.981754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:44.982528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:44.982991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:44.996104 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. Mar 26 21:29:44.996722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:29:44.997569 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0a829036-53f3-4601-ae4c-361e03b1eacc tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 404 len: 111 microversion: 2.1 time: 0.028367 Mar 26 21:29:44.998110 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3064/5860] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:29:44 2022] DELETE /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:29:45.006321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:45.006946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] [instance: 3e941d26-c67c-4ea5-a0ff-a71ba089f643] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:29:45.013166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:45.013622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:45.014396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:29:45.014835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:29:45.028670 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] HTTP exception thrown: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. Mar 26 21:29:45.029259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Returning 404 to user: Instance 3e941d26-c67c-4ea5-a0ff-a71ba089f643 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:29:45.030115 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-80f95ab0-43df-4571-a846-f3389f75e9ab tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643" status: 404 len: 111 microversion: 2.1 time: 0.027788 Mar 26 21:29:45.030642 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2797/5861] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:29:45 2022] GET /compute/v2.1/servers/3e941d26-c67c-4ea5-a0ff-a71ba089f643 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:29:46.316761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f0019940-be30-4376-9a2a-7fda4d464ec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] Calling method '.version_select at 0x7f6e58bd0820>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:29:46.339221 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f0019940-be30-4376-9a2a-7fda4d464ec4 tempest-TestVolumeBootPattern-540060077 tempest-TestVolumeBootPattern-540060077-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-343139743" status: 202 len: 0 microversion: 2.1 time: 0.026962 Mar 26 21:29:46.339987 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3065/5862] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-343139743 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:30:04.918264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-68492667", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:05.073953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] validate_networks() for None {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:30:05.342472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:30:05.342901 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:30:05.343380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:30:05.343797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:30:05.344241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:30:05.353697 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:05.354155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:05.354997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:05.355444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:05.371856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Getting quotas for project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:30:05.377057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Getting quotas for user f126505ca3764003887a54c270b442fd and project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:30:05.389069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:30:05.391318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:30:05.434306 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b225364-4117-4b44-81e6-261c61ecd5f2 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627961 Mar 26 21:30:05.434960 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2798/5863] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:30:05.445926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f21353f8-55f6-4c0c-8ee8-b2a3443b81f1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:05.446673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f21353f8-55f6-4c0c-8ee8-b2a3443b81f1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:05.607319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f21353f8-55f6-4c0c-8ee8-b2a3443b81f1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:05.614303 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f21353f8-55f6-4c0c-8ee8-b2a3443b81f1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1220 microversion: 2.1 time: 0.172363 Mar 26 21:30:05.614870 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3066/5864] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:05 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:06.631781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:06.632442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:06.639391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:06.640117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:06.640987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:06.641575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:06.707148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:06.714701 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9b98584-bdfa-48d5-a28d-6b81a85bd307 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1278 microversion: 2.1 time: 0.087813 Mar 26 21:30:06.715289 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2799/5865] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:06 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:07.738718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:07.743986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:07.780575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:07.788187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:07.789340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:07.790049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:08.051007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d5de5564-3163-412c-b1f8-df8175c04d4c req-8c2b5772-5c57-41f5-bf85-472f47440e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650aaab2-5d12-4f4e-ac70-c567f7f8f3eb", "tag": "d852a738-e2e2-4f09-9978-1f8e1a6a9799"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:08.071704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d5de5564-3163-412c-b1f8-df8175c04d4c req-8c2b5772-5c57-41f5-bf85-472f47440e0e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:08.072439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d5de5564-3163-412c-b1f8-df8175c04d4c req-8c2b5772-5c57-41f5-bf85-472f47440e0e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:08.086395 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d5de5564-3163-412c-b1f8-df8175c04d4c req-8c2b5772-5c57-41f5-bf85-472f47440e0e service nova] Creating event network-changed:d852a738-e2e2-4f09-9978-1f8e1a6a9799 for instance 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb on nch1-master-1 Mar 26 21:30:08.092597 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d5de5564-3163-412c-b1f8-df8175c04d4c req-8c2b5772-5c57-41f5-bf85-472f47440e0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049300 Mar 26 21:30:08.093839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2800/5866] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:08.129555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:08.159191 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e466620b-ab3b-46e4-9686-7681b4d59797 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.427907 Mar 26 21:30:08.160611 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3067/5867] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:07 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:09.179439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:09.180179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:09.186630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:09.187083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:09.187852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:09.188323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:09.321786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:09.329054 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f392edd-0c93-4a5a-8e43-b62327162935 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.155354 Mar 26 21:30:09.329629 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2801/5868] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:09 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:10.346092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:10.346637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:10.353368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:10.353833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:10.354613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:10.355068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:10.491858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:10.499291 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9e572e6-3109-48e0-b20b-560dbd2d32e5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.157233 Mar 26 21:30:10.499878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3068/5869] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:10 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:11.516100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:11.516714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:11.524200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:11.524659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:11.525438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:11.525881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:11.656328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:11.664266 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7637bfbc-8dcb-482a-9ca0-3ec207d224b5 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.152246 Mar 26 21:30:11.665061 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2802/5870] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:11 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:12.682819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:12.683444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:12.689937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:12.690402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:12.691179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:12.691633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:12.823214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:12.831011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-25586928-c288-4478-99b0-c9fa54209c06 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.152330 Mar 26 21:30:12.831596 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3069/5871] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:12 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:13.848281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:13.848894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:13.856192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:13.856647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:13.857413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:13.857850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:13.995412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:14.003877 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d29d18e7-b292-4f2c-8218-957c2880a85c tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.159665 Mar 26 21:30:14.004738 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2803/5872] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:13 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:14.011321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-cd7d8392-d88e-40b6-b0f5-42e9a7bb4d01 req-52b4cafd-7a13-4517-939b-a28fdbdb1af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650aaab2-5d12-4f4e-ac70-c567f7f8f3eb", "name": "network-vif-plugged", "status": "completed", "tag": "d852a738-e2e2-4f09-9978-1f8e1a6a9799"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:14.023957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cd7d8392-d88e-40b6-b0f5-42e9a7bb4d01 req-52b4cafd-7a13-4517-939b-a28fdbdb1af5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:14.024721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-cd7d8392-d88e-40b6-b0f5-42e9a7bb4d01 req-52b4cafd-7a13-4517-939b-a28fdbdb1af5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:14.036746 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-cd7d8392-d88e-40b6-b0f5-42e9a7bb4d01 req-52b4cafd-7a13-4517-939b-a28fdbdb1af5 service nova] Creating event network-vif-plugged:d852a738-e2e2-4f09-9978-1f8e1a6a9799 for instance 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb on nch1-master-1 Mar 26 21:30:14.041670 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-cd7d8392-d88e-40b6-b0f5-42e9a7bb4d01 req-52b4cafd-7a13-4517-939b-a28fdbdb1af5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Mar 26 21:30:14.042264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3070/5873] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:15.022835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:15.022835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:15.028471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:15.030741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:15.030741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:15.030741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:15.160624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:15.167859 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e422e3f-e58b-4c7b-89a0-577d1b294084 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1320 microversion: 2.1 time: 0.150929 Mar 26 21:30:15.168729 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2804/5874] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:15 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:16.187315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:16.188046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:16.194620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.195084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.195863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.196354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.331511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:16.338913 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-970b656f-3957-416d-9e9b-8881414fc32a tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1469 microversion: 2.1 time: 0.156861 Mar 26 21:30:16.339484 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3071/5875] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:16 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:16.404775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c66a72ea-ade4-4034-8907-9ecbb35d4b06 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '.version_select at 0x7f6e58561430>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:16.472088 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c66a72ea-ade4-4034-8907-9ecbb35d4b06 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fcbc5d70cf564fecbde7aeeaf1d58469" status: 200 len: 371 microversion: 2.1 time: 0.118937 Mar 26 21:30:16.472676 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2805/5876] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:30:16 2022] GET /compute/v2.1/os-quota-sets/fcbc5d70cf564fecbde7aeeaf1d58469 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:16.482806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf172faf-bdf8-4acf-ba63-b8d5c5f42ab7 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-655353140", "id": 893257203, "os-flavor-access:is_public": "True"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:16.484412 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:30:16.484412 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:30:16.499486 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf172faf-bdf8-4acf-ba63-b8d5c5f42ab7 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020373 Mar 26 21:30:16.500013 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3072/5877] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:30:16 2022] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:16.510969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "893257203"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:16.512001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:16.518025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.518471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.519239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.519681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.601582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '02360e9ad5ae48619072c872ec8c1c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:16.607772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-655353140 {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:30:16.614648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.615103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.615911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.616400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.636650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Getting quotas for project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:30:16.641613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Getting quotas for user f126505ca3764003887a54c270b442fd and project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:30:16.653380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] ram quota exceeded for fcbc5d70cf564fecbde7aeeaf1d58469, tried to resize instance. Mar 26 21:30:16.653921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Mar 26 21:30:16.654563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:30:16.655398 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-807b722e-a875-4abc-a0f2-c15124910e1f tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb/action" status: 403 len: 118 microversion: 2.1 time: 0.148335 Mar 26 21:30:16.655995 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2806/5878] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:30:16 2022] POST /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb/action => generated 118 bytes in 149 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:30:16.664874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3be413a6-a6f6-4903-bd65-c7d2a28c3f89 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:16.665637 ncdv-master-1 devstack@n-api.service[141581]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:30:16.665637 ncdv-master-1 devstack@n-api.service[141581]: warnings.warn(msg) Mar 26 21:30:16.681975 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3be413a6-a6f6-4903-bd65-c7d2a28c3f89 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/893257203" status: 202 len: 0 microversion: 2.1 time: 0.020822 Mar 26 21:30:16.682517 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3073/5879] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 21:30:16 2022] DELETE /compute/v2.1/flavors/893257203 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:30:16.690612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cf298b7-e171-4f48-8942-2437d65749d1 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:16.708900 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cf298b7-e171-4f48-8942-2437d65749d1 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022217 Mar 26 21:30:16.709439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2807/5880] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:30:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:30:16.725889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b65fa966-e183-45ae-839c-b01bbf8be042 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '.version_select at 0x7f6e58ac4310>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:16.797251 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b65fa966-e183-45ae-839c-b01bbf8be042 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fcbc5d70cf564fecbde7aeeaf1d58469" status: 200 len: 371 microversion: 2.1 time: 0.075022 Mar 26 21:30:16.797822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3074/5881] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:30:16 2022] GET /compute/v2.1/os-quota-sets/fcbc5d70cf564fecbde7aeeaf1d58469 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:16.808311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81eed75d-d796-4702-8ddb-12f8d2f7e8e5 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1082414731", "id": 806779177, "os-flavor-access:is_public": "True"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:16.809916 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:30:16.809916 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:30:16.824006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81eed75d-d796-4702-8ddb-12f8d2f7e8e5 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.019269 Mar 26 21:30:16.824552 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2808/5882] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:30:16 2022] POST /compute/v2.1/flavors => generated 434 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:16.835125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "806779177"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:16.836121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:16.842057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.842523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.843351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.843784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.977554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '02360e9ad5ae48619072c872ec8c1c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:16.983985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1082414731 {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:30:16.990907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.991371 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:16.992211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:16.992664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:17.012398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Getting quotas for project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:30:17.017329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Getting quotas for user f126505ca3764003887a54c270b442fd and project 9c448b2663f745ba974a354ab3cdcdd1. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:30:17.029633 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] cores quota exceeded for fcbc5d70cf564fecbde7aeeaf1d58469, tried to resize instance. Mar 26 21:30:17.030462 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Mar 26 21:30:17.031078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:30:17.031951 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf1d31a5-81ac-4503-b06b-44298bbf0b8a tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb/action" status: 403 len: 113 microversion: 2.1 time: 0.200663 Mar 26 21:30:17.032536 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3075/5883] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:30:16 2022] POST /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb/action => generated 113 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:30:17.041207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e5128075-6fe7-49fd-86a6-63856ab9e500 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:17.041971 ncdv-master-1 devstack@n-api.service[141580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:30:17.041971 ncdv-master-1 devstack@n-api.service[141580]: warnings.warn(msg) Mar 26 21:30:17.059137 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e5128075-6fe7-49fd-86a6-63856ab9e500 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/806779177" status: 202 len: 0 microversion: 2.1 time: 0.021494 Mar 26 21:30:17.059762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2809/5884] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 21:30:17 2022] DELETE /compute/v2.1/flavors/806779177 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:30:17.067429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f9b200f-8ff0-4872-8c6e-3cc9c802abc4 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:17.086292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f9b200f-8ff0-4872-8c6e-3cc9c802abc4 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022474 Mar 26 21:30:17.086875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3076/5885] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:30:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:17.103470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:17.104016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:17.109984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:17.110450 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:17.111225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:17.111698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:17.135486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:30:17.205945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-963d5aa4-f5eb-42d4-b77b-09340f153a5f tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "DELETE /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 204 len: 0 microversion: 2.1 time: 0.105538 Mar 26 21:30:17.206548 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2810/5886] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:30:17 2022] DELETE /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:30:17.215010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:17.215659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:17.223084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:17.223554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:17.224375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:17.224829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:17.355432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:17.362818 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-245c1551-5832-4119-8f67-90e8fd1e3e00 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1475 microversion: 2.1 time: 0.151763 Mar 26 21:30:17.363389 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3077/5887] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:17 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1475 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:18.380113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:18.380744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:18.387403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:18.387860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:18.388666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:18.389110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:18.527826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:18.535811 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad52aa17-0c4a-4970-a995-ff22905f0490 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1475 microversion: 2.1 time: 0.160039 Mar 26 21:30:18.536416 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2811/5888] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:18 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:19.107577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d5b2f761-42da-4f9f-801e-06535fce3bf5 req-bc7b6484-ef61-42f1-bb05-643ad2ce64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650aaab2-5d12-4f4e-ac70-c567f7f8f3eb", "name": "network-vif-deleted", "tag": "d852a738-e2e2-4f09-9978-1f8e1a6a9799"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:19.117598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d5b2f761-42da-4f9f-801e-06535fce3bf5 req-bc7b6484-ef61-42f1-bb05-643ad2ce64a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:19.118059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d5b2f761-42da-4f9f-801e-06535fce3bf5 req-bc7b6484-ef61-42f1-bb05-643ad2ce64a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:19.133578 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d5b2f761-42da-4f9f-801e-06535fce3bf5 req-bc7b6484-ef61-42f1-bb05-643ad2ce64a7 service nova] Creating event network-vif-deleted:d852a738-e2e2-4f09-9978-1f8e1a6a9799 for instance 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb on nch1-master-1 Mar 26 21:30:19.139363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d5b2f761-42da-4f9f-801e-06535fce3bf5 req-bc7b6484-ef61-42f1-bb05-643ad2ce64a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Mar 26 21:30:19.140023 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3078/5889] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:19.553119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:19.553736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:19.560822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:19.561283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:19.562062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:19.562530 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:19.596056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:19.596515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:19.596973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lazy-loading 'fault' on Instance uuid 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:30:19.638513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126505ca3764003887a54c270b442fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c448b2663f745ba974a354ab3cdcdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:19.645444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-73e38ba7-5bc7-42b8-998b-26b218571611 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 200 len: 1310 microversion: 2.1 time: 0.096722 Mar 26 21:30:19.646021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2812/5890] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:19 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:20.665142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:20.665880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] [instance: 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:20.672341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:20.672812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:20.673593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:20.674047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:20.687526 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] HTTP exception thrown: Instance 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb could not be found. Mar 26 21:30:20.688179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] Returning 404 to user: Instance 650aaab2-5d12-4f4e-ac70-c567f7f8f3eb could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:30:20.689021 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c78925aa-611a-4495-bf8e-8b2df3be26a1 tempest-ServersAdminNegativeTestJSON-646653735 tempest-ServersAdminNegativeTestJSON-646653735-project] 10.222.0.16 "GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb" status: 404 len: 111 microversion: 2.1 time: 0.029109 Mar 26 21:30:20.690039 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3079/5891] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:20 2022] GET /compute/v2.1/servers/650aaab2-5d12-4f4e-ac70-c567f7f8f3eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:30:23.260576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1074508302", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "02367ba7-87b9-43c6-9f3d-5ab1c8d04855"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:23.553337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] validate_networks() for [('02367ba7-87b9-43c6-9f3d-5ab1c8d04855', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:30:23.889190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:30:23.889631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:30:23.890118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:30:23.890538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:30:23.890963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:30:23.899750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:23.900244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:23.901059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:23.901508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:23.920010 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Getting quotas for project 0eed8f4e27f84b00a9e92e4cfdc378ac. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:30:23.925738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Getting quotas for user 5bfd467da71e47b18438c0b75a5d7836 and project 0eed8f4e27f84b00a9e92e4cfdc378ac. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:30:23.940871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:30:23.943182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:30:23.985796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed8e39d8-ae5b-4568-b7fd-407aaceabea5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838401 Mar 26 21:30:23.986435 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2813/5892] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:30:23.997246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-34e25705-5e0d-4b21-8bb3-0dfbd8e69ab6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:23.998452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-34e25705-5e0d-4b21-8bb3-0dfbd8e69ab6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:24.057032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-34e25705-5e0d-4b21-8bb3-0dfbd8e69ab6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:24.066110 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-34e25705-5e0d-4b21-8bb3-0dfbd8e69ab6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1215 microversion: 2.1 time: 0.072865 Mar 26 21:30:24.066689 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3080/5893] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:23 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:25.083896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:25.084537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:25.091740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:25.092231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:25.093441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:25.093441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:25.160119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:25.168078 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-07e12857-b494-4a5d-bad2-bb8b19cab125 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1267 microversion: 2.1 time: 0.089295 Mar 26 21:30:25.169219 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2814/5894] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:25 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:26.186608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:26.187814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:26.196526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:26.196993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:26.197791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:26.198256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:26.746556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:26.754055 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6b1b031b-683e-408f-b285-0271bc7a035c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.571442 Mar 26 21:30:26.754642 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3081/5895] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:26 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:26.854139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-1d922747-1eef-4c8f-bda0-2648eb964e5d req-a6afbf21-9468-4da8-b4bc-71db23b240b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:26.864756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1d922747-1eef-4c8f-bda0-2648eb964e5d req-a6afbf21-9468-4da8-b4bc-71db23b240b2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:26.865222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-1d922747-1eef-4c8f-bda0-2648eb964e5d req-a6afbf21-9468-4da8-b4bc-71db23b240b2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:26.879757 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-1d922747-1eef-4c8f-bda0-2648eb964e5d req-a6afbf21-9468-4da8-b4bc-71db23b240b2 service nova] Creating event network-changed:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch1-master-1 Mar 26 21:30:26.884742 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-1d922747-1eef-4c8f-bda0-2648eb964e5d req-a6afbf21-9468-4da8-b4bc-71db23b240b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Mar 26 21:30:26.885341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2815/5896] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:30:27.770980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:27.771653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:27.778656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:27.779130 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:27.779939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:27.780406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:27.913123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:27.920692 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c33802b4-9b83-4b9f-aeee-059a3de5eb4e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.153782 Mar 26 21:30:27.921268 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3082/5897] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:27 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:28.941107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:28.941822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:28.948883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:28.949345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:28.950121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:28.950567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:29.082596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:29.089897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c5b6d959-0911-4878-a06c-22321d735c2f tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.153123 Mar 26 21:30:29.090460 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2816/5898] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:28 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:30.106959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:30.107597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:30.115028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:30.115509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:30.116333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:30.116798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:30.255496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:30.263028 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-03033f72-3e52-485a-a20c-638f4c8d3a53 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.160038 Mar 26 21:30:30.263607 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3083/5899] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:30 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:31.279689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:31.280250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:31.286934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:31.287389 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:31.288184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:31.288626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:31.421171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:31.428908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a1392a6-852c-4de8-9f27-229ff303f78a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.153280 Mar 26 21:30:31.429464 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2817/5900] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:31 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:32.097303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-820a994e-e489-4fe5-8672-ed8ec6abf70f req-e1ebf8ef-b73c-4e35-8398-3f332b6dbb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "name": "network-vif-plugged", "status": "completed", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:32.110347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-820a994e-e489-4fe5-8672-ed8ec6abf70f req-e1ebf8ef-b73c-4e35-8398-3f332b6dbb85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:32.111048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-820a994e-e489-4fe5-8672-ed8ec6abf70f req-e1ebf8ef-b73c-4e35-8398-3f332b6dbb85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:32.122611 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-820a994e-e489-4fe5-8672-ed8ec6abf70f req-e1ebf8ef-b73c-4e35-8398-3f332b6dbb85 service nova] Creating event network-vif-plugged:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch1-master-1 Mar 26 21:30:32.127839 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-820a994e-e489-4fe5-8672-ed8ec6abf70f req-e1ebf8ef-b73c-4e35-8398-3f332b6dbb85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Mar 26 21:30:32.128477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3084/5901] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:30:32.446164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:32.446789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:32.453614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:32.454075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:32.454853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:32.455303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:32.589001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:32.596308 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8ac336c3-cb29-47ff-a0a2-b09c7b799406 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1315 microversion: 2.1 time: 0.154066 Mar 26 21:30:32.596877 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2818/5902] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:32 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:33.613368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:33.614101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:33.621116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:33.621596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:33.622398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:33.622860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:33.770666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:33.778137 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e7508b5-fec5-4806-ba4a-14d76c1c92e7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1502 microversion: 2.1 time: 0.169384 Mar 26 21:30:33.778714 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3085/5903] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:33 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:33.795000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:30:33.795985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:33.802627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:33.803080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:33.803846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:33.804307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:33.877101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:33.882746 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Old instance type m1.heat2, new instance type m1.heat {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:30:33.888850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:30:33.889276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:30:33.889757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:30:33.890167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:30:33.890580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:30:33.995695 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd83c60e-8314-4e30-bd77-5028aa90819b tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "POST /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c/action" status: 202 len: 0 microversion: 2.1 time: 0.204799 Mar 26 21:30:33.996508 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2819/5904] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:30:33 2022] POST /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:30:34.008490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:34.008707 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:34.015293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:34.015762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:34.016920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:34.017356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:34.159481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:34.167143 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0069d3d8-1b92-405c-8922-3f68c6bf2836 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1511 microversion: 2.1 time: 0.163490 Mar 26 21:30:34.168000 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3086/5905] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:34 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:35.185815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:35.186415 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:35.193150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:35.193613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:35.194733 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:35.195433 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:35.325242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:35.333089 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9fde8144-f924-434c-a678-92efa6a22e58 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1511 microversion: 2.1 time: 0.152459 Mar 26 21:30:35.333652 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2820/5906] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:35 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:36.350640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:36.351269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:36.358075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:36.358554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:36.359338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:36.359796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:36.493692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:36.501336 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-445ad651-dba8-4a8e-9cc9-9007a8a61731 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.155105 Mar 26 21:30:36.501924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3087/5907] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:36 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:37.518327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:37.518953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:37.526102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:37.526556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:37.527326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:37.527769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:37.661567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:37.668887 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13edc015-e5b4-4839-a61b-144023e2e2d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.154523 Mar 26 21:30:37.669736 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2821/5908] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:37 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:38.686623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:38.687263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:38.694590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:38.695063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:38.695850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:38.696341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:38.828060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:38.835481 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ccacfd25-42ec-4de9-b7a2-2fe984d095bb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.152820 Mar 26 21:30:38.836154 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3088/5909] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:38 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:39.852128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:39.852792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:39.859548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:39.860039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:39.860811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:39.861260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:39.998545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:40.006470 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9cf8505-d17a-46e6-9b01-07fb0b96ae56 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.158349 Mar 26 21:30:40.007038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2822/5910] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:39 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:41.024230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:41.024874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:41.031712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:41.032223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:41.033023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:41.033488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:41.168752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:41.176385 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1e3b66c-4bd7-4577-9005-31c11fae3798 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156236 Mar 26 21:30:41.176971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3089/5911] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:41 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:30:42.193375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:42.194003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:42.200844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:42.201312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:42.202094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:42.202551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:42.331842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:42.339258 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-619edd71-e085-4c35-a6b8-20fc8a534de5 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.149856 Mar 26 21:30:42.339829 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2823/5912] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:42 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:43.356700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:43.357281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:43.364447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:43.364921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:43.365742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:43.366204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:43.500905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:43.509399 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ab147c0-3ac8-4213-b868-61d9a9d894a7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156714 Mar 26 21:30:43.509972 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3090/5913] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:43 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:44.525237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:44.525852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:44.532917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:44.533375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:44.534635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:44.535076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:44.668431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:44.676672 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-647d65c4-a0c0-4bac-b06d-4d70a09d1b99 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.155297 Mar 26 21:30:44.677235 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2824/5914] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:44 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:45.693265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:45.693902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:45.700905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:45.701378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:45.702169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:45.702633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:45.837315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:45.844918 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f5af96ce-ec06-4cb2-81c9-29c8f9b5aa10 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.155729 Mar 26 21:30:45.845497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3091/5915] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:45 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:46.863025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:46.863572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:46.870340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:46.870797 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:46.871565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:46.872106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:47.002882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:47.010546 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12f12083-323b-40b2-9c2c-734b0b6cc66c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.152141 Mar 26 21:30:47.011155 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2825/5916] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:46 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:48.028108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:48.028738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:48.036158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:48.036633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:48.037420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:48.037879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:48.175354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:48.182950 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4d15cc5d-92aa-468f-a161-c4c7f51ae555 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.158828 Mar 26 21:30:48.183531 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3092/5917] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:48 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:49.200620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:49.201267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:49.208633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:49.209092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:49.209864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:49.210308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:49.339452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:49.346831 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-455ee742-2976-47d1-b998-e905db23193a tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.150154 Mar 26 21:30:49.347397 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2826/5918] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:49 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:50.364361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:50.364975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:50.371632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:50.372135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:50.372919 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:50.373374 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:50.509514 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:50.516947 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-be13d98a-2e34-43d3-a455-c5751c2784a4 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156901 Mar 26 21:30:50.517530 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3093/5919] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:50 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:51.535269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:51.535885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:51.542270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:51.542727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:51.543497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:51.543966 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:51.680633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:51.688796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-92e60295-a826-409a-9850-600e464550b6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.158172 Mar 26 21:30:51.689372 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2827/5920] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:51 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:52.705792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:52.706424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:52.713166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:52.713633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:52.714416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:52.714870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:52.845535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:52.853453 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10439100-ecca-43b1-823f-217f463f23bc tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.151637 Mar 26 21:30:52.854023 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3094/5921] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:52 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:53.870864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:53.871585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:53.878985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:53.879424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:53.880221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:53.880663 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:54.021640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:54.029767 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1adc5016-bc82-4945-b93f-6a589fba698d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.162847 Mar 26 21:30:54.030341 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2828/5922] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:53 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:55.046892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:55.047526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:55.054127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:55.054590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:55.055367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:55.055820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:55.191600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:55.199260 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fc1d7a2b-ab13-4275-845b-4bdc8a256b8e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156526 Mar 26 21:30:55.199861 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3095/5923] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:55 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:56.216816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:56.217427 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:56.224491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:56.224952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:56.225722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:56.226163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:56.358794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:56.366143 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1436533f-d1ba-4d0c-b123-fa18b01cdda3 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.153367 Mar 26 21:30:56.366715 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2829/5924] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:56 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:57.382729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:57.383258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:57.390114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:57.390581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:57.391360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:57.391811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:57.527181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:57.535143 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ad9ca1ad-1530-4835-a098-5b3e883d8ec7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156412 Mar 26 21:30:57.535716 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3096/5925] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:57 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:58.552534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:58.553151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:58.560059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:58.560522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:58.561313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:58.561762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:58.697728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:58.705926 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-925180d2-2350-402a-9c03-a82defa849d7 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.157556 Mar 26 21:30:58.706668 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2830/5926] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:58 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:30:59.726827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:30:59.727458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:30:59.734294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:59.734769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:59.735555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:30:59.736047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:30:59.868167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:30:59.875590 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5abb5add-a991-4330-bdf7-b4808a90de0c tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.156454 Mar 26 21:30:59.876197 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3097/5927] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:30:59 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:00.893028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:00.894052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:00.900859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:00.901322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:00.902100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:00.902551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:01.043765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:01.051817 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-958e27dc-177f-4c24-aa7f-3394b98714d2 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.162695 Mar 26 21:31:01.052632 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2831/5928] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:00 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:02.069504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:02.070158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:02.076993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:02.077457 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:02.078235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:02.078691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:02.215407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:02.222825 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-47b7e846-bc86-48f5-bf5b-22a88916ca92 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1516 microversion: 2.1 time: 0.157232 Mar 26 21:31:02.223897 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3098/5929] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:02 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:03.240884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:03.242304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:03.249149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:03.249616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:03.250402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:03.250853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:03.535033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:03.543236 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dcb0bdb0-2df0-4ef3-8b0e-3d61f4d8119e tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1515 microversion: 2.1 time: 0.307017 Mar 26 21:31:03.543818 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2832/5930] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:03 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:03.773323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "name": "network-vif-unplugged", "status": "completed", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:03.781525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:03.781997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:03.795281 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] Creating event network-vif-unplugged:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch2-master-1 Mar 26 21:31:03.801143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] Instance c05cdd89-ac42-494e-9b8e-3b895e48954c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:31:03.812046 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-af6d244e-967e-45bb-8de7-6c26cd2a7839 req-417062bb-1c46-4d41-bdaa-42ade8e67138 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113088 Mar 26 21:31:03.812657 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3099/5931] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:04.560229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:04.561000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:04.568634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:04.569095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:04.569865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:04.570310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:04.707793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:04.715149 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d88b2df-2d31-4298-b1b0-16041f779f5d tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1513 microversion: 2.1 time: 0.158930 Mar 26 21:31:04.715712 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2833/5932] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:04 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:05.734320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:05.735039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:05.741780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:05.742255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:05.743044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:05.743505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:05.829233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:05.841388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:05.841911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:05.855488 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] Creating event network-changed:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch2-master-1 Mar 26 21:31:05.860919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] Instance c05cdd89-ac42-494e-9b8e-3b895e48954c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:31:05.873917 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-adfc556c-6833-437c-a156-791d32739bf7 req-9fff2b89-5f28-471f-aa24-e892183b61be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049035 Mar 26 21:31:05.875080 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2834/5933] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:05.889641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:05.897768 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d6a10bf-3cab-4d6d-b9f4-131deabd8fde tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1513 microversion: 2.1 time: 0.168410 Mar 26 21:31:05.898491 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3100/5934] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:05 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:06.915079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:06.916034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:06.922972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:06.923432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:06.924246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:06.924692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:07.069927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:07.077754 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e4db8940-cc7b-4d3c-8447-f92f5c099630 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1510 microversion: 2.1 time: 0.166826 Mar 26 21:31:07.078437 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2835/5935] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:06 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:07.095083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:07.095639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:07.102884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:07.103283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:07.104133 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:07.104629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:07.131151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:31:07.181548 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.compute.api [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Found an unconfirmed migration during delete, id: 16, status: finished Mar 26 21:31:08.614546 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca7b29d5-0b29-4d2c-9347-761059293c20 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 204 len: 0 microversion: 2.1 time: 1.523129 Mar 26 21:31:08.615360 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3101/5936] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:31:07 2022] DELETE /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 0 bytes in 1525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:31:08.624147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:08.624775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:08.632139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:08.632597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:08.633374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:08.633865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:08.762913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:08.770194 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3a1d583-00bf-4ac1-a12a-ce7c11cc92a8 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1502 microversion: 2.1 time: 0.150563 Mar 26 21:31:08.770763 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2836/5937] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:08 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:31:09.089934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a5bbcac8-bbe1-4da9-ba23-ef4aef37cbab req-d6f36dda-b5d4-4e7b-9d4e-d3182fdd573d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "name": "network-vif-plugged", "status": "completed", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:09.097813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a5bbcac8-bbe1-4da9-ba23-ef4aef37cbab req-d6f36dda-b5d4-4e7b-9d4e-d3182fdd573d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:09.098256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a5bbcac8-bbe1-4da9-ba23-ef4aef37cbab req-d6f36dda-b5d4-4e7b-9d4e-d3182fdd573d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:09.108750 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a5bbcac8-bbe1-4da9-ba23-ef4aef37cbab req-d6f36dda-b5d4-4e7b-9d4e-d3182fdd573d service nova] Creating event network-vif-plugged:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch2-master-1 Mar 26 21:31:09.114287 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a5bbcac8-bbe1-4da9-ba23-ef4aef37cbab req-d6f36dda-b5d4-4e7b-9d4e-d3182fdd573d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092533 Mar 26 21:31:09.114869 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3102/5938] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:09.787318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:09.787968 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:09.794748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:09.795472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:09.796298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:09.796753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:09.960205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfd467da71e47b18438c0b75a5d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:09.967609 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3c0e5e50-490b-45d7-bcf5-fb8ef141bfe6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 200 len: 1502 microversion: 2.1 time: 0.184907 Mar 26 21:31:09.968222 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2837/5939] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:09 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:10.394215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-4165889c-3ab5-4672-8c41-f3d1e0035c96 req-7219bd61-f150-40af-8738-678a8272b47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05cdd89-ac42-494e-9b8e-3b895e48954c", "name": "network-vif-deleted", "tag": "12960f28-fe73-4d1f-bb1e-1c8338fb748f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:10.403288 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4165889c-3ab5-4672-8c41-f3d1e0035c96 req-7219bd61-f150-40af-8738-678a8272b47d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:10.403774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-4165889c-3ab5-4672-8c41-f3d1e0035c96 req-7219bd61-f150-40af-8738-678a8272b47d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:10.414791 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-4165889c-3ab5-4672-8c41-f3d1e0035c96 req-7219bd61-f150-40af-8738-678a8272b47d service nova] Creating event network-vif-deleted:12960f28-fe73-4d1f-bb1e-1c8338fb748f for instance c05cdd89-ac42-494e-9b8e-3b895e48954c on nch2-master-1 Mar 26 21:31:10.419466 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-4165889c-3ab5-4672-8c41-f3d1e0035c96 req-7219bd61-f150-40af-8738-678a8272b47d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029380 Mar 26 21:31:10.420361 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3103/5940] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:10.984498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:10.985174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:10.992483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:10.992945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:10.993723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:10.994174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:11.007222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] HTTP exception thrown: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. Mar 26 21:31:11.007823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Returning 404 to user: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:31:11.008713 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cbac1f70-c4db-452f-a63c-9b8b906947d1 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 404 len: 111 microversion: 2.1 time: 0.028131 Mar 26 21:31:11.009248 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2838/5941] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:10 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:31:11.025219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:11.025544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:11.032240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:11.032718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:11.033496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:11.033944 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:11.047699 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] HTTP exception thrown: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. Mar 26 21:31:11.048322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Returning 404 to user: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:31:11.049146 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8c34402d-7e9a-4a84-8cc8-42967af063eb tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 404 len: 111 microversion: 2.1 time: 0.028448 Mar 26 21:31:11.049668 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3104/5942] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:31:11 2022] DELETE /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:31:11.057749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:11.058310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] [instance: c05cdd89-ac42-494e-9b8e-3b895e48954c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:11.064626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:11.065086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:11.065867 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:11.066314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:11.080730 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] HTTP exception thrown: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. Mar 26 21:31:11.081328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] Returning 404 to user: Instance c05cdd89-ac42-494e-9b8e-3b895e48954c could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:31:11.082154 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d9141b9-1c48-4f38-bd07-4c3b4dcfb2d6 tempest-DeleteServersTestJSON-1156983118 tempest-DeleteServersTestJSON-1156983118-project] 10.222.0.16 "GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c" status: 404 len: 111 microversion: 2.1 time: 0.028442 Mar 26 21:31:11.083219 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2839/5943] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:11 2022] GET /compute/v2.1/servers/c05cdd89-ac42-494e-9b8e-3b895e48954c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:31:13.482735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-518062416", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "61740fd0-ccbd-4c4e-83df-5f568a3eb880"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:13.537872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] validate_networks() for [('61740fd0-ccbd-4c4e-83df-5f568a3eb880', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:31:13.880720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:31:13.881167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:31:13.881663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:31:13.882100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:31:13.882564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:31:13.891627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:13.892181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:13.893015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:13.893464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:13.913280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Getting quotas for project 150ede058f8c4b61a827850135921da2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:31:13.918554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Getting quotas for user 1af836fd9f5f405e9f4f885c6b6970fa and project 150ede058f8c4b61a827850135921da2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:31:13.931629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:31:13.933965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:31:13.978073 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-960a869c-05d1-41c4-97cd-6d207595d7e1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607248 Mar 26 21:31:13.978881 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3105/5944] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:31:13.989519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fe540cd0-c9b4-4c49-8cf5-2880d43554ca tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:13.990200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fe540cd0-c9b4-4c49-8cf5-2880d43554ca tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:14.045109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fe540cd0-c9b4-4c49-8cf5-2880d43554ca tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:14.052768 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fe540cd0-c9b4-4c49-8cf5-2880d43554ca tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1217 microversion: 2.1 time: 0.067780 Mar 26 21:31:14.053330 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2840/5945] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:13 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:15.070433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:15.071063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:15.079008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:15.079483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:15.080316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:15.080766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:15.146535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:15.154786 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e4071f0-d616-457f-91ed-a7f8dff4390e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1275 microversion: 2.1 time: 0.088406 Mar 26 21:31:15.155375 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3106/5946] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:15 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:16.172975 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:16.173814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:16.181653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:16.182760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:16.184189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:16.184534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:16.425500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:16.433347 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a8b2ff01-4c97-45b4-b175-bd3b376a7701 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.264614 Mar 26 21:31:16.433936 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2841/5947] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:16 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:16.596800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-db1f03ac-dd4e-463b-b226-e290d23a3a41 req-667948a7-e1a9-4406-ad63-2b2126b52649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:16.606725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-db1f03ac-dd4e-463b-b226-e290d23a3a41 req-667948a7-e1a9-4406-ad63-2b2126b52649 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:16.607203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-db1f03ac-dd4e-463b-b226-e290d23a3a41 req-667948a7-e1a9-4406-ad63-2b2126b52649 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:16.619286 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-db1f03ac-dd4e-463b-b226-e290d23a3a41 req-667948a7-e1a9-4406-ad63-2b2126b52649 service nova] Creating event network-changed:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch2-master-1 Mar 26 21:31:16.628288 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-db1f03ac-dd4e-463b-b226-e290d23a3a41 req-667948a7-e1a9-4406-ad63-2b2126b52649 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035312 Mar 26 21:31:16.628921 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3107/5948] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:17.450768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:17.451391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:17.458099 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:17.458558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:17.459340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:17.459790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:17.594512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:17.601792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e883f600-1c3a-43c0-b837-6f1d69a1983d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.154939 Mar 26 21:31:17.602362 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2842/5949] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:17 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:18.620151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:18.620879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:18.627122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:18.627654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:18.628476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:18.628941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:18.764087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:18.771423 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af2fff5e-5fae-43ff-ac0e-54a7ecad21a2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.156528 Mar 26 21:31:18.772037 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3108/5950] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:18 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:19.787622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:19.788254 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:19.795724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:19.796215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:19.796985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:19.797434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:19.926743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:19.935255 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aae8bec1-8f85-48c2-bdba-74e98f4b2126 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.151523 Mar 26 21:31:19.935834 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2843/5951] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:19 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:20.952222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:20.953530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:20.961341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:20.961822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:20.962659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:20.963151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:21.083553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ac5c24c5-7cc6-4f7c-9bce-40f33fb800ca req-66bbdaf9-f8a8-4de5-b8f4-bb92e3814cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "name": "network-vif-plugged", "status": "completed", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:21.092523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac5c24c5-7cc6-4f7c-9bce-40f33fb800ca req-66bbdaf9-f8a8-4de5-b8f4-bb92e3814cbd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:21.093007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac5c24c5-7cc6-4f7c-9bce-40f33fb800ca req-66bbdaf9-f8a8-4de5-b8f4-bb92e3814cbd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:21.099856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:21.109199 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1cc0438c-410f-49a3-9104-163a75967571 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.160463 Mar 26 21:31:21.110563 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3109/5952] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:20 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:21.110722 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ac5c24c5-7cc6-4f7c-9bce-40f33fb800ca req-66bbdaf9-f8a8-4de5-b8f4-bb92e3814cbd service nova] Creating event network-vif-plugged:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch2-master-1 Mar 26 21:31:21.115658 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ac5c24c5-7cc6-4f7c-9bce-40f33fb800ca req-66bbdaf9-f8a8-4de5-b8f4-bb92e3814cbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035866 Mar 26 21:31:21.116273 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2844/5953] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:31:22.126841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:22.127469 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:22.135599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:22.136117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:22.136904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:22.137356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:22.277115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:22.285859 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8b9a74a0-756b-459f-994a-f072e7cb3690 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1317 microversion: 2.1 time: 0.163129 Mar 26 21:31:22.296791 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3110/5954] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:22 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:23.304509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:23.305171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:23.311471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.311954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.312739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.313195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.448583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:23.456173 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b464fdc2-59c3-4dee-837c-a92c590c8516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1507 microversion: 2.1 time: 0.156898 Mar 26 21:31:23.456757 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2845/5955] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:23 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:23.472805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:23.473431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:23.480287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.480755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.481534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.481987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.610526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:23.617873 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-79f791da-b452-471f-b70e-ba6499d3633c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1507 microversion: 2.1 time: 0.148925 Mar 26 21:31:23.618445 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3111/5956] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:23 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:23.633829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:23.634943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:23.640788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.641246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.642013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.642452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.703343 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cf506db9-7404-4547-889f-bc2e1018de34 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "PUT /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1079 microversion: 2.1 time: 0.073841 Mar 26 21:31:23.703981 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2846/5957] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 21:31:23 2022] PUT /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1079 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:23.717701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:23.718338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:23.724398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.724871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.725656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.726122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.857855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:23.865292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1525cc7-cb96-456c-8ca5-fec7405dc3f9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1505 microversion: 2.1 time: 0.151517 Mar 26 21:31:23.865882 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3112/5958] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:23 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:23.881420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:23.882079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:23.888737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.889199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:23.889976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:23.890424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:24.025861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:24.033455 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d637b0d6-90db-4f44-bd9c-5994c70d6914 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1505 microversion: 2.1 time: 0.155945 Mar 26 21:31:24.034032 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2847/5959] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:23 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:24.050157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:24.051163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:24.057810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:24.058312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:24.059102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:24.059563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:24.086793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:24.092577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Old instance type m1.heat2, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:31:24.099074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:31:24.099516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:31:24.100051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:31:24.100489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:31:24.101405 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:31:24.160930 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-195dbd30-e3a4-434a-86b6-acceacb8201b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14/action" status: 202 len: 0 microversion: 2.1 time: 0.114896 Mar 26 21:31:24.161469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3113/5960] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:31:24 2022] POST /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:31:24.170298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:24.171182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:24.177214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:24.177680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:24.178498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:24.178949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:24.345090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:24.353209 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-672782d4-e0f0-4071-aa15-0b5ea4affd9d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1516 microversion: 2.1 time: 0.186990 Mar 26 21:31:24.353778 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2848/5961] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:24 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:25.372155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:25.372748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:25.378809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:25.379280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:25.380095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:25.380557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:25.525968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:25.533696 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ef6a065-e66f-44a0-8fb2-d7c75282a7d2 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1516 microversion: 2.1 time: 0.166966 Mar 26 21:31:25.534364 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3114/5962] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:25 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:26.551654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:26.552311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:26.558889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:26.559343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:26.560147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:26.560587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:26.693295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:26.701318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1196327c-3f0b-4774-9c0d-2ea7d3b94045 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153617 Mar 26 21:31:26.701888 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2849/5963] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:26 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:27.717952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:27.718579 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:27.725418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:27.725890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:27.727339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:27.727792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:27.861332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:27.868799 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f0704c9-8d8c-4066-ab42-e13ca7b6b3f8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.154786 Mar 26 21:31:27.869383 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3115/5964] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:27 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:28.886228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:28.886986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:28.893801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:28.894264 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:28.895051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:28.895503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:29.031003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:29.038429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6a6e41bd-23f2-4c26-ade2-69fa62aad1a3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.156571 Mar 26 21:31:29.039630 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2850/5965] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:28 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:30.056974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:30.057630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:30.065474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:30.066137 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:30.067266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:30.067723 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:30.202020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:30.209512 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-09fd3890-c6e6-4d56-909b-2f6a005ac168 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.157235 Mar 26 21:31:30.210105 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3116/5966] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:30 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:31.227550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:31.228228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:31.235110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:31.235573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:31.236391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:31.236845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:31.368617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:31.376077 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cc8e30cb-fbb4-4ac9-b383-99bb74b2bf43 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.152486 Mar 26 21:31:31.376647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2851/5967] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:31 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:32.393626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:32.394259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:32.402000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:32.402473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:32.403260 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:32.403726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:32.534325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:32.541883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-15185cde-a8f9-48e2-8244-25d0da50a34a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.152248 Mar 26 21:31:32.542457 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3117/5968] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:32 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:33.559190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:33.559805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:33.566613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:33.567070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:33.567841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:33.568314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:33.699040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:33.706468 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9dc04467-d37e-4b8c-b338-4a1428f3dc62 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.151318 Mar 26 21:31:33.707053 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2852/5969] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:33 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:34.724088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:34.724716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:34.731573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:34.732069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:34.732852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:34.733305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:34.866560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:34.874345 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1afe1c84-3fae-417e-960f-4b699733baf7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153963 Mar 26 21:31:34.874928 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3118/5970] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:34 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:35.891720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:35.892503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:35.899784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:35.900273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:35.901057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:35.901503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:36.036589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:36.044633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38311895-c81a-460c-a937-344b6b4dbce0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.156826 Mar 26 21:31:36.045240 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2853/5971] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:35 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:37.061851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:37.062609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:37.069618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:37.070628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:37.071433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:37.071887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:37.207008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:37.214420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3703fff6-c147-4177-b38a-4da503b385bb tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.156666 Mar 26 21:31:37.214993 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3119/5972] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:37 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:38.231900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:38.232544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:38.239525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:38.240013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:38.240794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:38.241241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:38.373812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:38.381354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ff18c052-ea23-4e54-a78f-2c7e73cfc497 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153444 Mar 26 21:31:38.381946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2854/5973] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:38 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:39.398836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:39.399399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:39.406245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:39.406718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:39.407507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:39.407989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:39.540648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:39.548246 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-efaa6ad7-2e54-458c-be66-b6b2727474f4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153372 Mar 26 21:31:39.548828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3120/5974] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:39 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:40.565468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:40.566095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:40.573018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:40.573476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:40.574243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:40.574717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:40.709369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:40.716868 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-50968b85-2a7b-42fc-a38e-0f4dce43f106 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.155674 Mar 26 21:31:40.717444 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2855/5975] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:40 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:41.733861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:41.734569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:41.745370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:41.745842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:41.746635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:41.747097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:41.882125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:41.890175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-be813a02-5d46-4b79-b41c-edd96136f7b8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.160475 Mar 26 21:31:41.890761 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3121/5976] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:41 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:42.907757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:42.908342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:42.915190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:42.915657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:42.916468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:42.916922 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:43.050474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:43.057888 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86a4f537-3389-48c9-84f9-17921a9a3516 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.154158 Mar 26 21:31:43.058468 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2856/5977] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:42 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:44.075328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:44.076020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:44.082527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:44.083008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:44.083799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:44.084295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:44.216091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:44.223474 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3fccffb1-33cf-49b1-9391-e143f03a9170 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.152293 Mar 26 21:31:44.224085 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3122/5978] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:44 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:45.241184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:45.242388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:45.249321 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:45.249791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:45.250575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:45.251030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:45.382978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:45.390431 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b3e41db-e5ce-47f8-a6ed-7134e0fc67f6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153252 Mar 26 21:31:45.391011 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2857/5979] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:45 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:46.406937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:46.407472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:46.414263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:46.414738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:46.415525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:46.416018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:46.549336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:46.557371 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a6623e2-c74e-4ada-bb70-c40e135a8b96 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.154480 Mar 26 21:31:46.557951 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3123/5980] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:46 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:47.574832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:47.575454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:47.582629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:47.583106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:47.583875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:47.584342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:47.718783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:47.726266 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-515bef56-ba65-413e-83df-b80faf7d1ccf tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.155935 Mar 26 21:31:47.726872 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2858/5981] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:47 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:48.743311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:48.743961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:48.750980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:48.751407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:48.752230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:48.752695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:48.886021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:48.893574 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-81774b02-6238-4edf-8734-67c830047d32 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.154245 Mar 26 21:31:48.894160 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3124/5982] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:48 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:49.911150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:49.911752 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:49.918653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:49.919115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:49.919948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:49.920405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:50.053184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:50.061063 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f0faf71e-2925-4fb1-a87c-dcd2b53aa5ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.153871 Mar 26 21:31:50.061648 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2859/5983] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:49 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:51.078414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:51.079046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:51.085999 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:51.086471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:51.087880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:51.088365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:51.222156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:51.229616 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-33eb468f-107f-413c-8bb8-3a09e219213e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.155234 Mar 26 21:31:51.230200 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3125/5984] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:51 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:52.246634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:52.247253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:52.254019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:52.254488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:52.255279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:52.255730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:52.393248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:52.401113 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d1707c9-317b-4d57-8340-d21e6bf3fab6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1521 microversion: 2.1 time: 0.158512 Mar 26 21:31:52.401664 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2860/5985] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:52 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:53.418131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:53.418770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:53.425479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:53.425952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:53.426731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:53.427186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:53.955458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:53.964092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "name": "network-vif-unplugged", "status": "completed", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:53.972014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ecd4b177-e5e3-4e17-b8ca-0308d21e4ff6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1520 microversion: 2.1 time: 0.554361 Mar 26 21:31:53.972826 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3126/5986] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:53 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1520 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:53.974269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:53.974902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:53.988164 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] Creating event network-vif-unplugged:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch1-master-1 Mar 26 21:31:53.994003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:31:54.004976 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-165dd394-fc91-4b9d-b92c-02065126bcfe req-7ae53954-ba81-4ab6-ac90-0ad62d5d2da4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127889 Mar 26 21:31:54.005947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2861/5987] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:31:54.989998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:54.990634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:54.998268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:54.998741 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:54.999526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:55.000015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:55.148073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:55.156029 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-537c1ff1-9a95-487c-9281-c8f887b11851 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1518 microversion: 2.1 time: 0.169939 Mar 26 21:31:55.156621 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3127/5988] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:54 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:56.026275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:56.034488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:56.034949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:56.046230 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] Creating event network-changed:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch1-master-1 Mar 26 21:31:56.051703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:31:56.062514 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9b7c8aaa-aaf9-42ea-8e75-fc68b6d3bd5d req-57f9c0d1-9d06-4844-9ce3-e8794e2080ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041281 Mar 26 21:31:56.063107 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2862/5989] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:31:56.177250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:56.177956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:56.188510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:56.189081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:56.189962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:56.190517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:56.470352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:56.479987 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-57918c66-791a-4630-a611-69b7f8500007 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1518 microversion: 2.1 time: 0.309540 Mar 26 21:31:56.481178 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3128/5990] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:56 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:57.498775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:57.499480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:57.505906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.506358 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.507135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.507578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.639869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:57.647183 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f57554b-476a-4ce4-9de0-4ae3366c01e3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1515 microversion: 2.1 time: 0.153559 Mar 26 21:31:57.647753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2863/5991] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:57 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:57.663656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:57.664252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:57.671899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.672409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.673200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.673663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.728854 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abe42f37-9e3d-437f-b700-d188a4f0f79a tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14/action" status: 204 len: 0 microversion: 2.1 time: 0.068958 Mar 26 21:31:57.730012 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3129/5992] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:31:57 2022] POST /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:31:57.738214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:57.738887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:57.744961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.745425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.746208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:57.746743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:57.964729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:57.972185 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bae46a24-0d56-49aa-a5f5-5b6f28d70128 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1515 microversion: 2.1 time: 0.237929 Mar 26 21:31:57.972762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2864/5993] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:57 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:58.990787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:58.991594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:58.998716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:58.999259 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.000731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.001196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.143051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:59.151194 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1ca80ca4-ebe3-4662-98e6-c073bf6eb564 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1507 microversion: 2.1 time: 0.165240 Mar 26 21:31:59.151778 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3130/5994] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:58 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:59.167907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:59.168543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:59.175591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.176080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.176851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.177297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.308498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:59.315881 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-accba118-3884-4a19-a0cf-f0aa0498e268 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1507 microversion: 2.1 time: 0.152567 Mar 26 21:31:59.316540 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2865/5995] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:59 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:59.333441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:59.334073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:59.340769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.341247 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.342047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.342509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.472264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:31:59.479723 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cae80dd5-4739-4765-aa5d-7f063d5f787f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 200 len: 1507 microversion: 2.1 time: 0.150328 Mar 26 21:31:59.480337 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3131/5996] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:31:59 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:31:59.495469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:31:59.496006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:31:59.501831 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.502288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.503052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:31:59.503524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:31:59.528323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:31:59.601428 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-67b1ebf4-3744-4e4a-af3b-1ecedb19eea4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 204 len: 0 microversion: 2.1 time: 0.109483 Mar 26 21:31:59.602270 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2866/5997] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:31:59 2022] DELETE /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:31:59.654938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1759405549", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "61740fd0-ccbd-4c4e-83df-5f568a3eb880"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:31:59.705446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] validate_networks() for [('61740fd0-ccbd-4c4e-83df-5f568a3eb880', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:32:00.069298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:32:00.069862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:32:00.070229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:32:00.070691 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:32:00.071127 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:32:00.080174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:00.080650 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:00.081488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:00.081947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:00.098500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Getting quotas for project 150ede058f8c4b61a827850135921da2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:32:00.103774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Getting quotas for user 1af836fd9f5f405e9f4f885c6b6970fa and project 150ede058f8c4b61a827850135921da2. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:32:00.116534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:32:00.118808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:32:00.162298 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61a8f63c-f279-4967-8c1f-5a40a901d91b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511215 Mar 26 21:32:00.162964 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3132/5998] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:32:00.174295 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0003705a-9dd7-48a9-b428-4ae91dbede24 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:00.175011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0003705a-9dd7-48a9-b428-4ae91dbede24 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:00.233239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0003705a-9dd7-48a9-b428-4ae91dbede24 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:00.240621 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0003705a-9dd7-48a9-b428-4ae91dbede24 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1218 microversion: 2.1 time: 0.070932 Mar 26 21:32:00.241373 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2867/5999] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:00 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:00.442065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2f5486da-1965-42b1-803c-e5583911184d req-85c809e6-49b0-457b-808c-52d06e13885d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "name": "network-vif-plugged", "status": "completed", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:00.451399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2f5486da-1965-42b1-803c-e5583911184d req-85c809e6-49b0-457b-808c-52d06e13885d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:00.451874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2f5486da-1965-42b1-803c-e5583911184d req-85c809e6-49b0-457b-808c-52d06e13885d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:00.464916 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2f5486da-1965-42b1-803c-e5583911184d req-85c809e6-49b0-457b-808c-52d06e13885d service nova] Creating event network-vif-plugged:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch1-master-1 Mar 26 21:32:00.470380 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2f5486da-1965-42b1-803c-e5583911184d req-85c809e6-49b0-457b-808c-52d06e13885d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Mar 26 21:32:00.471200 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3133/6000] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:32:01.258053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:01.258633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:01.268865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:01.269778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:01.270603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:01.271090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:01.347818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:01.357097 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2140fda4-1263-49c4-bd51-7d06a4acc02e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1276 microversion: 2.1 time: 0.102862 Mar 26 21:32:01.358260 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2868/6001] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:01 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:01.527647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b4a4c54a-031a-407b-b519-212b0a36d4b4 req-c92249fa-6c2c-4184-abc9-fc94a54947c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed644eb-5f99-4bab-8ae6-36ef4e566c14", "name": "network-vif-deleted", "tag": "17b13de9-4b02-4616-8994-9e98f10813b4"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:01.536513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b4a4c54a-031a-407b-b519-212b0a36d4b4 req-c92249fa-6c2c-4184-abc9-fc94a54947c9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:01.537573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b4a4c54a-031a-407b-b519-212b0a36d4b4 req-c92249fa-6c2c-4184-abc9-fc94a54947c9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:01.550193 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b4a4c54a-031a-407b-b519-212b0a36d4b4 req-c92249fa-6c2c-4184-abc9-fc94a54947c9 service nova] Creating event network-vif-deleted:17b13de9-4b02-4616-8994-9e98f10813b4 for instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 on nch1-master-1 Mar 26 21:32:01.555770 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b4a4c54a-031a-407b-b519-212b0a36d4b4 req-c92249fa-6c2c-4184-abc9-fc94a54947c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Mar 26 21:32:01.556629 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3134/6002] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:32:02.374916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:02.375539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:02.383291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:02.383755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:02.384581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:02.385033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:02.542683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-361a9e84-eab3-45a9-bf5d-5f4921167996 req-76d58863-7e67-4b8d-a96f-ddbdcaf4f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45dfba47-4f95-4382-b416-44665a97caf4", "tag": "7a0fe1af-7381-4743-bdbb-ece72d57ed14"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:02.552934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-361a9e84-eab3-45a9-bf5d-5f4921167996 req-76d58863-7e67-4b8d-a96f-ddbdcaf4f961 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:02.553503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-361a9e84-eab3-45a9-bf5d-5f4921167996 req-76d58863-7e67-4b8d-a96f-ddbdcaf4f961 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:02.570903 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-361a9e84-eab3-45a9-bf5d-5f4921167996 req-76d58863-7e67-4b8d-a96f-ddbdcaf4f961 service nova] Creating event network-changed:7a0fe1af-7381-4743-bdbb-ece72d57ed14 for instance 45dfba47-4f95-4382-b416-44665a97caf4 on nch1-master-1 Mar 26 21:32:02.576278 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-361a9e84-eab3-45a9-bf5d-5f4921167996 req-76d58863-7e67-4b8d-a96f-ddbdcaf4f961 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037907 Mar 26 21:32:02.577024 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3135/6003] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:32:02.957011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:02.964604 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ead97e6-1b10-420f-94ca-852db9fec411 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.593793 Mar 26 21:32:02.965197 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2869/6004] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:02 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:03.983161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:03.983933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:03.990261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:03.990735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:03.991534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:03.992025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:04.125747 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:04.133480 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a34b2f2-6f96-4683-b9db-527e49a6dc1b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.155628 Mar 26 21:32:04.134051 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3136/6005] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:03 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:05.151301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:05.151955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:05.158804 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:05.159266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:05.160079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:05.160534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:05.292661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:05.300324 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-65a12a46-c05c-4f6c-b696-6cee74ba65c1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.153408 Mar 26 21:32:05.300905 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2870/6006] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:05 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:06.317037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:06.317685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:06.324522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:06.324988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:06.325800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:06.326254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:06.462509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:06.471237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-55316a2a-e2bd-4b07-9033-4570d4149793 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.158083 Mar 26 21:32:06.471828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3137/6007] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:06 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:07.488559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:07.489174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:07.496504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:07.496955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:07.497722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:07.498164 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:07.632955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:07.640368 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0178966b-5311-443f-be5b-47c3a715d1b9 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.155648 Mar 26 21:32:07.640978 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2871/6008] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:07 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:08.480065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ca5ed0fa-fbac-4ab8-98ac-80f039eb4092 req-2d7c2f35-75fe-4c10-99d6-d8b6601baa03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dfba47-4f95-4382-b416-44665a97caf4", "name": "network-vif-plugged", "status": "completed", "tag": "7a0fe1af-7381-4743-bdbb-ece72d57ed14"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:08.491327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ca5ed0fa-fbac-4ab8-98ac-80f039eb4092 req-2d7c2f35-75fe-4c10-99d6-d8b6601baa03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:08.492017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ca5ed0fa-fbac-4ab8-98ac-80f039eb4092 req-2d7c2f35-75fe-4c10-99d6-d8b6601baa03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:08.503324 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ca5ed0fa-fbac-4ab8-98ac-80f039eb4092 req-2d7c2f35-75fe-4c10-99d6-d8b6601baa03 service nova] Creating event network-vif-plugged:7a0fe1af-7381-4743-bdbb-ece72d57ed14 for instance 45dfba47-4f95-4382-b416-44665a97caf4 on nch1-master-1 Mar 26 21:32:08.508620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ca5ed0fa-fbac-4ab8-98ac-80f039eb4092 req-2d7c2f35-75fe-4c10-99d6-d8b6601baa03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Mar 26 21:32:08.509598 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3138/6009] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:32:08.656751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:08.657503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:08.666353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:08.667025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:08.668114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:08.668784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:08.805716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:08.813540 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7b0b4e98-f5ea-436e-b0b4-e534587ba941 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.160722 Mar 26 21:32:08.814091 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2872/6010] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:08 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:09.831852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:09.832633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:09.840668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:09.841239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:09.842031 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:09.842487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:09.980888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:09.988256 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3d2ed85b-97b7-434d-b52d-4bc3b9362f9b tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1318 microversion: 2.1 time: 0.161247 Mar 26 21:32:09.988844 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3139/6011] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:09 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:11.004823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:11.005442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:11.012842 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.013299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.014080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.014531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.146027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:11.153937 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1b19f64e-14d2-4469-b35b-915bb4b38625 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1507 microversion: 2.1 time: 0.153050 Mar 26 21:32:11.154509 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2873/6012] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:10 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:11.170462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:11.171105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:11.178109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.178585 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.179378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.179842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.313658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:11.321140 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2dc884e-059c-4402-b768-8dfff1230245 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1507 microversion: 2.1 time: 0.155275 Mar 26 21:32:11.321721 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3140/6013] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:11 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:11.337577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:11.339308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:11.345213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.345672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.346435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.346878 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.375493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:11.381201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Old instance type m1.heat2, new instance type m1.heat {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:32:11.387759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:32:11.388250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:32:11.388729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:32:11.389137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:32:11.389553 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:32:11.450270 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8a91feb4-8611-4511-8b80-fdd918ea0825 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4/action" status: 202 len: 0 microversion: 2.1 time: 0.116618 Mar 26 21:32:11.450989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2874/6014] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:32:11 2022] POST /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:32:11.459176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:11.459812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:11.466387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.466876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.467668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:11.468171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:11.609813 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:11.617305 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e03d8be-f305-404d-adde-44b5b88fb688 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1514 microversion: 2.1 time: 0.162041 Mar 26 21:32:11.618063 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3141/6015] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:11 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:12.635781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:12.636475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:12.642485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:12.642946 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:12.643728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:12.644204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:12.902091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:12.909735 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-490c9336-529b-4d9e-8872-f4086563d80c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1514 microversion: 2.1 time: 0.278664 Mar 26 21:32:12.911223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2875/6016] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:12 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:13.926832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:13.927465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:13.933972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:13.934445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:13.935262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:13.935730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:14.070027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:14.077547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-792d38ad-85a8-4e28-af8d-c5e1370dd3e7 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.154785 Mar 26 21:32:14.078134 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3142/6017] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:13 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:15.095139 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:15.095762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:15.102732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:15.103187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:15.103974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:15.104913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:15.236093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:15.243441 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40498abe-6f55-4e98-95f1-3f6f2c1caa56 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.152225 Mar 26 21:32:15.244080 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2876/6018] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:15 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:16.261472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:16.262103 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:16.268918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:16.269396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:16.270190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:16.270652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:16.403332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:16.410764 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a8dafee-ba29-4c64-98fb-00098bb386e5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.153896 Mar 26 21:32:16.411345 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3143/6019] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:16 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:17.426896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:17.427526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:17.434374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:17.434839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:17.435622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:17.436121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:17.570903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:17.578916 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63999e72-d5fd-4e8f-97e5-05f42011005c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.155947 Mar 26 21:32:17.579498 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2877/6020] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:17 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:18.595420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:18.596096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:18.602995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:18.603463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:18.604950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:18.605413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:18.736238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:18.743620 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c704e19f-fe40-4e6a-8cfd-14fecc1f2d52 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.152204 Mar 26 21:32:18.744243 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3144/6021] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:18 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:19.760618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:19.761233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:19.768106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:19.768575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:19.769361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:19.769815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:19.899822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:19.907736 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0e8c85a-80f5-4e6c-b3c1-a91babed07b3 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.151127 Mar 26 21:32:19.908349 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2878/6022] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:19 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:20.924583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:20.925266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:20.932051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:20.933054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:20.933829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:20.934280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:21.074756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:21.082186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0578b68b-dcbe-4e34-8987-87705e7d15fd tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.161777 Mar 26 21:32:21.082773 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3145/6023] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:20 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:22.099287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:22.099911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:22.106565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:22.107030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:22.107798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:22.108275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:22.237794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:22.245747 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-95ce95ea-b8b0-42a0-94ac-dd9677464c58 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.150382 Mar 26 21:32:22.246356 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2879/6024] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:22 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:23.262446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:23.263100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:23.269883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:23.270355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:23.271136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:23.271595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:23.402612 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:23.410022 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-26799848-85da-4753-93b0-8c8c7e8e9b98 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.152045 Mar 26 21:32:23.410600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3146/6025] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:23 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:24.427084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:24.427704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:24.435061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:24.435514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:24.436328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:24.436772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:24.574728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:24.582179 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2dffe11c-ef64-4af1-9eff-696cbcacdd08 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.159052 Mar 26 21:32:24.582764 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2880/6026] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:24 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:25.291322 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:32:25.291518 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:32:25.599210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:25.599774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:25.606714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:25.607191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:25.608010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:25.608475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:25.747796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:25.755338 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c5ebfdc4-3117-4f4a-9679-454f525db22e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.160152 Mar 26 21:32:25.755935 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3147/6027] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:25 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:26.772542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:26.773090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:26.780091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:26.780554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:26.781334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:26.781782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:26.913287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:26.921429 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ec1226c-1499-43b4-b73f-d0dc761e7697 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.153149 Mar 26 21:32:26.921989 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2881/6028] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:26 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:27.939135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:27.939764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:27.946525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:27.946996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:27.947780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:27.948264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:28.079738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:28.087151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b62954a1-8efb-4b1b-8d16-70d7c6903a7f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.151955 Mar 26 21:32:28.087720 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3148/6029] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:27 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:29.104612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:29.105234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:29.112145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:29.112609 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:29.113388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:29.113839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:29.248603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:29.256005 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f73e96b-5543-4e29-87b8-5273e7c1b707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.155300 Mar 26 21:32:29.256580 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2882/6030] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:29 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:30.272774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:30.273553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:30.281417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:30.281894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:30.282702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:30.283172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:30.423810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:30.431197 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eccc58eb-62fa-4bcd-9ab4-85be27150d6f tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.162353 Mar 26 21:32:30.431780 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3149/6031] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:30 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:31.447808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:31.448455 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:31.455242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:31.455698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:31.456502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:31.456948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:31.594672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:31.602052 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-047319e3-693d-4833-8de8-b1c3fbb86c61 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.158185 Mar 26 21:32:31.602617 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2883/6032] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:31 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:32.618805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:32.619530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:32.626339 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:32.626789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:32.627564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:32.628048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:32.764424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:32.771890 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ade1d30-af35-4c58-9322-266bc1d51aa8 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.156968 Mar 26 21:32:32.772507 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3150/6033] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:32 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:32:33.789700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:33.790348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:33.797849 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:33.798307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:33.799080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:33.799521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:33.929516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:33.937520 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd33a93a-85b4-40a7-8a85-745ee86cc8ba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.151757 Mar 26 21:32:33.938095 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2884/6034] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:33 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:34.954866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:34.955491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:34.962251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:34.962720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:34.963507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:34.964004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:35.101928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:35.109329 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d72a834-b982-439e-85b9-7ad4ebc50963 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.158412 Mar 26 21:32:35.109903 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3151/6035] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:34 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:36.126195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:36.126750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:36.133466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:36.133920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:36.134688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:36.135128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:36.270919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:36.278871 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ed8281e2-5d9a-48dc-bf2b-419c16157e07 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.156720 Mar 26 21:32:36.279423 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2885/6036] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:36 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:37.295376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:37.295966 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:37.303092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:37.303565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:37.304393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:37.304856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:37.439666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:37.447086 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e2198721-765e-4303-a256-438bd9b27c69 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.156347 Mar 26 21:32:37.447667 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3152/6037] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:37 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:38.463888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:38.464580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:38.472035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:38.472538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:38.473326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:38.473776 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:38.610219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:38.617654 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f9328ad6-ed7e-4b8d-8a96-8e356c5f45b1 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.157738 Mar 26 21:32:38.618241 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2886/6038] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:38 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:39.634645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:39.635303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:39.642904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:39.643372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:39.644182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:39.644642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:39.776894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:39.784258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-12498467-1e63-42f9-a0af-80a8080e1eba tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1519 microversion: 2.1 time: 0.153482 Mar 26 21:32:39.784836 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3153/6039] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:39 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:40.801777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:40.802403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:40.809167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:40.809630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:40.810445 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:40.810955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:40.874479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dfba47-4f95-4382-b416-44665a97caf4", "name": "network-vif-unplugged", "status": "completed", "tag": "7a0fe1af-7381-4743-bdbb-ece72d57ed14"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:40.883153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:40.883621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:40.895793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] Creating event network-vif-unplugged:7a0fe1af-7381-4743-bdbb-ece72d57ed14 for instance 45dfba47-4f95-4382-b416-44665a97caf4 on nch2-master-1 Mar 26 21:32:40.902021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] Instance 45dfba47-4f95-4382-b416-44665a97caf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:32:40.918312 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-26a3f1cb-203d-449e-bcfd-c647ffde6a54 req-5484859e-c370-4bc9-9890-66ed0453d62f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048255 Mar 26 21:32:40.918933 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3154/6040] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:32:41.067780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:41.075940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4057a4e-3b01-4f63-ba3b-1499e791c32e tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1518 microversion: 2.1 time: 0.278318 Mar 26 21:32:41.076530 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2887/6041] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:40 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:42.095095 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:42.095839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:42.102098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:42.102568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:42.103347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:42.103802 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:42.236220 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:42.243533 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-36dc2096-23e7-48db-8e9a-46336f571707 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1516 microversion: 2.1 time: 0.154115 Mar 26 21:32:42.244140 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3155/6042] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:42 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:32:42.947172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45dfba47-4f95-4382-b416-44665a97caf4", "tag": "7a0fe1af-7381-4743-bdbb-ece72d57ed14"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:42.956096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:42.956555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:42.968329 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] Creating event network-changed:7a0fe1af-7381-4743-bdbb-ece72d57ed14 for instance 45dfba47-4f95-4382-b416-44665a97caf4 on nch2-master-1 Mar 26 21:32:42.976417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] Instance 45dfba47-4f95-4382-b416-44665a97caf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:32:42.988221 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a04d25a5-7f7d-4131-a84a-a7c86fcc3983 req-e64143e7-77f1-4d98-9ceb-9223570224bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044833 Mar 26 21:32:42.988829 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2888/6043] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:32:43.260909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:43.262017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:43.268282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.268758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.269547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.270007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.408020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:43.415845 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c7cc1c44-c58b-4491-9cdb-fed4e793c2d5 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1513 microversion: 2.1 time: 0.159073 Mar 26 21:32:43.416469 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3156/6044] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:43 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:43.433830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:43.434475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:43.440778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.441275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.442072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.442528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.501318 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b57f29af-f287-4109-98a7-aa46106a00c4 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "POST /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4/action" status: 204 len: 0 microversion: 2.1 time: 0.071744 Mar 26 21:32:43.502283 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2889/6045] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:32:43 2022] POST /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:32:43.510481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:43.511051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:43.517893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.518603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.519573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:43.520049 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:43.736956 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:43.744520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6360698e-9874-402b-8576-64291d68d8fc tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1513 microversion: 2.1 time: 0.238044 Mar 26 21:32:43.745367 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3157/6046] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:43 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:44.763081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:44.763801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:44.770895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:44.771366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:44.772182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:44.772639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:44.909758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:44.917624 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac0afb00-28d3-4a5a-9625-a6a2c3128eef tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1505 microversion: 2.1 time: 0.159979 Mar 26 21:32:44.918196 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2890/6047] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:44 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:44.934531 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:44.935158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:44.942232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:44.942705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:44.943497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:44.943987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.080432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:45.088108 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-90a1326c-3d8b-4126-b40c-12730f28ecd0 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1505 microversion: 2.1 time: 0.157894 Mar 26 21:32:45.088640 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3158/6048] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:44 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:45.103669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:45.104344 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:45.110869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.111327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.112140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.112594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.245477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:45.253461 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dd7e2155-5fd6-4080-a39e-44938ba2fd4d tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1505 microversion: 2.1 time: 0.153703 Mar 26 21:32:45.254042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2891/6049] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:45 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:45.269183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:45.269710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:45.275795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.276360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.277158 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.277621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.301695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:32:45.376244 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef8435d9-e3a3-4f9b-a863-65e36eb56b4c tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 204 len: 0 microversion: 2.1 time: 0.110329 Mar 26 21:32:45.376935 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3159/6050] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:32:45 2022] DELETE /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:32:45.392613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:45.393125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:45.399269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.399734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.400549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.401004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.426394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:32:45.471081 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.compute.api [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Instance is already in deleting state, ignoring this request Mar 26 21:32:45.471987 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-63cdc735-3c90-4e9f-9d3f-546e4c17a182 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 204 len: 0 microversion: 2.1 time: 0.083307 Mar 26 21:32:45.472565 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2892/6051] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:32:45 2022] DELETE /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:32:45.481652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:45.482383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:45.488348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.488823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.489651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:45.490110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:45.629593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:45.637209 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ca362cb9-13e5-4185-9240-984b7be397de tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1511 microversion: 2.1 time: 0.160361 Mar 26 21:32:45.638152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3160/6052] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:45 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:46.653763 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:46.654388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:46.661289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:46.661751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:46.662528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:46.662977 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:46.873121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af836fd9f5f405e9f4f885c6b6970fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ede058f8c4b61a827850135921da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:46.880892 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5367d11c-3a7c-4347-8f31-bcdb50622c19 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 200 len: 1511 microversion: 2.1 time: 0.231153 Mar 26 21:32:46.881915 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2893/6053] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:46 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:47.216611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-901ffcf1-727e-4c6c-9ed2-37c069c5d5b0 req-1759b9f8-1a7f-48bd-b484-66ec24cf122d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dfba47-4f95-4382-b416-44665a97caf4", "name": "network-vif-deleted", "tag": "7a0fe1af-7381-4743-bdbb-ece72d57ed14"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:47.226340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-901ffcf1-727e-4c6c-9ed2-37c069c5d5b0 req-1759b9f8-1a7f-48bd-b484-66ec24cf122d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.226873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-901ffcf1-727e-4c6c-9ed2-37c069c5d5b0 req-1759b9f8-1a7f-48bd-b484-66ec24cf122d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.239790 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-901ffcf1-727e-4c6c-9ed2-37c069c5d5b0 req-1759b9f8-1a7f-48bd-b484-66ec24cf122d service nova] Creating event network-vif-deleted:7a0fe1af-7381-4743-bdbb-ece72d57ed14 for instance 45dfba47-4f95-4382-b416-44665a97caf4 on nch2-master-1 Mar 26 21:32:47.244626 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-901ffcf1-727e-4c6c-9ed2-37c069c5d5b0 req-1759b9f8-1a7f-48bd-b484-66ec24cf122d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032436 Mar 26 21:32:47.245234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3161/6054] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:32:47.898016 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:47.898576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: 45dfba47-4f95-4382-b416-44665a97caf4] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:47.905357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.905809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.906578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.907121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.920908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] HTTP exception thrown: Instance 45dfba47-4f95-4382-b416-44665a97caf4 could not be found. Mar 26 21:32:47.921541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Returning 404 to user: Instance 45dfba47-4f95-4382-b416-44665a97caf4 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:32:47.922378 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bb41f874-d774-4c98-8d23-a472f20deb97 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4" status: 404 len: 111 microversion: 2.1 time: 0.028422 Mar 26 21:32:47.923187 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2894/6055] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:47 2022] GET /compute/v2.1/servers/45dfba47-4f95-4382-b416-44665a97caf4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:32:47.932081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:47.932729 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:47.939417 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.939897 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.940716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.941174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.954703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] HTTP exception thrown: Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 could not be found. Mar 26 21:32:47.955306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Returning 404 to user: Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:32:47.956167 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ef2bda37-86f9-4e2d-9e20-342106bd24b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 404 len: 111 microversion: 2.1 time: 0.028541 Mar 26 21:32:47.956693 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3162/6056] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:32:47 2022] DELETE /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:32:47.964678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:47.965308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] [instance: eed644eb-5f99-4bab-8ae6-36ef4e566c14] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:47.971225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.971696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.972501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:47.972955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:47.986716 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] HTTP exception thrown: Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 could not be found. Mar 26 21:32:47.987309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] Returning 404 to user: Instance eed644eb-5f99-4bab-8ae6-36ef4e566c14 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:32:47.988196 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c69bef7f-196e-482d-a896-5ee72dd301b6 tempest-ServerDiskConfigTestJSON-1143735945 tempest-ServerDiskConfigTestJSON-1143735945-project] 10.222.0.16 "GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14" status: 404 len: 111 microversion: 2.1 time: 0.027489 Mar 26 21:32:47.988721 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2895/6057] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:47 2022] GET /compute/v2.1/servers/eed644eb-5f99-4bab-8ae6-36ef4e566c14 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:32:53.852546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: .version_select at 0x7f6e5816e9d0>, body: {"keypair": {"name": "tempest-keypair-20944289"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:53.867290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:32:53.872735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:32:53.946535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:32:53.953035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:32:53.968321 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7e9dbcfd-31e2-4e78-92ca-52e5c023f2da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.234289 Mar 26 21:32:53.969122 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3163/6058] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:32:53 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:55.533899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-190989528", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3b6cf45-6f83-4e22-b160-72283064af17"}], "security_groups": [{"name": "tempest-securitygroup--861180895"}], "key_name": "tempest-keypair-20944289", "user_data": "}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:55.655742 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] validate_networks() for [('a3b6cf45-6f83-4e22-b160-72283064af17', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:32:56.106258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:32:56.106670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:32:56.107145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:32:56.107559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:32:56.107998 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:32:56.116714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:56.117165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:56.117986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:56.118630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:56.135607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:32:56.141585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:32:56.154154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:32:56.156485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:32:56.203459 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-03979a17-ddc4-49f1-8060-e9723f9a2d24 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.674479 Mar 26 21:32:56.204322 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2896/6059] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:32:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:32:56.216630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4ef840fb-0e55-4dae-bd3e-8fd319d48b1e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:56.217400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4ef840fb-0e55-4dae-bd3e-8fd319d48b1e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:56.287027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4ef840fb-0e55-4dae-bd3e-8fd319d48b1e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:56.295424 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4ef840fb-0e55-4dae-bd3e-8fd319d48b1e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1236 microversion: 2.1 time: 0.085301 Mar 26 21:32:56.299246 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3164/6060] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:56 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:57.315062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:57.315719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:57.323074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:57.323536 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:57.324382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:57.325020 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:57.399868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:57.408342 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad0c6ea4-8e93-4093-bf28-cfa64b86cdc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1294 microversion: 2.1 time: 0.098182 Mar 26 21:32:57.408939 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2897/6061] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:57 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:32:58.426075 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:58.426697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:58.437664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:58.438145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:58.438948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:58.439609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:58.592614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a9ba9bf9-4599-4a72-8798-7a0c6ca89eac req-e302912e-4020-4cbe-bc12-ee0e92993a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:32:58.601375 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:58.609544 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a31a46d-b987-4a78-b18a-ebdec86f9121 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.187669 Mar 26 21:32:58.610898 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3165/6062] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:58 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:32:58.629353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a9ba9bf9-4599-4a72-8798-7a0c6ca89eac req-e302912e-4020-4cbe-bc12-ee0e92993a06 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:58.629883 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a9ba9bf9-4599-4a72-8798-7a0c6ca89eac req-e302912e-4020-4cbe-bc12-ee0e92993a06 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:58.642465 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a9ba9bf9-4599-4a72-8798-7a0c6ca89eac req-e302912e-4020-4cbe-bc12-ee0e92993a06 service nova] Creating event network-changed:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch2-master-1 Mar 26 21:32:58.647990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a9ba9bf9-4599-4a72-8798-7a0c6ca89eac req-e302912e-4020-4cbe-bc12-ee0e92993a06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065440 Mar 26 21:32:58.648767 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2898/6063] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:32:59.626598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:32:59.627232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:32:59.633995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:59.634466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:59.635252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:32:59.635715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:32:59.771459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:32:59.779658 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d4c196d-afa3-4028-bf47-bf5046726852 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.156878 Mar 26 21:32:59.780216 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3166/6064] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:32:59 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:00.797473 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:00.798368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:00.804557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:00.805014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:00.805806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:00.806248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:00.943549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:00.951024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb0267b4-9764-4454-a104-78489ce79406 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.159186 Mar 26 21:33:00.951650 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2899/6065] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:00 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:01.968898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:01.969526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:01.977826 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:01.978302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:01.979101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:01.979561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:02.114223 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:02.122063 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de00ed6c-cbc1-4fbc-9bd1-1087a4c8a98b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.157191 Mar 26 21:33:02.122666 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3167/6066] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:01 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:03.139181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:03.139800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:03.146579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:03.147035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:03.147802 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:03.148276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:03.279835 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:03.287343 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15ba5e27-483f-4695-9cf5-df58f0cf5ebd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.152587 Mar 26 21:33:03.287912 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2900/6067] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:03 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:03.716067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-85c26fdc-4be2-4239-8023-93a1c962883c req-eda02ec4-8d8b-40d3-9a77-000e84b0ce95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "name": "network-vif-plugged", "status": "completed", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:03.725915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-85c26fdc-4be2-4239-8023-93a1c962883c req-eda02ec4-8d8b-40d3-9a77-000e84b0ce95 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:03.726389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-85c26fdc-4be2-4239-8023-93a1c962883c req-eda02ec4-8d8b-40d3-9a77-000e84b0ce95 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:03.738010 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-85c26fdc-4be2-4239-8023-93a1c962883c req-eda02ec4-8d8b-40d3-9a77-000e84b0ce95 service nova] Creating event network-vif-plugged:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch2-master-1 Mar 26 21:33:03.743047 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-85c26fdc-4be2-4239-8023-93a1c962883c req-eda02ec4-8d8b-40d3-9a77-000e84b0ce95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030702 Mar 26 21:33:03.743587 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3168/6068] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:04.304879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:04.305435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:04.312319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:04.312780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:04.313556 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:04.314006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:04.445045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:04.452369 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-87f04619-c66d-412a-a53f-ae550bc99fd2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1361 microversion: 2.1 time: 0.151539 Mar 26 21:33:04.452948 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2901/6069] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:04 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:05.469486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:05.470245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:05.476507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:05.476981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:05.477770 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:05.478226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:05.613892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:05.621335 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6c04db28-1c9e-4e8f-8139-f7aece4d2441 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1548 microversion: 2.1 time: 0.157073 Mar 26 21:33:05.621910 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3169/6070] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:05 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:05.637392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:05.637891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:05.644791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:05.645253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:05.646038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:05.646492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:05.727804 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bfd06b72-5af5-4e24-a185-73b47258d8b3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094311 Mar 26 21:33:05.728442 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2902/6071] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:33:05 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:06.682086 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:06.683940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:06.684134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2bc37643-da61-4c7e-bcf2-3423a35b5d05 req-8b8332ac-c22a-404e-b17e-9e699d1a48f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:06.690852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:06.691325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:06.692186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:06.692302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2bc37643-da61-4c7e-bcf2-3423a35b5d05 req-8b8332ac-c22a-404e-b17e-9e699d1a48f4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:06.692644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:06.692771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2bc37643-da61-4c7e-bcf2-3423a35b5d05 req-8b8332ac-c22a-404e-b17e-9e699d1a48f4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:06.712008 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2bc37643-da61-4c7e-bcf2-3423a35b5d05 req-8b8332ac-c22a-404e-b17e-9e699d1a48f4 service nova] Creating event network-changed:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch2-master-1 Mar 26 21:33:06.717276 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2bc37643-da61-4c7e-bcf2-3423a35b5d05 req-8b8332ac-c22a-404e-b17e-9e699d1a48f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038470 Mar 26 21:33:06.717890 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2903/6072] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:06.846651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:06.855843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6a62a441-e181-44d9-9a71-61e3102a0164 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1548 microversion: 2.1 time: 0.178575 Mar 26 21:33:06.856682 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3170/6073] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:06 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:06.873377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:06.874096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:06.880550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:06.881021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:06.881816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:06.882272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:07.472353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:07.484732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77a870fd-69d6-4e5f-887b-7e3bdec6b369 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1548 microversion: 2.1 time: 0.616242 Mar 26 21:33:07.485638 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2904/6074] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:06 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1548 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:08.502396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:08.503039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:08.509703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.510168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.510976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.511493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.641639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:08.649012 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8a90da88-9fc6-4855-b1d8-e88b5fb46d1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1665 microversion: 2.1 time: 0.150531 Mar 26 21:33:08.649599 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3171/6075] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:08 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:08.665152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:08.665766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:08.673405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.673869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.674677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.675106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.813921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:08.821488 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-20ef2b33-e6e5-428d-9d10-6144691c30a4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1665 microversion: 2.1 time: 0.160130 Mar 26 21:33:08.822266 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2905/6076] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:08 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:08.837423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:08.838517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:08.845304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.845778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.846573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.847030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.874629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:08.880755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Old instance type m1.heat2, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:33:08.887057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:33:08.887637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:33:08.888155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:33:08.888584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:33:08.889009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:33:08.954406 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fad2b9c3-e31a-42a0-b4d4-a7b547984ba2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/action" status: 202 len: 0 microversion: 2.1 time: 0.120864 Mar 26 21:33:08.955328 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3172/6077] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:33:08 2022] POST /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:33:08.963243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:08.963861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:08.970416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.970872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:08.971677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:08.972152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:09.135225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:09.143187 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2f550cf-5aaf-4507-ba22-57293d449caa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1674 microversion: 2.1 time: 0.183864 Mar 26 21:33:09.143763 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2906/6078] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:08 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:10.162097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:10.162644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:10.172442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:10.172912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:10.173950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:10.174404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:10.312824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:10.320567 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-39197eec-e2b6-478a-a808-e928b320cc8d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1674 microversion: 2.1 time: 0.163260 Mar 26 21:33:10.321314 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3173/6079] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:10 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:11.338171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:11.338710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:11.345654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:11.346121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:11.346906 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:11.347359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:11.485285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:11.494892 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18cd234b-fbf6-4528-a9ba-7de8f9dca5c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.160699 Mar 26 21:33:11.495512 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2907/6080] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:11 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:12.513661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:12.514273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:12.521003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:12.521472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:12.522251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:12.522709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:12.654243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:12.661681 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4386799-d546-47f5-a436-557891040b8e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.152742 Mar 26 21:33:12.662258 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3174/6081] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:12 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:13.678881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:13.679513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:13.686360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:13.686824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:13.687602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:13.688089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:13.820253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:13.828175 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-002e4469-4c5a-4046-ba50-a1c9b8d3b19e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.153236 Mar 26 21:33:13.828747 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2908/6082] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:13 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:14.845153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:14.845777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:14.852524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:14.852992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:14.853768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:14.854250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:14.992768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:15.000340 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-736ff796-30d7-45f6-9380-00af0744166d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.159144 Mar 26 21:33:15.000921 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3175/6083] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:14 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:16.017811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:16.018587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:16.026078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:16.026690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:16.027941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:16.028483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:16.165210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:16.173897 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef69b66d-eaeb-4d03-9702-0f9b13d61484 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.159821 Mar 26 21:33:16.174581 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2909/6084] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:16 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:17.191232 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:17.191818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:17.198624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:17.199724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:17.200542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:17.201002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:17.332506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:17.339979 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b21e0cb0-598b-48c0-91fd-ec4cbea4b72a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.152704 Mar 26 21:33:17.340560 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3176/6085] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:17 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:18.356812 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:18.357950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:18.364958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:18.365413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:18.366183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:18.366625 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:18.497971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:18.505380 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9a5603f7-3503-4dc2-9205-5491a8666048 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.152624 Mar 26 21:33:18.505947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2910/6086] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:18 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:19.522132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:19.522795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:19.529619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:19.530089 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:19.530875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:19.531337 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:19.665228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:19.673214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3c988ba0-616d-4abd-b649-c8cc70d72746 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.155028 Mar 26 21:33:19.674057 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3177/6087] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:19 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:20.690744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:20.691409 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:20.698350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:20.698813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:20.699589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:20.700068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:20.834491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:20.842446 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-72cfc7f7-8675-4aee-90fb-a638cd316727 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.155705 Mar 26 21:33:20.843019 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2911/6088] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:20 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:21.859131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:21.859771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:21.866596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:21.867067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:21.867853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:21.868338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:22.000324 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:22.007665 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-703ffdb9-415e-4924-81af-819daaafe207 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.152980 Mar 26 21:33:22.008270 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3178/6089] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:21 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:23.024950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:23.025582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:23.036437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:23.036921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:23.037694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:23.038147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:23.173896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:23.181414 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-81a976f3-0029-4e5b-9835-f4dc852f2cdb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.160449 Mar 26 21:33:23.181990 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2912/6090] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:23 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:24.198640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:24.199294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:24.206419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:24.206888 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:24.207673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:24.208159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:24.341560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:24.348941 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-156f31cd-f194-4b68-b0e6-83bbba65c279 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.154260 Mar 26 21:33:24.349530 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3179/6091] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:24 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:25.366166 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:25.366730 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:25.373551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:25.374003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:25.374769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:25.375211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:25.506402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:25.514239 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-247166e2-800b-4ef5-a71e-7423411f74f3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.152150 Mar 26 21:33:25.514797 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2913/6092] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:25 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:26.531170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:26.531795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:26.538613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:26.539082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:26.539856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:26.540334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:26.675250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:26.682654 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-826b10c2-eb97-40c3-bfe8-fae5bb51f57e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1679 microversion: 2.1 time: 0.156020 Mar 26 21:33:26.683230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3180/6093] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:26 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:27.701594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:27.702211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:27.708610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:27.709119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:27.710494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:27.710925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:27.939851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:27.947224 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-953e8a1e-d198-4673-af0b-6395564f030c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1678 microversion: 2.1 time: 0.251024 Mar 26 21:33:27.947815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2914/6094] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:27 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:28.012061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "name": "network-vif-unplugged", "status": "completed", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:28.022696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:28.023326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:28.036516 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] Creating event network-vif-unplugged:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch1-master-1 Mar 26 21:33:28.041949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] Instance 1071ae51-9176-4425-b5df-a99aa39cd56d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:33:28.052988 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-10202e10-03a3-4986-83e9-72de5967368d req-143e2b43-3fba-4c81-b9c7-cef0392b8633 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044891 Mar 26 21:33:28.053601 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3181/6095] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:28.965962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:28.967007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:28.974270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:28.974728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:28.975509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:28.976143 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:29.115623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:29.123681 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc90e131-4225-40d3-90de-557f68b630c3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1678 microversion: 2.1 time: 0.161974 Mar 26 21:33:29.124449 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2915/6096] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:28 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:30.072145 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:30.080306 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:30.080778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:30.091905 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] Creating event network-changed:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch1-master-1 Mar 26 21:33:30.097188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] Instance 1071ae51-9176-4425-b5df-a99aa39cd56d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:33:30.108024 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0e0e7c28-7021-43e5-8c4c-21551cd4412b req-0e374763-774a-4bbc-ab1a-53b3fc906c38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040419 Mar 26 21:33:30.108614 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3182/6097] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:30.140400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:30.141019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:30.147834 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:30.148328 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:30.149122 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:30.149570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:30.504833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:30.512535 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e70d6780-9688-44d0-9ccd-034d94477ecb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1676 microversion: 2.1 time: 0.376022 Mar 26 21:33:30.513124 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2916/6098] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:30 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1676 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:31.531415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:31.532382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:31.538659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.539141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.539993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.540391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.675594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:31.683639 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ae97f1d-5c29-474d-bb33-33845efe4d29 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1673 microversion: 2.1 time: 0.157135 Mar 26 21:33:31.684284 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3183/6099] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:31 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:31.700571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:31.701098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:31.708289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.708952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.709927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.710370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.768332 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d24d6269-60e3-4021-a757-1ad8fd040755 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/action" status: 204 len: 0 microversion: 2.1 time: 0.071646 Mar 26 21:33:31.768984 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2917/6100] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:33:31 2022] POST /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:33:31.777299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:31.777932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:31.784152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.784765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.785777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:31.786389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:31.932675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:31.940328 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d8306a61-c62e-4278-908f-9e48c3abdc11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1673 microversion: 2.1 time: 0.167081 Mar 26 21:33:31.940911 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3184/6101] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:31 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:33:32.960426 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:32.961983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:32.968407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:32.969087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:32.970104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:32.970709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.114917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:33.122522 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b3bef80-93a9-4d48-93a1-475c447e0efa tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1665 microversion: 2.1 time: 0.167309 Mar 26 21:33:33.123662 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2918/6102] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:32 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:33.139191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:33.139818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:33.146461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.146933 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.147735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.148213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.280687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:33.288366 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f087c5c-b942-4b5e-b84e-d56cdc477de8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1665 microversion: 2.1 time: 0.152992 Mar 26 21:33:33.288942 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3185/6103] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:33 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:33.305269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:33.305891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:33.313226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.313226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.314176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.314632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.446967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:33.454361 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9ce0313-b6bd-45c8-b86a-57655957a528 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1665 microversion: 2.1 time: 0.153049 Mar 26 21:33:33.454959 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2919/6104] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:33 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:33.470766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:33.471283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:33.477379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.477853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.478631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.479109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.502961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:33:33.575449 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-263a883f-c044-4b7e-8188-759be696f7c7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 204 len: 0 microversion: 2.1 time: 0.108754 Mar 26 21:33:33.576415 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3186/6105] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:33:33 2022] DELETE /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:33:33.584714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:33.585332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:33.591801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.592306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.593076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:33.593520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:33.727183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:33.734792 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-417ba65a-a967-4ea2-a2d2-618d51dbb1dc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1671 microversion: 2.1 time: 0.153938 Mar 26 21:33:33.735411 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2920/6106] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:33 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:34.753809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:34.754529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:34.761281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:34.761754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:34.762541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:34.763000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:34.904735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:34.913140 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3b5ff322-c071-4dc2-a183-503077c2aec6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1671 microversion: 2.1 time: 0.163598 Mar 26 21:33:34.913924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3187/6107] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:34 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:35.019149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2fb8a60b-04cf-492d-a489-b02bb37c6639 req-0330395a-02b8-4b6a-8969-9aff52d891bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "name": "network-vif-plugged", "status": "completed", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:35.028185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2fb8a60b-04cf-492d-a489-b02bb37c6639 req-0330395a-02b8-4b6a-8969-9aff52d891bc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:35.028645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2fb8a60b-04cf-492d-a489-b02bb37c6639 req-0330395a-02b8-4b6a-8969-9aff52d891bc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:35.041028 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2fb8a60b-04cf-492d-a489-b02bb37c6639 req-0330395a-02b8-4b6a-8969-9aff52d891bc service nova] Creating event network-vif-plugged:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch1-master-1 Mar 26 21:33:35.046786 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2fb8a60b-04cf-492d-a489-b02bb37c6639 req-0330395a-02b8-4b6a-8969-9aff52d891bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Mar 26 21:33:35.047403 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2921/6108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:35.930882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:35.931555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:35.939226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:35.939848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:35.940716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:35.941175 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:36.008066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:36.015703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cecfd53e-d713-411a-a55a-4dcff621983d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 200 len: 1604 microversion: 2.1 time: 0.088777 Mar 26 21:33:36.016305 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3188/6109] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:35 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:36.218916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-51d9836c-deef-49ff-bf42-2d5bdd27d10d req-df04503d-6134-44ce-be65-b20cd2b0340b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1071ae51-9176-4425-b5df-a99aa39cd56d", "name": "network-vif-deleted", "tag": "b4e3af8e-6675-41d1-85f0-5aec41aba9b7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:36.228929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51d9836c-deef-49ff-bf42-2d5bdd27d10d req-df04503d-6134-44ce-be65-b20cd2b0340b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:36.229392 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-51d9836c-deef-49ff-bf42-2d5bdd27d10d req-df04503d-6134-44ce-be65-b20cd2b0340b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:36.245282 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-51d9836c-deef-49ff-bf42-2d5bdd27d10d req-df04503d-6134-44ce-be65-b20cd2b0340b service nova] Creating event network-vif-deleted:b4e3af8e-6675-41d1-85f0-5aec41aba9b7 for instance 1071ae51-9176-4425-b5df-a99aa39cd56d on nch1-master-1 Mar 26 21:33:36.251182 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-51d9836c-deef-49ff-bf42-2d5bdd27d10d req-df04503d-6134-44ce-be65-b20cd2b0340b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Mar 26 21:33:36.252093 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2922/6110] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:37.033562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:37.034393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:37.041415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.041885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.042687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.043146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.057713 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. Mar 26 21:33:37.058332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:33:37.059187 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e552bf7f-a30f-44cc-87e7-b1fe2d733fe6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 404 len: 111 microversion: 2.1 time: 0.030236 Mar 26 21:33:37.059756 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3189/6111] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:37 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:33:37.074919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:37.075635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:37.082805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.083266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.084113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.084622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.099085 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. Mar 26 21:33:37.099693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:33:37.100578 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-200d2093-6934-4194-a0f8-cca376cc3fad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 404 len: 111 microversion: 2.1 time: 0.030446 Mar 26 21:33:37.101130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2923/6112] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:37 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:33:37.149814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1180580949", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "a3b6cf45-6f83-4e22-b160-72283064af17"}], "security_groups": [{"name": "tempest-securitygroup--861180895"}], "key_name": "tempest-keypair-20944289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:37.252984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] validate_networks() for [('a3b6cf45-6f83-4e22-b160-72283064af17', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:33:37.617249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:33:37.617694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:33:37.618188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:33:37.618614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:33:37.619043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:33:37.628411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.628880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.629703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:37.630161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:37.646510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:33:37.651749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:33:37.664034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:33:37.666316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:33:37.711610 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17486256-2fb8-483d-b271-944b9ae92fb9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.565682 Mar 26 21:33:37.712289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3190/6113] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:33:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:33:37.722403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-812aacdd-d39a-4ef6-a8e0-6b99ca44587f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:37.723144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-812aacdd-d39a-4ef6-a8e0-6b99ca44587f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:37.776837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-812aacdd-d39a-4ef6-a8e0-6b99ca44587f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:37.783637 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-812aacdd-d39a-4ef6-a8e0-6b99ca44587f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1237 microversion: 2.1 time: 0.065297 Mar 26 21:33:37.784351 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2924/6114] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:37 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:38.802446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:38.803069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:38.810616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:38.811141 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:38.812024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:38.812719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:38.886171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:38.894219 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45347e96-073a-4081-80b5-f1109babd251 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1295 microversion: 2.1 time: 0.096895 Mar 26 21:33:38.894794 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3191/6115] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:38 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:39.911824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:39.912634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:39.920853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:39.921449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:39.922341 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:39.922889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:40.065243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-f90a727b-ecf7-4ee6-bab7-aa59a993dca6 req-8d469a2c-8691-4f0f-8a40-aad4f926efde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:40.080732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f90a727b-ecf7-4ee6-bab7-aa59a993dca6 req-8d469a2c-8691-4f0f-8a40-aad4f926efde service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:40.081202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-f90a727b-ecf7-4ee6-bab7-aa59a993dca6 req-8d469a2c-8691-4f0f-8a40-aad4f926efde service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:40.098065 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-f90a727b-ecf7-4ee6-bab7-aa59a993dca6 req-8d469a2c-8691-4f0f-8a40-aad4f926efde service nova] Creating event network-changed:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch1-master-1 Mar 26 21:33:40.104775 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-f90a727b-ecf7-4ee6-bab7-aa59a993dca6 req-8d469a2c-8691-4f0f-8a40-aad4f926efde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043306 Mar 26 21:33:40.105901 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3192/6116] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:33:40.169544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:40.178158 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-623e4904-0361-43f0-873d-4a8eceb9d5cd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.270309 Mar 26 21:33:40.179056 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2925/6117] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:39 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:41.197725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:41.198444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:41.204646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:41.205113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:41.205889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:41.206341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:41.338207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:41.345570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ebbefc39-7ec5-4ad7-9868-4160d9249714 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.152982 Mar 26 21:33:41.346147 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3193/6118] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:41 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:42.362206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:42.362744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:42.369688 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:42.370155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:42.370965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:42.371420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:42.506995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:42.515212 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-89cd7344-f6ff-48ba-b772-0d9761e3a1af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.157094 Mar 26 21:33:42.515796 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2926/6119] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:42 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:43.533261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:43.533811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:43.540166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:43.540631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:43.541402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:43.541855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:43.678471 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:43.685811 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-94945ad2-d046-4cec-9280-c613e1463d04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.157287 Mar 26 21:33:43.686385 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3194/6120] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:43 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:44.703661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:44.704307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:44.711163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:44.711620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:44.712702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:44.713150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:44.847157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:44.854564 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-59aa73be-9702-42df-b441-28bfcdcfe3fc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.155455 Mar 26 21:33:44.855148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2927/6121] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:44 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:45.035541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3e72059e-38fd-4df9-b1a9-69f4755a928f req-ffcaf140-297d-46dc-ac7f-27535364ae2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "name": "network-vif-plugged", "status": "completed", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:45.045022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3e72059e-38fd-4df9-b1a9-69f4755a928f req-ffcaf140-297d-46dc-ac7f-27535364ae2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:45.045500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3e72059e-38fd-4df9-b1a9-69f4755a928f req-ffcaf140-297d-46dc-ac7f-27535364ae2a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:45.059214 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3e72059e-38fd-4df9-b1a9-69f4755a928f req-ffcaf140-297d-46dc-ac7f-27535364ae2a service nova] Creating event network-vif-plugged:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch1-master-1 Mar 26 21:33:45.064623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3e72059e-38fd-4df9-b1a9-69f4755a928f req-ffcaf140-297d-46dc-ac7f-27535364ae2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Mar 26 21:33:45.065446 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3195/6122] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:45.871132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:45.871764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:45.879141 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:45.879596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:45.880383 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:45.880825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:46.014488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:46.023438 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b0a868fe-5052-41d5-87fe-4dbe9d8d3cf9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1362 microversion: 2.1 time: 0.156178 Mar 26 21:33:46.024887 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2928/6123] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:45 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:47.042084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:47.042806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:47.049347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:47.049822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:47.050607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:47.051066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:47.182725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:47.190797 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c72fc277-454a-438b-8d94-252f5c787076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1548 microversion: 2.1 time: 0.153897 Mar 26 21:33:47.191367 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3196/6124] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:47 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:47.207529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:47.208063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:47.214736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:47.215189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:47.215992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:47.216438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:47.296949 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3744272-ba86-4af2-8ef5-a553728f7d9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093336 Mar 26 21:33:47.297553 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2929/6125] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:33:47 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:48.247198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3e024ef9-73d2-4fc0-abfc-fe2a723bac4e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:48.252268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0fe6b862-e21d-488a-b3db-8fcb1f60ff34 req-a00d2f94-b720-43d8-a100-48e713c0b2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:33:48.259756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e024ef9-73d2-4fc0-abfc-fe2a723bac4e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:48.260267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3e024ef9-73d2-4fc0-abfc-fe2a723bac4e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:48.267144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0fe6b862-e21d-488a-b3db-8fcb1f60ff34 req-a00d2f94-b720-43d8-a100-48e713c0b2e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:48.267596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0fe6b862-e21d-488a-b3db-8fcb1f60ff34 req-a00d2f94-b720-43d8-a100-48e713c0b2e1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:48.289016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3e024ef9-73d2-4fc0-abfc-fe2a723bac4e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:33:48.289563 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0fe6b862-e21d-488a-b3db-8fcb1f60ff34 req-a00d2f94-b720-43d8-a100-48e713c0b2e1 service nova] Creating event network-changed:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch1-master-1 Mar 26 21:33:48.295253 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0fe6b862-e21d-488a-b3db-8fcb1f60ff34 req-a00d2f94-b720-43d8-a100-48e713c0b2e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054832 Mar 26 21:33:48.296088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2930/6126] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:33:48.341319 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3e024ef9-73d2-4fc0-abfc-fe2a723bac4e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action" status: 202 len: 0 microversion: 2.1 time: 0.103521 Mar 26 21:33:48.343646 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3197/6127] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:33:48 2022] POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:33:48.353063 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:48.354298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:48.362933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:48.363674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:48.364682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:48.365334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:48.616486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:48.624419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7af182ac-86f0-44a9-9835-4691b428b44a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1558 microversion: 2.1 time: 0.276043 Mar 26 21:33:48.625189 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2931/6128] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:48 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:33:49.643808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:49.644567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:49.650821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:49.651298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:49.652125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:49.652590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:49.791189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:49.798879 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd002b41-aec1-4944-818a-23298caf5a65 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.160851 Mar 26 21:33:49.799724 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3198/6129] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:49 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:50.816518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:50.817087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:50.823785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:50.824274 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:50.825043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:50.825490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:50.959047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:50.966359 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-be5f9ad4-0000-410e-bbda-c21dbd1ee7d3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.153875 Mar 26 21:33:50.967486 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2932/6130] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:50 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:51.984909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:51.985589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:51.992389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:51.992856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:51.993651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:51.994091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:52.126239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:52.133627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8ab72849-42cb-414b-97b3-21c9a5e0b711 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.153113 Mar 26 21:33:52.134193 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3199/6131] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:51 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:53.150872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:53.151483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:53.157917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:53.158399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:53.159163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:53.159601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:53.288813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:53.296720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-08a8ea3a-ca3c-4515-8e1e-7fae77967a1d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.149970 Mar 26 21:33:53.297293 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2933/6132] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:53 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:33:54.314725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:54.315298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:54.321792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:54.322263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:54.323048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:54.323511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:54.455165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:54.462661 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f80571fc-64e1-4150-8605-7d85e2a0eb05 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.152674 Mar 26 21:33:54.463236 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3200/6133] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:54 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:55.479482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:55.480129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:55.487025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:55.487479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:55.488283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:55.488724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:55.620734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:55.628215 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53112cd9-ef05-410c-aee5-0bf52cfee758 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.152559 Mar 26 21:33:55.628799 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2934/6134] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:55 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:56.645146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:56.645771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:56.652814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:56.653280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:56.654548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:56.655041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:56.794377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:56.802602 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4a276ddb-104a-404a-a4d6-91ac50ecd466 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.161342 Mar 26 21:33:56.803182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3201/6135] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:56 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:57.819570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:57.820214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:57.826685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:57.827138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:57.827927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:57.828372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:57.960066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:57.967320 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-409d4ea7-5201-4802-940d-a79953e9eb89 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.151858 Mar 26 21:33:57.967895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2935/6136] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:57 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:33:58.983516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:33:58.984188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:33:58.991018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:58.991491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:58.992311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:33:58.992777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:33:59.124801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:33:59.132235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08bcf759-9445-4d79-8ecc-69ef90d1852a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.152699 Mar 26 21:33:59.132818 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3202/6137] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:33:58 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:00.149761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:00.150384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:00.158091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:00.158461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:00.159240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:00.159686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:00.291904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:00.299574 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca1a5bdf-0771-4945-b345-9ca72569561d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.153472 Mar 26 21:34:00.300178 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2936/6138] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:00 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:01.316739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:01.317323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:01.324144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:01.324620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:01.325404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:01.325864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:01.462425 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:01.470546 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-263755a6-47f0-4878-9e62-fdfed0570ef4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.157853 Mar 26 21:34:01.471123 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3203/6139] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:01 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:02.488140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:02.488760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:02.495525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:02.496008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:02.496782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:02.497224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:02.633079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:02.640493 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e691435a-d8e2-4c3c-a283-3b37dc153737 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.156408 Mar 26 21:34:02.641074 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2937/6140] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:02 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:03.658012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:03.658645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:03.665426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:03.665895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:03.666671 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:03.667126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:03.797906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:03.805584 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fa5f4549-ddc2-4b83-911d-bddddcff62a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.151981 Mar 26 21:34:03.806186 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3204/6141] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:03 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:04.821953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:04.822493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:04.829230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:04.829681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:04.830451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:04.830892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:04.961090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:04.968910 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f123cf33-15b9-419d-8f3f-9f006e56b3e8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.150922 Mar 26 21:34:04.969482 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2938/6142] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:04 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:05.985737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:05.986394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:05.993543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:05.994016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:05.994807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:05.995264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:06.128233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:06.135694 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e0b49a3b-a9e7-41dc-b599-a06210cba68f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.154389 Mar 26 21:34:06.136303 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3205/6143] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:05 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:07.151828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:07.152472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:07.159325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:07.159788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:07.160597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:07.161047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:07.292869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:07.300433 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f516819c-27ae-44a6-93ed-c5e6a92dfe56 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.152607 Mar 26 21:34:07.301010 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2939/6144] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:07 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:08.317613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:08.318152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:08.325008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:08.325478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:08.326768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:08.327228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:08.461362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:08.469408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6e1a780e-9f6d-4031-b835-a76cf68f5d1f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.155814 Mar 26 21:34:08.469988 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3206/6145] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:08 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:09.486961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:09.487607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:09.494537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:09.494989 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:09.495761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:09.496236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:09.625751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:09.633444 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1117ed9-4601-45d3-88ab-48a45009b001 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.150985 Mar 26 21:34:09.634024 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2940/6146] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:09 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:34:10.650613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:10.651250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:10.658068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:10.658541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:10.659361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:10.659818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:10.792048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:10.800203 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8bf825a5-9cf0-4d52-990a-9eb95688ca12 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.153489 Mar 26 21:34:10.800781 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3207/6147] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:10 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:11.817305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:11.817949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:11.824741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:11.825200 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:11.826576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:11.827019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:11.961909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:11.969477 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b41f47ae-101c-4525-9f5b-576a73f315ac tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.156073 Mar 26 21:34:11.970056 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2941/6148] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:11 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:12.986935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:12.987580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:12.994997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:12.995473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:12.996301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:12.996765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:13.133648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:13.141027 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0e338c99-2171-406f-9674-2a81ddf6d3b6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.158571 Mar 26 21:34:13.141600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3208/6149] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:12 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:14.158574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:14.159194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:14.166053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.166516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.167298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.167748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.300756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:14.308148 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-237da49d-ef72-4a4b-b9db-778489258cd1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1652 microversion: 2.1 time: 0.154053 Mar 26 21:34:14.308734 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2942/6150] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:14 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:14.324411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:14.325401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:14.332684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.333157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.333943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.334426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.361639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:14.367294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Old instance type m1.heat2, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:34:14.373527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:34:14.373968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:34:14.374461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:34:14.374890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:34:14.375320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:34:14.436088 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a074689-1eee-4a46-ad68-d2ef70edce13 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action" status: 202 len: 0 microversion: 2.1 time: 0.115595 Mar 26 21:34:14.436698 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3209/6151] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:34:14 2022] POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:34:14.445061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:14.445715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:14.452652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.453106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.453876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:14.454316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:14.617679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:14.625598 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-878ed635-c2fc-4361-8fe6-80905d8dcf59 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.184597 Mar 26 21:34:14.626174 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2943/6152] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:14 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:34:15.644012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:15.644659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:15.650909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:15.651386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:15.652224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:15.652690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:15.787504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:15.795014 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8dd4d543-9b5d-4a1c-a7ff-57eda628f534 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1675 microversion: 2.1 time: 0.156044 Mar 26 21:34:15.795686 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3210/6153] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:15 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:34:16.812504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:16.813127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:16.819995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:16.820460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:16.821237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:16.821694 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:16.953542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:16.961038 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-44837bde-bbe3-460f-917a-05fc21d78a32 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1680 microversion: 2.1 time: 0.153152 Mar 26 21:34:16.961636 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2944/6154] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:16 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:17.978947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:17.979606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:17.986947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:17.987423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:17.988231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:17.988693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:18.123460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:18.130893 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2e86eb6d-cd06-4b9c-97f2-45bc8f1d9ed8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1680 microversion: 2.1 time: 0.155913 Mar 26 21:34:18.131477 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3211/6155] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:17 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:19.096526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "name": "network-vif-unplugged", "status": "completed", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:19.106085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:19.106569 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:19.118192 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] Creating event network-vif-unplugged:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch2-master-1 Mar 26 21:34:19.124076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] Instance 84182e46-e480-4292-8337-9ae3f60d062b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:34:19.136205 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-874c94b2-7b46-494a-8577-aeb4f7fc2ee4 req-1e50c10a-bdcc-441a-ad58-10f0dea1f901 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043130 Mar 26 21:34:19.136521 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2945/6156] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:34:19.149005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:19.149757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:19.158003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:19.158811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:19.159730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:19.160290 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:19.304752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:19.312998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b0c1a83-9742-46e8-b7c6-84ab155d1590 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1679 microversion: 2.1 time: 0.168591 Mar 26 21:34:19.316632 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3212/6157] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:19 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:20.330923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:20.331631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:20.338648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:20.339108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:20.339886 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:20.340365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:20.481992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:20.489512 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-36158f97-efa5-4319-97fc-95d631ed46af tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1677 microversion: 2.1 time: 0.163384 Mar 26 21:34:20.490090 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2946/6158] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:20 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:21.154501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:21.163853 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.164342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.176814 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] Creating event network-changed:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch2-master-1 Mar 26 21:34:21.182142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] Instance 84182e46-e480-4292-8337-9ae3f60d062b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:34:21.193512 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-63de23c4-18ca-4697-ab02-e4249e296d42 req-c8da398d-7818-4021-a36c-052a7b923135 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042874 Mar 26 21:34:21.194122 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3213/6159] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:34:21.506800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:21.507416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:21.514651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.514651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.514993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.515434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.810920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:21.818234 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4cb06b46-2f2a-47b3-8af9-746a91ee9ce2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1673 microversion: 2.1 time: 0.315540 Mar 26 21:34:21.818815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2947/6160] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:21 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1673 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:21.835504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:21.836173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:21.842892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.843364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.844169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.844626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.912734 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d9f06382-ce81-405c-9621-360488f28add tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action" status: 204 len: 0 microversion: 2.1 time: 0.081322 Mar 26 21:34:21.913554 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3214/6161] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:34:21 2022] POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:34:21.921848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:21.922461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:21.929938 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.930391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:21.931414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:21.932058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:22.259542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:22.268921 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5ac1b7de-65c3-4a4c-8246-7fd646961786 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1673 microversion: 2.1 time: 0.351016 Mar 26 21:34:22.269506 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2948/6162] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:21 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1673 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:23.287055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:23.288038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:23.294805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.295286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.296116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.296577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.441920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:23.449892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fb614f45-83c1-4c8d-9fba-a7303244ec28 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1652 microversion: 2.1 time: 0.167285 Mar 26 21:34:23.450467 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3215/6163] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:23 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1652 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:23.468726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:23.469355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:23.477194 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.477660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.478442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.478900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.610340 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:23.617748 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-34e7a90b-3090-469c-b188-4f3a1bb70996 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1652 microversion: 2.1 time: 0.154688 Mar 26 21:34:23.618326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2949/6164] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:23 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1652 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:23.634121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6f336f86-f153-4d18-b73d-810f80864c20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:23.640985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f336f86-f153-4d18-b73d-810f80864c20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.641461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6f336f86-f153-4d18-b73d-810f80864c20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.662279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6f336f86-f153-4d18-b73d-810f80864c20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:34:23.703050 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6f336f86-f153-4d18-b73d-810f80864c20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action" status: 202 len: 0 microversion: 2.1 time: 0.072689 Mar 26 21:34:23.703640 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3216/6165] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:34:23 2022] POST /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:34:23.712336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:23.712995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:23.719466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.719953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.720759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:23.721185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:23.945743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:23.954509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aaaa25e3-83aa-4b00-81a6-59da5b78f734 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1661 microversion: 2.1 time: 0.246177 Mar 26 21:34:23.955738 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2950/6166] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:23 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1661 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:24.068825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-60240ce8-c8fb-4e36-8c95-3ce9b2767f3a req-520b6385-c006-4ed2-b7e3-e8b8cd0e4fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "name": "network-vif-plugged", "status": "completed", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:24.078733 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-60240ce8-c8fb-4e36-8c95-3ce9b2767f3a req-520b6385-c006-4ed2-b7e3-e8b8cd0e4fbc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:24.079153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-60240ce8-c8fb-4e36-8c95-3ce9b2767f3a req-520b6385-c006-4ed2-b7e3-e8b8cd0e4fbc service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:24.094100 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-60240ce8-c8fb-4e36-8c95-3ce9b2767f3a req-520b6385-c006-4ed2-b7e3-e8b8cd0e4fbc service nova] Creating event network-vif-plugged:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch2-master-1 Mar 26 21:34:24.098898 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-60240ce8-c8fb-4e36-8c95-3ce9b2767f3a req-520b6385-c006-4ed2-b7e3-e8b8cd0e4fbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035304 Mar 26 21:34:24.099803 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3217/6167] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:24.973649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:24.974261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:24.981267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:24.981748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:24.982526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:24.982969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:25.120753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:25.128744 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e83ec4c6-c15b-42ab-a023-767a9d6158e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1665 microversion: 2.1 time: 0.159045 Mar 26 21:34:25.129316 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2951/6168] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:24 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:25.147073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:25.147672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:25.153787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:25.154286 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:25.155096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:25.155546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:25.179788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:34:25.251176 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e42e70ee-f20f-44ba-9747-9391d8d9a167 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 204 len: 0 microversion: 2.1 time: 0.108774 Mar 26 21:34:25.255358 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3218/6169] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:34:25 2022] DELETE /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:34:25.260794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:25.261407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:25.268145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:25.268601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:25.269365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:25.269809 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:25.405754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:25.413068 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8d5d8883-68ac-4f5b-b15a-627683ba1090 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1671 microversion: 2.1 time: 0.156263 Mar 26 21:34:25.413672 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2952/6170] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:25 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:26.431143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:26.431871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:26.438667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:26.439144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:26.439957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:26.440422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:26.575577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:26.584095 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-738eca57-e013-4f10-a525-562493f7be74 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 200 len: 1671 microversion: 2.1 time: 0.157215 Mar 26 21:34:26.584872 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3219/6171] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:26 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:27.389330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c3a9115b-a88d-4290-aab8-477e652ea773 req-78a696a4-4890-4dc5-bb69-1617d1c19cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182e46-e480-4292-8337-9ae3f60d062b", "name": "network-vif-deleted", "tag": "c9f65bcd-1500-4f49-ae54-a70d6a459ddb"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:27.398879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c3a9115b-a88d-4290-aab8-477e652ea773 req-78a696a4-4890-4dc5-bb69-1617d1c19cb3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:27.399687 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c3a9115b-a88d-4290-aab8-477e652ea773 req-78a696a4-4890-4dc5-bb69-1617d1c19cb3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:27.412883 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c3a9115b-a88d-4290-aab8-477e652ea773 req-78a696a4-4890-4dc5-bb69-1617d1c19cb3 service nova] Creating event network-vif-deleted:c9f65bcd-1500-4f49-ae54-a70d6a459ddb for instance 84182e46-e480-4292-8337-9ae3f60d062b on nch2-master-1 Mar 26 21:34:27.417825 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c3a9115b-a88d-4290-aab8-477e652ea773 req-78a696a4-4890-4dc5-bb69-1617d1c19cb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 Mar 26 21:34:27.418439 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2953/6172] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:27.601101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:27.601766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:27.609555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:27.610093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:27.610948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:27.611473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:27.625207 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. Mar 26 21:34:27.625828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:34:27.626678 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c33c007e-f143-4fd3-a217-1f258761d54b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 404 len: 111 microversion: 2.1 time: 0.029589 Mar 26 21:34:27.627235 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3220/6173] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:27 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:34:27.647692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:27.648478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:27.655192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:27.655654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:27.656464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:27.656914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:27.671127 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. Mar 26 21:34:27.671739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:34:27.672614 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-37954a30-fa0a-45bd-8960-cbc7bebdc9ad tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 404 len: 111 microversion: 2.1 time: 0.029292 Mar 26 21:34:27.673175 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2954/6174] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:27 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:34:27.719311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-592026862", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "a3b6cf45-6f83-4e22-b160-72283064af17"}], "security_groups": [{"name": "tempest-securitygroup--861180895"}], "key_name": "tempest-keypair-20944289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:27.816635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] validate_networks() for [('a3b6cf45-6f83-4e22-b160-72283064af17', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:34:28.217423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:34:28.217872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:34:28.218373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:34:28.218833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:34:28.219271 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:34:28.228526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:28.228998 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:28.229827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:28.230280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:28.247125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:34:28.253104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:34:28.266069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:34:28.268408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:34:28.315498 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72f8aae8-9d7d-4668-90fd-5e296d915761 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.600600 Mar 26 21:34:28.316182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3221/6175] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:34:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:34:28.327644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c325b4fd-9e41-42bf-84cd-2503841ee6c1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:28.328630 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c325b4fd-9e41-42bf-84cd-2503841ee6c1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:28.386176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c325b4fd-9e41-42bf-84cd-2503841ee6c1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:28.394769 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c325b4fd-9e41-42bf-84cd-2503841ee6c1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1236 microversion: 2.1 time: 0.072330 Mar 26 21:34:28.395368 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2955/6176] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:28 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:29.412936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:29.413582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:29.420945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:29.421422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:29.422228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:29.422689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:29.497120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:29.504960 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8cb6ac3a-4bb2-4fbb-83c7-a7fc461925a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1294 microversion: 2.1 time: 0.096905 Mar 26 21:34:29.505547 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3222/6177] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:29 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:30.523489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:30.524095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:30.532566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:30.532967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:30.533777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:30.534225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:30.789512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:30.798136 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-620d6d61-f973-46e6-baa5-2655a03b369b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.278611 Mar 26 21:34:30.798728 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2956/6178] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:30 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:30.954096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6f8d7018-62a7-4d6b-9268-63822a774861 req-e8387741-fe77-4bec-ad2a-3e8fd48c4e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:30.969610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6f8d7018-62a7-4d6b-9268-63822a774861 req-e8387741-fe77-4bec-ad2a-3e8fd48c4e7b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:30.970077 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6f8d7018-62a7-4d6b-9268-63822a774861 req-e8387741-fe77-4bec-ad2a-3e8fd48c4e7b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:30.981656 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6f8d7018-62a7-4d6b-9268-63822a774861 req-e8387741-fe77-4bec-ad2a-3e8fd48c4e7b service nova] Creating event network-changed:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:34:30.987573 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6f8d7018-62a7-4d6b-9268-63822a774861 req-e8387741-fe77-4bec-ad2a-3e8fd48c4e7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037720 Mar 26 21:34:30.988841 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3223/6179] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:31.816104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:31.816734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:31.823508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:31.824106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:31.824927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:31.825419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:31.982908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:31.990453 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f978d3b-0699-489c-942b-8c86c697376a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.178441 Mar 26 21:34:31.991056 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2957/6180] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:31 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:33.009138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:33.009861 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:33.016300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:33.016768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:33.017565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:33.018023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:33.149205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:33.156537 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d1ef2763-c796-4387-8491-9a8dcf96f7e0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.152546 Mar 26 21:34:33.157108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3224/6181] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:33 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:34.174965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:34.175592 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:34.182466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:34.182862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:34.183640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:34.184119 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:34.315085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:34.322598 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-954d4946-58e1-45de-8e5a-526b9716bb10 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.151837 Mar 26 21:34:34.323178 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2958/6182] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:34 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:35.339213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:35.339768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:35.346519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:35.346996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:35.347781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:35.348423 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:35.480543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:35.488500 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10235f03-169c-4a83-a1b7-1a78bb0c2586 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.153317 Mar 26 21:34:35.489076 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3225/6183] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:35 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:36.112715 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7971f4a0-c351-4233-ad2f-f33e212ee51f req-e0019eae-4dd1-4460-8c7e-57f8a9f390a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "name": "network-vif-plugged", "status": "completed", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:36.122380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7971f4a0-c351-4233-ad2f-f33e212ee51f req-e0019eae-4dd1-4460-8c7e-57f8a9f390a5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:36.122781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7971f4a0-c351-4233-ad2f-f33e212ee51f req-e0019eae-4dd1-4460-8c7e-57f8a9f390a5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:36.134788 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7971f4a0-c351-4233-ad2f-f33e212ee51f req-e0019eae-4dd1-4460-8c7e-57f8a9f390a5 service nova] Creating event network-vif-plugged:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:34:36.140352 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7971f4a0-c351-4233-ad2f-f33e212ee51f req-e0019eae-4dd1-4460-8c7e-57f8a9f390a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031373 Mar 26 21:34:36.140946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2959/6184] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:36.506562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:36.507196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:36.514513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:36.514976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:36.515755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:36.516240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:36.652228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:36.659599 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f3a06dd-21bb-4125-9e76-676c869f0aa1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1361 microversion: 2.1 time: 0.156968 Mar 26 21:34:36.660227 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3226/6185] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:36 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:37.677723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:37.678465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:37.685738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:37.686229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:37.687004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:37.687454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:37.820244 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:37.828392 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2dca82f2-ad3a-461f-9434-b5499e230d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1548 microversion: 2.1 time: 0.155210 Mar 26 21:34:37.828976 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2960/6186] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:37 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:37.844834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:37.845358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:37.852011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:37.852481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:37.853254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:37.853708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:37.936189 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-76e0994b-2245-47dc-9326-f059a5af8ebf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094600 Mar 26 21:34:37.936873 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3227/6187] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:34:37 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:38.901585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:38.902654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:38.905189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2060b2d3-c367-4656-8aad-76e5e8a8390e req-001e88c8-e0ea-4ae2-9bfa-34526e25b3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:34:38.911118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:38.911662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:38.912693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:38.913362 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2060b2d3-c367-4656-8aad-76e5e8a8390e req-001e88c8-e0ea-4ae2-9bfa-34526e25b3b9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:38.913587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:38.913821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2060b2d3-c367-4656-8aad-76e5e8a8390e req-001e88c8-e0ea-4ae2-9bfa-34526e25b3b9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:38.927883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2060b2d3-c367-4656-8aad-76e5e8a8390e req-001e88c8-e0ea-4ae2-9bfa-34526e25b3b9 service nova] Creating event network-changed:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:34:38.933119 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2060b2d3-c367-4656-8aad-76e5e8a8390e req-001e88c8-e0ea-4ae2-9bfa-34526e25b3b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Mar 26 21:34:38.933723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3228/6188] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:34:38.945029 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:38.952410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Old instance type m1.heat2, new instance type m1.heat {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:34:38.959129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:34:38.959622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:34:38.960148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:34:38.960573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:34:38.960997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:34:39.035232 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bda5623c-d8fa-4bd6-8e9e-41401d5251b7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/action" status: 202 len: 0 microversion: 2.1 time: 0.137562 Mar 26 21:34:39.038915 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2961/6189] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:34:38 2022] POST /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:34:39.045941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:39.047986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:39.055578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:39.056465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:39.057381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:39.058094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:39.228931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:39.238265 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9a82b16e-96ac-4c1d-a9be-e4d0dd4368b1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1557 microversion: 2.1 time: 0.197530 Mar 26 21:34:39.239182 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3229/6190] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:39 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1557 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:40.254943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:40.255572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:40.262533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:40.263002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:40.263795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:40.264273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:40.411676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:40.420319 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b8be1a53-5ba5-4346-9f93-7147e8dbd46b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1674 microversion: 2.1 time: 0.168743 Mar 26 21:34:40.420909 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2962/6191] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:40 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:41.438329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:41.438960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:41.448188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:41.448661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:41.449451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:41.449910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:41.582472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:41.589998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d251f2b4-adab-42df-af21-a5089535dd3b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.156134 Mar 26 21:34:41.590585 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3230/6192] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:41 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:42.607793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:42.608451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:42.615310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:42.615768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:42.616577 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:42.617024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:42.747209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:42.755208 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3b75c563-fb7d-48d3-8ee0-0db122c1fb23 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.151324 Mar 26 21:34:42.755787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2963/6193] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:42 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:43.772935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:43.773564 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:43.780916 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:43.781389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:43.782172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:43.782620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:43.913353 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:43.920772 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb4ca5f3-af5e-4445-874f-b638ffd52843 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.151894 Mar 26 21:34:43.921347 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3231/6194] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:43 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:44.938705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:44.939333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:44.946232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:44.946696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:44.947474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:44.948005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:45.086640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:45.094073 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f3b51346-1d87-423c-97ea-84b2d32908c6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.159883 Mar 26 21:34:45.094651 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2964/6195] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:44 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:46.111311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:46.111964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:46.118844 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:46.119319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:46.120142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:46.120602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:46.257163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:46.264819 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-164505c7-9e9e-4d88-abb0-07db5d8f4708 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.158128 Mar 26 21:34:46.265395 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3232/6196] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:46 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:47.281463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:47.282004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:47.288816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:47.289272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:47.290035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:47.290475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:47.424785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:47.432516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4cb1b227-6282-41fe-9575-93f98e11775d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.155103 Mar 26 21:34:47.433091 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2965/6197] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:47 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:48.450160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:48.450786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:48.458233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:48.458697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:48.459474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:48.459946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:48.592705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:48.600361 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-59097291-93fa-4f24-96c7-d986242cd813 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.154104 Mar 26 21:34:48.600933 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3233/6198] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:48 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:49.617135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:49.617770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:49.625301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:49.625766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:49.626589 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:49.627049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:49.762759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:49.770367 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a9b9463e-6b5b-4f52-a90e-d0cf77689c36 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.157068 Mar 26 21:34:49.770944 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2966/6199] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:49 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:50.786567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:50.787226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:50.794012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:50.794494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:50.795281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:50.795742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:50.931202 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:50.939171 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd8dd781-62a2-4b3f-90e1-f1cebce83b7e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.156521 Mar 26 21:34:50.939743 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3234/6200] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:50 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:51.956627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:51.957245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:51.963794 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:51.964279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:51.965057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:51.965503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:52.097497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:52.105008 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b43f0700-fc8c-480f-b697-40ea8a7f8c92 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.152332 Mar 26 21:34:52.105582 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2967/6201] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:51 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:53.122062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:53.122684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:53.129688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:53.130163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:53.130952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:53.131412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:53.263524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:53.271722 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dcd97c32-7746-440c-b2f2-7e788856d5b5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.153571 Mar 26 21:34:53.272331 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3235/6202] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:53 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:54.289587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:54.290215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:54.297806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:54.298288 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:54.299100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:54.299594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:54.429798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:54.437862 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-20a71f71-a8c9-4cc9-b43d-67b625917e3d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.152361 Mar 26 21:34:54.438434 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2968/6203] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:54 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:55.455381 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:55.456072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:55.462477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:55.462950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:55.463735 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:55.464224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:55.603201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:55.610675 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a83bc00e-d5b4-4485-af54-aa754825f6a8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.159899 Mar 26 21:34:55.611260 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3236/6204] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:55 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:56.627605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:56.628258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:56.634868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:56.635334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:56.636165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:56.636615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:56.770165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:56.777630 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-515572f5-26ce-4936-bed4-b5cd222db126 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.154008 Mar 26 21:34:56.778211 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2969/6205] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:56 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:34:57.794522 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:57.795153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:57.802695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:57.803159 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:57.804000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:57.804455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:57.939110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:57.946640 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a28f6c67-25bf-4b7b-a30a-9384e88d2140 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.155971 Mar 26 21:34:57.947212 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3237/6206] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:57 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:34:58.962563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:34:58.963215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:34:58.970108 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:58.970560 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:58.971336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:34:58.971778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:34:59.103424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:34:59.110823 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-12c7e634-03bd-46a0-b381-c9c85112ea84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.152184 Mar 26 21:34:59.111397 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2970/6207] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:34:58 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:00.127880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:00.128538 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:00.135499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:00.136010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:00.136808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:00.137273 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:00.270839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:00.278420 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08246e51-6676-4114-b72d-0092c397c8e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.154419 Mar 26 21:35:00.278937 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3238/6208] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:00 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:01.297157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:01.297701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:01.304744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:01.305210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:01.305988 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:01.306441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:01.443305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:01.450754 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dbc7a76b-56eb-4ae1-9295-40482ff1d6f7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.158243 Mar 26 21:35:01.451327 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2971/6209] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:01 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:02.468502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:02.469139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:02.476019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:02.476498 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:02.477297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:02.477769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:02.616726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:02.624151 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-098a1f57-51fa-4fdd-bc5f-1dad4a41d31c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.159649 Mar 26 21:35:02.624739 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3239/6210] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:02 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:03.641544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:03.642158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:03.649448 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:03.649905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:03.650677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:03.651116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:03.781601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:03.789060 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8628beed-0e3f-471f-844e-d04f4eb011ed tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.151995 Mar 26 21:35:03.789674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2972/6211] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:03 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:04.806039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:04.806663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:04.814012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:04.814481 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:04.815255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:04.815710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:04.946958 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:04.955793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-692e5501-2bc2-4dfa-a374-04907ee39a11 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.153738 Mar 26 21:35:04.956394 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3240/6212] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:04 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:05.973393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:05.974173 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:05.981080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:05.981551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:05.982330 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:05.982778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:06.168910 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:06.177568 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a9663bc-6107-47f7-9d9a-73251c9552d8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.208202 Mar 26 21:35:06.178247 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2973/6213] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:05 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:07.194990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:07.195629 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:07.202426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:07.202931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:07.203720 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:07.204209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:07.399415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:07.407444 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ae692f12-e8ab-406f-be52-18a8e6215902 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.216537 Mar 26 21:35:07.408045 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3241/6214] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:07 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:08.424086 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:08.424701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:08.431685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:08.432178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:08.432947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:08.433393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:08.566956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:08.574633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-18bdef3c-4f1e-4c90-bb7a-793a6728a80b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.155002 Mar 26 21:35:08.575212 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2974/6215] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:08 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:09.591790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:09.592526 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:09.599406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:09.599882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:09.600704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:09.601164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:09.733462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:09.740892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b7862c2c-3033-47d6-8697-b68368e69fec tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.153074 Mar 26 21:35:09.741463 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3242/6216] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:09 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:10.758790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:10.759417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:10.766923 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:10.767384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:10.768190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:10.768639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:10.898806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:10.906214 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38e32b79-ef8e-4f1c-ac3d-ed36b18b115c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.151331 Mar 26 21:35:10.906785 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2975/6217] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:10 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:11.922946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:11.923571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:11.930760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:11.931226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:11.932044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:11.932506 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:12.064356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:12.071878 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-798a61b0-c1ee-4299-ab24-f37c2adf3d8b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1679 microversion: 2.1 time: 0.152912 Mar 26 21:35:12.072472 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3243/6218] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:11 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:13.089430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:13.090072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:13.097439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:13.097925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:13.098709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:13.099161 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:13.288303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "name": "network-vif-unplugged", "status": "completed", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:13.298477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:13.298947 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:13.311659 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] Creating event network-vif-unplugged:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch1-master-1 Mar 26 21:35:13.316342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:13.318082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] Instance a6f1b046-a678-45f1-9ae5-03f034094e99 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:35:13.325925 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e3f8527d-3790-48cd-9aeb-cf2ee115f4e5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1678 microversion: 2.1 time: 0.240223 Mar 26 21:35:13.326794 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2976/6219] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:13 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:13.338692 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9fc8e5c7-9cd9-45c9-979c-75f674e1e961 req-3241da33-13ff-4570-9b87-cebe4e8a0f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054331 Mar 26 21:35:13.339312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3244/6220] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:35:14.342995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:14.343620 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:14.350458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:14.350925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:14.351702 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:14.352186 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:14.489721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:14.497316 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7eb7c6c7-019c-473a-89db-0e99f09d7c2d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1676 microversion: 2.1 time: 0.158189 Mar 26 21:35:14.497850 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2977/6221] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:14 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:15.356385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:15.365242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:15.365702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:15.377332 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] Creating event network-changed:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch1-master-1 Mar 26 21:35:15.382569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] Instance a6f1b046-a678-45f1-9ae5-03f034094e99 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:35:15.393508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-61a47285-cac4-41a7-9b69-9ece468c10c0 req-ef0979c0-7e08-46f5-98d6-aa0bbb4624f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041230 Mar 26 21:35:15.394083 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3245/6222] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:15.515393 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:15.516041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:15.522813 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:15.523271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:15.524070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:15.524513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:16.245652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:16.253087 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a7afb94f-bb75-478f-aa6d-9eb6bd639076 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1676 microversion: 2.1 time: 0.742281 Mar 26 21:35:16.253661 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2978/6223] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:15 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1676 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:17.271589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:17.272329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:17.279560 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.280065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.280856 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.281311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.421924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:17.429721 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-56dd003b-6381-4e79-8a4d-96c7373f30a1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1673 microversion: 2.1 time: 0.163192 Mar 26 21:35:17.430328 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3246/6224] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:17 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:17.446704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:17.447241 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:17.454061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.454524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.455337 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.455785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.493126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.493588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.494396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.494841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.515744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:35:17.520971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:35:17.618119 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f92ebebb-5b64-4f17-a265-18c8d57d158f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/action" status: 202 len: 0 microversion: 2.1 time: 0.175257 Mar 26 21:35:17.618664 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2979/6225] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:35:17 2022] POST /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:35:17.627268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:17.627948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:17.634074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.634616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.635438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:17.636026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:17.775034 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:17.783911 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-471bb0f0-f574-4ec9-9130-0e6fd3fc66da tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1672 microversion: 2.1 time: 0.160537 Mar 26 21:35:17.784785 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3247/6226] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:17 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:18.803893 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:18.804633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:18.810933 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:18.812031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:18.812817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:18.813270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:18.945268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:18.952768 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bcde56e4-de50-4246-badb-497fcc38d12b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1672 microversion: 2.1 time: 0.154316 Mar 26 21:35:18.953351 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2980/6227] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:18 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:19.456571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "name": "network-vif-plugged", "status": "completed", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:19.465776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:19.466252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:19.478804 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] Creating event network-vif-plugged:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch1-master-1 Mar 26 21:35:19.484074 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] Instance a6f1b046-a678-45f1-9ae5-03f034094e99 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:35:19.494629 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-db808d55-82a8-49bb-928e-6ce36e46d578 req-a2b9428f-8bb2-4c2c-876d-257fc81e9c36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041772 Mar 26 21:35:19.495241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3248/6228] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:19.970327 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:19.970967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:19.977683 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:19.978174 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:19.978942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:19.979386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:20.116432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:20.124222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b5d4937-74c2-4b8f-a127-2abae741e0ce tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1672 microversion: 2.1 time: 0.157452 Mar 26 21:35:20.124802 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2981/6229] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:19 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:20.847134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "name": "network-vif-unplugged", "status": "completed", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:20.857451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:20.858494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:20.870412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] Creating event network-vif-unplugged:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:35:20.875753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] Instance a6f1b046-a678-45f1-9ae5-03f034094e99 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:35:20.886545 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7fa53a22-9c8b-436a-906b-afbb3a69ada5 req-a918aec2-d847-4ad1-bc7e-f50a3cf3a197 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044216 Mar 26 21:35:20.887327 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3249/6230] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:21.141449 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:21.142075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:21.148928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:21.149388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:21.150171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:21.150669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:21.402858 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:21.411504 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f96c132e-ba00-4f34-8cc1-07acd3025192 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1672 microversion: 2.1 time: 0.274392 Mar 26 21:35:21.412246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2982/6231] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:21 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:22.430268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:22.430978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:22.437221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:22.437718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:22.438495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:22.438954 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:22.574233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:22.582076 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c1048bb7-f841-449b-b650-74558b2fb0f8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1672 microversion: 2.1 time: 0.157160 Mar 26 21:35:22.582646 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3250/6232] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:22 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:35:22.903311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:22.912039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:22.912497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:22.926442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] Creating event network-changed:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:35:22.931667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] Instance a6f1b046-a678-45f1-9ae5-03f034094e99 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:35:22.942706 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c9bbd546-6fe0-47b1-96f1-b476d15d98dc req-d30eac9a-c81b-419c-8464-c6d4d1c71e03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043106 Mar 26 21:35:22.943287 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2983/6233] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:23.599639 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:23.600561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:23.606942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.607422 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:23.608849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.609309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:23.746959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:23.754841 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-08bbf84a-ad4c-46a8-98c0-728b889ea502 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1665 microversion: 2.1 time: 0.159289 Mar 26 21:35:23.755355 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3251/6234] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:23 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:23.771632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:23.772486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:23.778708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.779277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:23.780669 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.781184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:23.927440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:23.934781 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-aa0e98f5-cc06-40b5-9a47-161eb0547c4d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1665 microversion: 2.1 time: 0.167539 Mar 26 21:35:23.935353 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2984/6235] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:23 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:23.950356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:23.950982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:23.957358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.957822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:23.958597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:23.959051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:24.095524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:24.102934 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-27f5160e-74e7-46aa-adb3-ee6c0facd606 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1665 microversion: 2.1 time: 0.156407 Mar 26 21:35:24.103509 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3252/6236] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:23 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:24.118749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:24.119270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:24.125265 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:24.125726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:24.126502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:24.126952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:24.151030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:35:24.226267 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d762c9ac-b638-42cc-9742-b857b5cd4b5d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 204 len: 0 microversion: 2.1 time: 0.111281 Mar 26 21:35:24.226859 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2985/6237] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:35:24 2022] DELETE /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:35:24.235236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:24.235955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:24.241730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:24.242197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:24.242974 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:24.243426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:24.376523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:24.384998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f09c5ee-e23f-4429-8468-e884bd18265d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1671 microversion: 2.1 time: 0.153707 Mar 26 21:35:24.385582 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3253/6238] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:24 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:25.403361 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:25.404781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:25.412435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:25.412900 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:25.413920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:25.414273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:25.573678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:25.581636 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d94e13f-afb9-4d4d-820d-3d43b56cfa9c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1671 microversion: 2.1 time: 0.182677 Mar 26 21:35:25.582223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2986/6239] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:25 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:26.599146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:26.599788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:26.606665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:26.607155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:26.608567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:26.609032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:26.670910 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:26.679124 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7de9afa5-77ea-4fe1-98f3-f3bcd150c1ff tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 200 len: 1604 microversion: 2.1 time: 0.083750 Mar 26 21:35:26.680106 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3254/6240] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:26 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 1604 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:26.725918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9f674275-ce0c-42e0-b0d0-d369bdb5b73b req-ec3b719e-b8e4-4702-9e0c-762c63c8a083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1b046-a678-45f1-9ae5-03f034094e99", "name": "network-vif-deleted", "tag": "42383a66-e6a8-460a-ab82-6d80dac24f0d"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:26.735279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f674275-ce0c-42e0-b0d0-d369bdb5b73b req-ec3b719e-b8e4-4702-9e0c-762c63c8a083 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:26.735734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9f674275-ce0c-42e0-b0d0-d369bdb5b73b req-ec3b719e-b8e4-4702-9e0c-762c63c8a083 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:26.747173 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9f674275-ce0c-42e0-b0d0-d369bdb5b73b req-ec3b719e-b8e4-4702-9e0c-762c63c8a083 service nova] Creating event network-vif-deleted:42383a66-e6a8-460a-ab82-6d80dac24f0d for instance a6f1b046-a678-45f1-9ae5-03f034094e99 on nch2-master-1 Mar 26 21:35:26.753920 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9f674275-ce0c-42e0-b0d0-d369bdb5b73b req-ec3b719e-b8e4-4702-9e0c-762c63c8a083 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030971 Mar 26 21:35:26.756868 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2987/6241] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:27.695803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:27.696493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:27.703767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:27.704198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:27.705294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:27.705454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:27.720843 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. Mar 26 21:35:27.721472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:35:27.722340 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-395f3154-ee89-43cf-9717-50e6bb787cd3 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 404 len: 111 microversion: 2.1 time: 0.030658 Mar 26 21:35:27.726040 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3255/6242] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:27 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:35:27.743230 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:27.744096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:27.752407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:27.752971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:27.753863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:27.754386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:27.769256 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. Mar 26 21:35:27.769896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:35:27.770740 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0547ca73-ed68-4fa4-8afa-972901875a40 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 404 len: 111 microversion: 2.1 time: 0.031885 Mar 26 21:35:27.771512 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2988/6243] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:27 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 26 21:35:27.821548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1315294308", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "a3b6cf45-6f83-4e22-b160-72283064af17"}], "security_groups": [{"name": "tempest-securitygroup--861180895"}], "key_name": "tempest-keypair-20944289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:27.924125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] validate_networks() for [('a3b6cf45-6f83-4e22-b160-72283064af17', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:35:28.345752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:35:28.346194 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:35:28.346714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:35:28.347138 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:35:28.347568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:35:28.357190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:28.357660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:28.359037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:28.359487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:28.375854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:35:28.381122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:35:28.393798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:35:28.396136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:35:28.440832 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99714594-ac86-4921-8290-3567cb492a80 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.623208 Mar 26 21:35:28.441490 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3256/6244] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:35:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:35:28.452178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f87bb98-2837-4682-8306-c897ac77945d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:28.453039 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f87bb98-2837-4682-8306-c897ac77945d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:28.510064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f87bb98-2837-4682-8306-c897ac77945d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:28.517568 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f87bb98-2837-4682-8306-c897ac77945d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1237 microversion: 2.1 time: 0.069411 Mar 26 21:35:28.518112 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2989/6245] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:28 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:35:29.535203 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:29.535955 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:29.542801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:29.543268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:29.544111 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:29.544565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:29.610287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:29.617708 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-405b1520-4cbb-427b-a6aa-545b02d4dab8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1295 microversion: 2.1 time: 0.086472 Mar 26 21:35:29.618279 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3257/6246] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:29 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:30.635213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:30.635828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:30.644716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:30.645487 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:30.647001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:30.647451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:30.848355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3c6ec299-88c7-4fce-a2a1-531733f38117 req-b100464a-63a0-4a32-86bc-af41f56ccb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:30.862798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3c6ec299-88c7-4fce-a2a1-531733f38117 req-b100464a-63a0-4a32-86bc-af41f56ccb56 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:30.863605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3c6ec299-88c7-4fce-a2a1-531733f38117 req-b100464a-63a0-4a32-86bc-af41f56ccb56 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:30.886704 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3c6ec299-88c7-4fce-a2a1-531733f38117 req-b100464a-63a0-4a32-86bc-af41f56ccb56 service nova] Creating event network-changed:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:35:30.892125 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:30.893560 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3c6ec299-88c7-4fce-a2a1-531733f38117 req-b100464a-63a0-4a32-86bc-af41f56ccb56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050048 Mar 26 21:35:30.894769 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3258/6247] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:35:30.901480 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d97b5cc5-f904-435c-8c62-988a755fa23f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.270493 Mar 26 21:35:30.902326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2990/6248] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:30 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:31.919684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:31.920454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:31.927765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:31.928257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:31.929039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:31.929494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:32.065832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:32.073131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9293b272-22fb-43a9-8dfa-04d31b9d38bc tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.157799 Mar 26 21:35:32.073709 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3259/6249] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:31 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:33.090710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:33.091333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:33.098820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:33.099285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:33.100096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:33.100551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:33.230820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:33.238340 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-959e2db2-5a3b-4a23-b621-556e61b68258 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.151664 Mar 26 21:35:33.238926 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2991/6250] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:33 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:34.255452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:34.256122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:34.262839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:34.263305 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:34.264125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:34.264584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:34.394852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:34.402244 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e744e11e-0358-48cf-a84c-484bd9324e82 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.150778 Mar 26 21:35:34.402814 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3260/6251] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:34 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:35.421470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:35.422216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:35.429083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:35.429543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:35.430333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:35.430786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:35.536178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-fcfc4072-a90b-4a81-a21d-c102df755bb8 req-86ec2988-1c1a-43de-94e8-47f6f5c92ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-plugged", "status": "completed", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:35.546293 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fcfc4072-a90b-4a81-a21d-c102df755bb8 req-86ec2988-1c1a-43de-94e8-47f6f5c92ace service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:35.547112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-fcfc4072-a90b-4a81-a21d-c102df755bb8 req-86ec2988-1c1a-43de-94e8-47f6f5c92ace service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:35.560594 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-fcfc4072-a90b-4a81-a21d-c102df755bb8 req-86ec2988-1c1a-43de-94e8-47f6f5c92ace service nova] Creating event network-vif-plugged:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:35:35.565598 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-fcfc4072-a90b-4a81-a21d-c102df755bb8 req-86ec2988-1c1a-43de-94e8-47f6f5c92ace service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033178 Mar 26 21:35:35.566701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3261/6252] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:35:35.571221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:35.579282 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-313d58d8-537d-4955-b34d-0bcc30f3065d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.163880 Mar 26 21:35:35.580226 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2992/6253] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:35 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:36.597987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:36.598730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:36.604961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:36.605428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:36.606205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:36.606692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:36.740779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:36.748171 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-92af70d1-14b1-47a2-b6e1-237d8ad9d499 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1362 microversion: 2.1 time: 0.155207 Mar 26 21:35:36.749367 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3262/6254] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:36 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:37.766509 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:37.767129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:37.773997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:37.774458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:37.775234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:37.775685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:37.909527 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:37.917071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3d80499-338e-4d0f-9e47-bd81c3a09fc4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1548 microversion: 2.1 time: 0.155002 Mar 26 21:35:37.917655 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2993/6255] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:37 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:37.933679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:37.934207 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:37.941446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:37.941911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:37.942690 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:37.943142 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:38.026133 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-abbdf79b-43b7-45f9-8d74-a119b3a6a79e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096277 Mar 26 21:35:38.026753 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3263/6256] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:35:37 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:39.295736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9fef5f22-3875-4150-b9dd-870754e701f8 req-e7bc01cb-b085-4137-b846-0388a81eaa33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:39.305013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9fef5f22-3875-4150-b9dd-870754e701f8 req-e7bc01cb-b085-4137-b846-0388a81eaa33 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:39.305470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9fef5f22-3875-4150-b9dd-870754e701f8 req-e7bc01cb-b085-4137-b846-0388a81eaa33 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:39.317775 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9fef5f22-3875-4150-b9dd-870754e701f8 req-e7bc01cb-b085-4137-b846-0388a81eaa33 service nova] Creating event network-changed:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:35:39.323172 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9fef5f22-3875-4150-b9dd-870754e701f8 req-e7bc01cb-b085-4137-b846-0388a81eaa33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031302 Mar 26 21:35:39.324148 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2994/6257] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:40.648835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:40.649465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:40.656204 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:40.656615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:40.657397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:40.657860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:40.792295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:40.799664 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4473446d-4ff2-4fce-881d-0a3e5696ab39 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1665 microversion: 2.1 time: 0.155566 Mar 26 21:35:40.800294 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3264/6258] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:40 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:40.818000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b29693cc-24c7-4ee1-959a-04059d309db7"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:40.819168 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:40.826136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:40.827217 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:40.828023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:40.828465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:41.051540 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cd81e54-af7e-498c-99f9-02dfd9eadf01 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237773 Mar 26 21:35:41.052192 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2995/6259] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:35:40 2022] POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:35:43.261542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:35:43.262518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:43.268928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:43.269395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:43.270170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:43.270624 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:43.298112 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:43.303975 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Old instance type m1.heat2, new instance type m1.heat {{(pid=141581) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:35:43.314572 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:35:43.315014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:35:43.315504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:35:43.315949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:35:43.316382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:35:43.376635 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74a210ef-8149-4e2a-b103-bcc8ccfe7c57 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/action" status: 202 len: 0 microversion: 2.1 time: 0.119236 Mar 26 21:35:43.377928 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3265/6260] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:35:43 2022] POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:35:43.386650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:43.387354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:43.394220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:43.394708 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:43.395495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:43.396037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:43.570359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:43.579251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1471859-0b86-472e-8708-c44b63ff4253 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1720 microversion: 2.1 time: 0.197643 Mar 26 21:35:43.579857 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2996/6261] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:43 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:44.597020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:44.597655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:44.604512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:44.604993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:44.605805 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:44.606270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:44.745569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:44.753562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-eed91265-5d4e-4bd7-85c5-b729f36acddb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1720 microversion: 2.1 time: 0.161063 Mar 26 21:35:44.754152 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3266/6262] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:44 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:45.300902 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:35:45.301465 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:35:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:35:45.770705 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:45.771319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:45.778155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:45.778615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:45.779410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:45.779902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:45.909995 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:45.917857 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e0cb190b-f957-43b6-891d-ae378253ac4b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.151083 Mar 26 21:35:45.918423 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2997/6263] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:45 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:46.601854 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:35:46.602325 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:35:46.935773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:46.936943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:46.943757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:46.944263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:46.945044 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:46.945546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:47.084738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:47.092759 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-779e75a1-8549-4634-9fd5-0c72c4d8ff0f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.160893 Mar 26 21:35:47.093345 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3267/6264] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:46 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:48.109588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:48.110238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:48.117109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:48.117568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:48.118343 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:48.118785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:48.255582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:48.263458 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc8a2589-a9c5-4470-a9f9-1af3c4276bc2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.157937 Mar 26 21:35:48.264551 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2998/6265] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:48 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:49.281672 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:49.282249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:49.289028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:49.289493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:49.290270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:49.290721 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:49.428115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:49.435986 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cfbb3513-9fd7-4257-a63c-2b09cf7c90a7 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.158752 Mar 26 21:35:49.436558 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3268/6266] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:49 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:50.452939 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:50.453562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:50.460435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:50.460896 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:50.461678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:50.462130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:50.594539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:50.602474 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5729b2b0-be88-430f-acb2-a09c0af6d5a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.154044 Mar 26 21:35:50.603127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 2999/6267] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:50 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:51.619738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:51.620393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:51.627115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:51.627583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:51.628391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:51.628852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:51.767518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:51.775809 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b7b9bbb-3a74-4f05-b192-53d35503423c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.160048 Mar 26 21:35:51.776421 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3269/6268] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:51 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:52.793318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:52.793932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:52.801607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:52.802065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:52.802841 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:52.803289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:52.935643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:52.943502 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7ecea85e-8f8e-4e78-af2d-8e7be68019a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.154126 Mar 26 21:35:52.944112 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3000/6269] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:52 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:53.959578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:53.960264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:53.966778 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:53.967245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:53.968055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:53.968507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:54.104821 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:54.113316 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-481c6587-efa6-49cd-940a-0449c4f36ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.157626 Mar 26 21:35:54.113888 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3270/6270] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:53 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:55.131115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:55.131732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:55.138548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:55.139018 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:55.139793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:55.140267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:55.271131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:55.279005 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b66d4f7b-1bdc-4f07-88be-1a75859f311c tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.151852 Mar 26 21:35:55.279577 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3001/6271] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:55 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:56.295403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:56.295973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:56.302952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:56.303420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:56.304235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:56.304694 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:56.436323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:56.444202 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0482839c-4e56-4bda-abfd-b27d777f19bf tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.152761 Mar 26 21:35:56.444786 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3271/6272] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:56 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:57.461911 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:57.462526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:57.469643 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:57.470106 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:57.470880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:57.471326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:57.605481 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:57.613837 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e603803-c61d-44b8-8ff3-2f2351a80016 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.156077 Mar 26 21:35:57.614420 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3002/6273] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:57 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:58.630666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:58.631219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:58.637934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:58.638436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:58.639227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:58.639687 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:58.772002 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:58.779998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bcf68373-ca57-41c7-9f21-060b518f1628 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.153315 Mar 26 21:35:58.780569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3272/6274] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:58 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:35:59.797537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:35:59.798167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:35:59.805919 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:59.806385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:59.807198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:35:59.807654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:35:59.948549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:35:59.957024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c25bce94-9d67-4e7b-abeb-40c5026a8ebe tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.164297 Mar 26 21:35:59.957599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3003/6275] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:35:59 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:00.974267 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:00.974892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:00.981649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:00.982118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:00.982912 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:00.983369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:01.121607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:01.129502 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-85219c24-2059-4c24-a31d-02833016f883 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.159259 Mar 26 21:36:01.130069 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3273/6276] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:00 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:02.148441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:02.149000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:02.156567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:02.157041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:02.157829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:02.158281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:02.290732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:02.299254 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cd7a5dd9-6b49-45d4-a4d3-79e6a080dfa9 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.154919 Mar 26 21:36:02.299832 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3004/6277] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:02 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:36:03.317076 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:03.317626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:03.324492 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:03.324959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:03.325737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:03.326191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:03.459071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:03.466958 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-787e15c2-0e29-4cc8-a4ef-5b6053635320 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.154380 Mar 26 21:36:03.467537 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3274/6278] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:03 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:04.483980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:04.484659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:04.491452 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:04.491909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:04.492724 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:04.493169 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:04.625717 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:04.633550 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4c329996-1b4d-4903-a22a-fbae0e90942f tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.153574 Mar 26 21:36:04.634127 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3005/6279] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:04 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:05.651178 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:05.651828 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:05.659215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:05.659689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:05.660510 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:05.660971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:05.800053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:05.808401 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a48581a-0c8d-4728-b036-046cf5fda11b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.161120 Mar 26 21:36:05.808989 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3275/6280] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:05 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:06.825493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:06.826114 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:06.833014 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:06.833468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:06.834234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:06.834678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:06.966416 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:06.974279 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7a1d7dc3-ee4b-42be-81b7-84774fa30985 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.152697 Mar 26 21:36:06.974851 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3006/6281] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:06 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:07.991349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:07.992023 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:07.999328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:07.999815 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:08.000663 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:08.001135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:08.141701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:08.149814 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f6b0d770-6240-4c96-8157-4288ef5eb5fb tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1725 microversion: 2.1 time: 0.162401 Mar 26 21:36:08.150641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3276/6282] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:07 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:08.573876 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-unplugged", "status": "completed", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:08.584908 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:08.585686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:08.598586 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] Creating event network-vif-unplugged:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch2-master-1 Mar 26 21:36:08.606685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] Instance bbf12a51-f421-460e-9f30-afbd901dd734 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:36:08.620109 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-04457b38-a45d-4f63-8ba4-47757a675215 req-8b581219-b836-4f9c-a126-1582a6b5fd59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121565 Mar 26 21:36:08.620725 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3007/6283] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:09.168053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:09.168764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:09.177892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:09.178675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:09.179551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:09.180199 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:09.321760 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:09.330253 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fcf0d232-49bb-43d2-86ac-2e1a03fd36a6 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1724 microversion: 2.1 time: 0.166456 Mar 26 21:36:09.330855 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3277/6284] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:09 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:10.347864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:10.348617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:10.355608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:10.356115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:10.356898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:10.357351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:10.494181 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:10.502732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3507d1b-1920-49e0-a8b8-e8cc7c0b6c84 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1722 microversion: 2.1 time: 0.159268 Mar 26 21:36:10.503622 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3008/6285] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:10 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:10.635658 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:10.644651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:10.645114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:10.657005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] Creating event network-changed:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch2-master-1 Mar 26 21:36:10.662784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] Instance bbf12a51-f421-460e-9f30-afbd901dd734 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:36:10.674731 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1dfe49a1-7ed1-4fa2-88a0-82da5f574eb6 req-d524df07-8f61-4b73-9710-8d09c1d4f847 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042795 Mar 26 21:36:10.675429 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3278/6286] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:11.520983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:11.521566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:11.528273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:11.528737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:11.529514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:11.529958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:11.663612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:11.671534 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-84958455-139e-4aea-a3b9-d5ee51953120 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1722 microversion: 2.1 time: 0.154583 Mar 26 21:36:11.672201 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3009/6287] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:11 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:12.690071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:12.690788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:12.697419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:12.697890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:12.698676 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:12.699135 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:12.831941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:12.839887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b99c2ca-4a0f-4901-b786-c29da82e4df8 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1722 microversion: 2.1 time: 0.154908 Mar 26 21:36:12.840488 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3279/6288] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:12 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:13.856823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:13.857470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:13.864272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:13.864711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:13.865477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:13.865918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.003934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:14.011993 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d6bb2a73-4786-4c54-869b-c1e295a9c15b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1719 microversion: 2.1 time: 0.159024 Mar 26 21:36:14.012579 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3010/6289] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:13 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:14.028889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:14.029439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:14.036239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.036706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.037487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.037941 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.073878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.074342 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.075187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.075668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.096474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:36:14.101791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Getting quotas for user dc934eed0dcd45a3a4967a219b7d84a7 and project ed4a3c1555504ccaaa90ea06f794d09a. Resources: {'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:36:14.198042 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7bf108cc-2178-47de-9c7c-aa10ba25e338 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/action" status: 202 len: 0 microversion: 2.1 time: 0.172914 Mar 26 21:36:14.198652 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3280/6290] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:36:14 2022] POST /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:36:14.206777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:14.207400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:14.213547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.214007 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.214783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:14.215220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:14.419314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:14.429064 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5f834e39-bc79-4b39-a564-51d16d602d97 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.226231 Mar 26 21:36:14.430258 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3011/6291] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:14 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:15.449132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:15.449855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:15.456779 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:15.457233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:15.458018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:15.458476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:15.592634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:15.600477 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8185e18e-57ed-49fc-baa2-96b7b2209f04 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.156580 Mar 26 21:36:15.601055 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3281/6292] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:15 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:16.614237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-plugged", "status": "completed", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:16.617967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:16.618602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:16.622483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:16.622932 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:16.625527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:16.626007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:16.626801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:16.627261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:16.634737 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] Creating event network-vif-plugged:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch2-master-1 Mar 26 21:36:16.640868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] Instance bbf12a51-f421-460e-9f30-afbd901dd734 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:36:16.651408 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-47364d53-ded3-4a3e-9cca-e2ffe4cbf514 req-ee1d46f9-7284-496e-a506-c795519668d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102083 Mar 26 21:36:16.652038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3012/6293] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:16.772314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:16.783994 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2d375b0-e51e-456a-ba73-6ab35451728d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.169645 Mar 26 21:36:16.784610 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3282/6294] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:16 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:36:17.803818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:17.804563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:17.811024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:17.811491 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:17.812346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:17.812798 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:18.017259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:18.025516 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc6eecf6-e807-4ad7-9567-58b28aa48e75 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.227182 Mar 26 21:36:18.026105 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3013/6295] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:17 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:18.036554 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-unplugged", "status": "completed", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:18.045479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:18.045950 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:18.058331 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] Creating event network-vif-unplugged:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:36:18.064257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] Instance bbf12a51-f421-460e-9f30-afbd901dd734 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:36:18.075066 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-626cc664-1a34-46a8-a6db-7381246f0fcc req-958f4020-c729-4abd-b0cc-2181988932f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042615 Mar 26 21:36:18.075678 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3283/6296] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:36:19.042467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:19.043089 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:19.049903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:19.050394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:19.051436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:19.051889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:19.188464 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:19.196354 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f09d7f81-cb64-40d8-9ec2-3f63753dee86 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.157721 Mar 26 21:36:19.197140 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3014/6297] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:19 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:20.096119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:20.104214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:20.104680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:20.121309 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] Creating event network-changed:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:36:20.126544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] Instance bbf12a51-f421-460e-9f30-afbd901dd734 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:36:20.137217 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-851cd60b-7eac-4c8a-8c89-1b9f7f8654b3 req-157ce156-bc52-4546-91fd-697b5bb72ddd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046522 Mar 26 21:36:20.137809 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3284/6298] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:20.214056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:20.214731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:20.222603 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:20.223062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:20.223852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:20.224326 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:20.588986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:20.596830 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a961051a-2507-401d-987d-6c3d8d4a991b tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.386755 Mar 26 21:36:20.597410 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3015/6299] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:20 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:21.615170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:21.616070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:21.623117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:21.623590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:21.624479 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:21.624940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:21.764064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:21.772401 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de5264b4-a80b-42f4-ad7a-ac926eef1b2a tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.161585 Mar 26 21:36:21.773063 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3285/6300] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:21 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:22.791052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:22.791676 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:22.798799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:22.799261 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:22.800075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:22.800531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:22.935959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:22.943850 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4ad9b40-a07d-48ce-9fae-c35e56bf1fcd tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1718 microversion: 2.1 time: 0.157018 Mar 26 21:36:22.944457 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3016/6301] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:22 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:23.961182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:23.961825 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:23.968332 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:23.968809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:23.969600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:23.970065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.109926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:24.117915 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b0c7f299-826a-48a7-8f50-1a61b19654d1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1711 microversion: 2.1 time: 0.160920 Mar 26 21:36:24.118496 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3286/6302] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:23 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:24.134799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:24.135424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:24.142397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.143019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.143800 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.144268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.282088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:24.290279 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-602a5a90-1610-4b7c-8f9a-b5bf7e81c610 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1711 microversion: 2.1 time: 0.159306 Mar 26 21:36:24.290862 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3017/6303] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:24 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:24.307024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:24.307653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:24.313573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.314045 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.314834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.315291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.445329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:24.453248 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-517ec161-ae84-41c4-b689-7038c479b5e4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1711 microversion: 2.1 time: 0.150107 Mar 26 21:36:24.453828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3287/6304] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:24 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:24.469701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:24.470206 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:24.476059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.476520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.477345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.477743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.501598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:36:24.574321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc389f1a-4380-4c2d-9e26-ebfa891a2977 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 204 len: 0 microversion: 2.1 time: 0.108724 Mar 26 21:36:24.574923 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3018/6305] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:24 2022] DELETE /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:36:24.584565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:24.585193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:24.591459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.591948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.592732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:24.593184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:24.726515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:24.734413 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2a57b4a6-df7c-4a64-a6f2-a0af6f2401ba tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1717 microversion: 2.1 time: 0.154453 Mar 26 21:36:24.734934 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3288/6306] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:24 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:25.752909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:25.753617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:25.760934 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:25.761782 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:25.762595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:25.763069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:25.839556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-7b9c0ed5-1d58-46be-9227-fb71d3db8d6b req-f3f85017-9f5d-43b7-960f-b265b3543c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-plugged", "status": "completed", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:25.852924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b9c0ed5-1d58-46be-9227-fb71d3db8d6b req-f3f85017-9f5d-43b7-960f-b265b3543c00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:25.853388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-7b9c0ed5-1d58-46be-9227-fb71d3db8d6b req-f3f85017-9f5d-43b7-960f-b265b3543c00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:25.869222 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-7b9c0ed5-1d58-46be-9227-fb71d3db8d6b req-f3f85017-9f5d-43b7-960f-b265b3543c00 service nova] Creating event network-vif-plugged:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:36:25.875111 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-7b9c0ed5-1d58-46be-9227-fb71d3db8d6b req-f3f85017-9f5d-43b7-960f-b265b3543c00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039155 Mar 26 21:36:25.876234 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3289/6307] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:36:25.919498 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:25.928523 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f6d52f47-610e-47ac-9d7b-70ffb84189e1 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1717 microversion: 2.1 time: 0.180638 Mar 26 21:36:25.929035 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3019/6308] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:25 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:26.947078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:26.948165 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:26.956458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:26.957028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:26.957949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:26.958714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:27.042071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:27.051669 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-191e9ab0-511f-4be4-9ba3-2f5889966342 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1650 microversion: 2.1 time: 0.108908 Mar 26 21:36:27.053211 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3290/6309] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:26 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1650 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:27.616545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-c47bb190-73f3-4f53-ba16-e14a5c41a1b2 req-9bd05d16-81b6-4f31-ac94-760d42f5a836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf12a51-f421-460e-9f30-afbd901dd734", "name": "network-vif-deleted", "tag": "5942c052-bdf2-4989-8332-b191744ebba7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:27.626052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c47bb190-73f3-4f53-ba16-e14a5c41a1b2 req-9bd05d16-81b6-4f31-ac94-760d42f5a836 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:27.626507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-c47bb190-73f3-4f53-ba16-e14a5c41a1b2 req-9bd05d16-81b6-4f31-ac94-760d42f5a836 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:27.648273 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-c47bb190-73f3-4f53-ba16-e14a5c41a1b2 req-9bd05d16-81b6-4f31-ac94-760d42f5a836 service nova] Creating event network-vif-deleted:5942c052-bdf2-4989-8332-b191744ebba7 for instance bbf12a51-f421-460e-9f30-afbd901dd734 on nch1-master-1 Mar 26 21:36:27.653810 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-c47bb190-73f3-4f53-ba16-e14a5c41a1b2 req-9bd05d16-81b6-4f31-ac94-760d42f5a836 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040721 Mar 26 21:36:27.654645 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3020/6310] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:28.069368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:28.070000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:28.077229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:28.077700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:28.079222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:28.079682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:28.111179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:28.111652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:28.112156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lazy-loading 'fault' on Instance uuid bbf12a51-f421-460e-9f30-afbd901dd734 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:36:28.154927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc934eed0dcd45a3a4967a219b7d84a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4a3c1555504ccaaa90ea06f794d09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:28.164373 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64337d90-c471-4b12-952f-b37e209b8cab tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 200 len: 1373 microversion: 2.1 time: 0.098813 Mar 26 21:36:28.165428 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3291/6311] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:28 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:29.182666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:29.183377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:29.190351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:29.190811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:29.191587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:29.192060 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:29.205015 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. Mar 26 21:36:29.205604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:29.206419 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ac4a4add-5694-466f-928c-4fbbea21d47e tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 404 len: 111 microversion: 2.1 time: 0.028904 Mar 26 21:36:29.206947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3021/6312] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:29 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:29.260651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:29.261600 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:29.268333 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:29.268807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:29.269592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:29.270051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:29.282282 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. Mar 26 21:36:29.282882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:29.283753 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6ebf74cb-5365-49f4-8a75-69b37baae46d tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027155 Mar 26 21:36:29.284390 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3292/6313] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:36:29 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.475454 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.475961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.482615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.483069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.483833 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.484373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.497339 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. Mar 26 21:36:30.497914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.498720 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-487a92af-cef9-4ef2-96f9-545ce631cbe2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 404 len: 111 microversion: 2.1 time: 0.027243 Mar 26 21:36:30.499237 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3022/6314] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:30 2022] DELETE /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.508176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.508836 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: bbf12a51-f421-460e-9f30-afbd901dd734] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.516314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.516786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.517573 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.518028 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.531086 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. Mar 26 21:36:30.531692 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance bbf12a51-f421-460e-9f30-afbd901dd734 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.532551 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6daf4d46-e7cf-435e-baa7-b93a9441e891 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734" status: 404 len: 111 microversion: 2.1 time: 0.028388 Mar 26 21:36:30.533109 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3293/6315] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:30 2022] GET /compute/v2.1/servers/bbf12a51-f421-460e-9f30-afbd901dd734 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.541817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.542336 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.548263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.548825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.549788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.550390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.565509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. Mar 26 21:36:30.566096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.566915 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-89d0c246-8e12-4a15-a3f9-cdd5b6011ed2 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 404 len: 111 microversion: 2.1 time: 0.029989 Mar 26 21:36:30.567452 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3023/6316] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:30 2022] DELETE /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.575436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.576190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: a6f1b046-a678-45f1-9ae5-03f034094e99] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.582801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.583275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.584099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.584586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.597647 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. Mar 26 21:36:30.598254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance a6f1b046-a678-45f1-9ae5-03f034094e99 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.599126 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-353dd456-a8a7-40e1-8f78-ea5872bfbfd4 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99" status: 404 len: 111 microversion: 2.1 time: 0.027662 Mar 26 21:36:30.599651 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3294/6317] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:30 2022] GET /compute/v2.1/servers/a6f1b046-a678-45f1-9ae5-03f034094e99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.607538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.608081 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.614466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.614920 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.615681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.616147 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.629826 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. Mar 26 21:36:30.630405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.631211 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-98efa8a0-c954-4105-9a07-18b64cadcec0 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 404 len: 111 microversion: 2.1 time: 0.027626 Mar 26 21:36:30.631725 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3024/6318] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:30 2022] DELETE /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.639365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.640257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 84182e46-e480-4292-8337-9ae3f60d062b] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.646144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.646614 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.647946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.647946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.660962 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. Mar 26 21:36:30.661567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 84182e46-e480-4292-8337-9ae3f60d062b could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.662408 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-885c561c-6b7a-4c92-a485-5c967695f132 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b" status: 404 len: 111 microversion: 2.1 time: 0.026944 Mar 26 21:36:30.662942 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3295/6319] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:30 2022] GET /compute/v2.1/servers/84182e46-e480-4292-8337-9ae3f60d062b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.670714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.671227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.678021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.678478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.679248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.679692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.693483 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. Mar 26 21:36:30.694074 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.694894 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ab733225-dfc0-49f7-b40e-4a2ea87ed4d5 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 404 len: 111 microversion: 2.1 time: 0.028039 Mar 26 21:36:30.695421 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3025/6320] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:30 2022] DELETE /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.703346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.703940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] [instance: 1071ae51-9176-4425-b5df-a99aa39cd56d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:30.709935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.710407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.711196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:30.711657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:30.724701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] HTTP exception thrown: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. Mar 26 21:36:30.725358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Returning 404 to user: Instance 1071ae51-9176-4425-b5df-a99aa39cd56d could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:36:30.726186 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9368b26d-e3c2-4db8-8dbc-c064e8854d20 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d" status: 404 len: 111 microversion: 2.1 time: 0.026892 Mar 26 21:36:30.726703 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3296/6321] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:30 2022] GET /compute/v2.1/servers/1071ae51-9176-4425-b5df-a99aa39cd56d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:36:30.735030 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cfc16b4b-bded-48ad-a34b-1b2be9c33014 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] Calling method '.version_select at 0x7f6e59725310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:30.757895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cfc16b4b-bded-48ad-a34b-1b2be9c33014 tempest-ServerActionsTestJSON-666290772 tempest-ServerActionsTestJSON-666290772-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20944289" status: 202 len: 0 microversion: 2.1 time: 0.027037 Mar 26 21:36:30.758492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3026/6322] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 21:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20944289 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:36:36.486633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-170939070", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "8fad62e7-964f-46ac-807d-f2e566f56fdf"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:36.536683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] validate_networks() for [('8fad62e7-964f-46ac-807d-f2e566f56fdf', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:36:36.875834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:36:36.876299 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:36:36.876812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:36:36.877238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:36:36.877662 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:36:36.886403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:36.886894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:36.887756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:36.888236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:36.905124 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Getting quotas for project e0f5a23725414492b27c2c670de3c618. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:36:36.910911 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Getting quotas for user 0ad1f122bc764018a18ed3d7de21be56 and project e0f5a23725414492b27c2c670de3c618. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:36:36.922886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:36:36.925215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:36:36.968981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99b74326-1ead-4776-b9fa-da5cb52dcb4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594024 Mar 26 21:36:36.969633 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3297/6323] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:36:36.980366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2ade9452-2fcf-4e19-bb96-8182dcd8c279 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:36.980990 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2ade9452-2fcf-4e19-bb96-8182dcd8c279 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:37.035511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2ade9452-2fcf-4e19-bb96-8182dcd8c279 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:37.042150 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2ade9452-2fcf-4e19-bb96-8182dcd8c279 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1216 microversion: 2.1 time: 0.066585 Mar 26 21:36:37.042752 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3027/6324] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:36 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:38.059949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:38.060595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:38.067855 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:38.068432 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:38.069237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:38.069703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:38.132913 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:38.140740 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bd7b3188-2fb1-429b-aff3-39ef5a636508 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1274 microversion: 2.1 time: 0.085237 Mar 26 21:36:38.141371 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3298/6325] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:38 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:39.157311 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:39.157926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:39.164768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:39.165226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:39.166013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:39.166457 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:39.274584 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-6f23846e-9c33-4d2f-a44e-20ab311ff1e6 req-1b04c506-4f64-4051-9c87-8f8eb8fc2aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae210ac-a29a-4beb-811d-3f86358ee531", "tag": "1eb053ef-36f6-46ba-a08a-0fa3cfa75dca"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:39.284882 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6f23846e-9c33-4d2f-a44e-20ab311ff1e6 req-1b04c506-4f64-4051-9c87-8f8eb8fc2aa3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:39.285657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-6f23846e-9c33-4d2f-a44e-20ab311ff1e6 req-1b04c506-4f64-4051-9c87-8f8eb8fc2aa3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:39.298195 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-6f23846e-9c33-4d2f-a44e-20ab311ff1e6 req-1b04c506-4f64-4051-9c87-8f8eb8fc2aa3 service nova] Creating event network-changed:1eb053ef-36f6-46ba-a08a-0fa3cfa75dca for instance 3ae210ac-a29a-4beb-811d-3f86358ee531 on nch2-master-1 Mar 26 21:36:39.310244 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-6f23846e-9c33-4d2f-a44e-20ab311ff1e6 req-1b04c506-4f64-4051-9c87-8f8eb8fc2aa3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 Mar 26 21:36:39.310864 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3299/6326] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:39.393152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:39.400351 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa8cc8c8-7864-4592-9c0e-80eb810795de tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.247052 Mar 26 21:36:39.400922 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3028/6327] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:39 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:40.418793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:40.419431 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:40.426440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:40.426915 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:40.427696 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:40.428183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:40.561669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:40.569826 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f965fe18-8ebc-4d8d-a037-0bdc0ac77902 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.156184 Mar 26 21:36:40.570404 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3300/6328] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:40 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:41.586396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:41.587038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:41.593971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:41.594428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:41.595198 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:41.595638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:41.726407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:41.733834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-053073ee-c139-4323-94e3-3c8f6dc75ea9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.151451 Mar 26 21:36:41.734398 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3029/6329] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:41 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:42.750476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:42.751121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:42.757780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:42.758256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:42.759053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:42.759519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:42.902224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:42.910387 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8dc75f69-296e-47a8-9f76-9d60385bbd4b tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.163838 Mar 26 21:36:42.910962 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3301/6330] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:42 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:36:43.926803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:43.927417 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:43.934165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:43.934622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:43.935385 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:43.935824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:44.071725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:44.080021 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9ff3dc7a-88a4-4390-9c92-9dc570374f02 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.157297 Mar 26 21:36:44.080603 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3030/6331] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:43 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:44.743765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8ad96e0e-10c8-4a96-8bba-b27fe3f62643 req-de9cd1af-7962-49d0-ab68-51dc7b984c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae210ac-a29a-4beb-811d-3f86358ee531", "name": "network-vif-plugged", "status": "completed", "tag": "1eb053ef-36f6-46ba-a08a-0fa3cfa75dca"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:44.752541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8ad96e0e-10c8-4a96-8bba-b27fe3f62643 req-de9cd1af-7962-49d0-ab68-51dc7b984c42 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:44.753019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8ad96e0e-10c8-4a96-8bba-b27fe3f62643 req-de9cd1af-7962-49d0-ab68-51dc7b984c42 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:44.764061 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8ad96e0e-10c8-4a96-8bba-b27fe3f62643 req-de9cd1af-7962-49d0-ab68-51dc7b984c42 service nova] Creating event network-vif-plugged:1eb053ef-36f6-46ba-a08a-0fa3cfa75dca for instance 3ae210ac-a29a-4beb-811d-3f86358ee531 on nch2-master-1 Mar 26 21:36:44.768881 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8ad96e0e-10c8-4a96-8bba-b27fe3f62643 req-de9cd1af-7962-49d0-ab68-51dc7b984c42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028892 Mar 26 21:36:44.769492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3302/6332] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:36:45.097552 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:45.098176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:45.105009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:45.105469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:45.106248 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:45.106696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:45.239576 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:45.246836 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-866fab38-b3b3-4131-b2fd-a90820e72b70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1316 microversion: 2.1 time: 0.153849 Mar 26 21:36:45.247408 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3031/6333] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:45 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:46.265255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:46.265976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:46.272222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:46.272695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:46.273524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:46.273931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:46.406171 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:46.414321 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d14fb7e6-602c-4f70-8bd8-e506487ceda9 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.154188 Mar 26 21:36:46.414894 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3303/6334] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:46 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:46.467505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-209630924", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "8fad62e7-964f-46ac-807d-f2e566f56fdf"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:46.518601 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] validate_networks() for [('8fad62e7-964f-46ac-807d-f2e566f56fdf', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:36:46.883680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:36:46.884145 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:36:46.884624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:36:46.885069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:36:46.885512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:36:46.894961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:46.895412 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:46.896232 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:46.896674 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:46.913376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Getting quotas for project e0f5a23725414492b27c2c670de3c618. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:36:46.918570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Getting quotas for user 0ad1f122bc764018a18ed3d7de21be56 and project e0f5a23725414492b27c2c670de3c618. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:36:46.930819 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:36:46.933088 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:36:46.976875 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [4327744d-0046-4f09-8991-8bd6aaed999b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:36:47.983965 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [4327744d-0046-4f09-8991-8bd6aaed999b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34374. Mar 26 21:36:47.987837 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-451c0783-724a-4435-b91e-1cc8071737f4 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.524255 Mar 26 21:36:47.988516 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3032/6335] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:36:47.998399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-df9dd479-9ca4-4903-9f03-3c5eb98d1d70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:47.999038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-df9dd479-9ca4-4903-9f03-3c5eb98d1d70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:48.052903 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-df9dd479-9ca4-4903-9f03-3c5eb98d1d70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:48.059352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-df9dd479-9ca4-4903-9f03-3c5eb98d1d70 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1216 microversion: 2.1 time: 0.064907 Mar 26 21:36:48.059940 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3304/6336] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:47 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:49.076765 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:49.077394 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:49.083447 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:49.083909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:49.084769 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:49.085207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:49.158484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:49.166383 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e6ff4319-c569-46f1-96f2-ff42cddc8916 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1274 microversion: 2.1 time: 0.094531 Mar 26 21:36:49.166976 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3033/6337] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:49 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:50.183571 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:50.184264 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:50.192563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:50.193036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:50.193850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:50.194300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:50.222294 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d2cbf90c-2429-48d0-bc7d-c00b81317d5c req-08767f71-b803-4ce2-8c90-b4fb2ca1cadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e72f5a5-66ae-476f-8fac-74b6f2bc67ee", "tag": "69dfdada-8996-47cb-a65b-7c951d8d9343"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:50.247299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d2cbf90c-2429-48d0-bc7d-c00b81317d5c req-08767f71-b803-4ce2-8c90-b4fb2ca1cadf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:50.247869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d2cbf90c-2429-48d0-bc7d-c00b81317d5c req-08767f71-b803-4ce2-8c90-b4fb2ca1cadf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:50.262800 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d2cbf90c-2429-48d0-bc7d-c00b81317d5c req-08767f71-b803-4ce2-8c90-b4fb2ca1cadf service nova] Creating event network-changed:69dfdada-8996-47cb-a65b-7c951d8d9343 for instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee on nch1-master-1 Mar 26 21:36:50.268045 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d2cbf90c-2429-48d0-bc7d-c00b81317d5c req-08767f71-b803-4ce2-8c90-b4fb2ca1cadf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052848 Mar 26 21:36:50.268827 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3034/6338] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:36:50.348755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:50.356491 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8dcddea2-559f-4ba0-a4f4-e58d1f40f6e6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.176970 Mar 26 21:36:50.357099 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3305/6339] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:50 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:51.374231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:51.374954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:51.381728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:51.382388 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:51.383199 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:51.383781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:51.521441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:51.528820 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c16b6e1e-884d-48d4-90c7-8e85f4bbc698 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.159709 Mar 26 21:36:51.529387 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3035/6340] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:51 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:52.545602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:52.546228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:52.553192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:52.553640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:52.554415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:52.554864 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:52.688004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:52.695902 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8e01db82-c6c2-4655-8b04-5c2264415dd2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.154177 Mar 26 21:36:52.696525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3306/6341] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:52 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:53.711820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:53.712444 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:53.719285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:53.719739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:53.720540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:53.720984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:53.855210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:53.862650 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-617257dc-6a45-446f-a644-dd61b300c39d tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.154774 Mar 26 21:36:53.863225 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3036/6342] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:53 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:54.880391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:54.881013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:54.887532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:54.888356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:54.889164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:54.889623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:55.035193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:55.042714 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1a20e6c0-8968-4cb1-9e27-eb7d31d51f3c tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.167216 Mar 26 21:36:55.043282 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3307/6343] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:54 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:56.003320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-0b44cfd5-6c89-4250-88cb-73802a79fd38 req-6cd5c23a-b8fe-4a80-8ad8-5c01a41fcd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72f5a5-66ae-476f-8fac-74b6f2bc67ee", "name": "network-vif-plugged", "status": "completed", "tag": "69dfdada-8996-47cb-a65b-7c951d8d9343"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:36:56.012753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0b44cfd5-6c89-4250-88cb-73802a79fd38 req-6cd5c23a-b8fe-4a80-8ad8-5c01a41fcd85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:56.013256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-0b44cfd5-6c89-4250-88cb-73802a79fd38 req-6cd5c23a-b8fe-4a80-8ad8-5c01a41fcd85 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:56.030116 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-0b44cfd5-6c89-4250-88cb-73802a79fd38 req-6cd5c23a-b8fe-4a80-8ad8-5c01a41fcd85 service nova] Creating event network-vif-plugged:69dfdada-8996-47cb-a65b-7c951d8d9343 for instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee on nch1-master-1 Mar 26 21:36:56.035107 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-0b44cfd5-6c89-4250-88cb-73802a79fd38 req-6cd5c23a-b8fe-4a80-8ad8-5c01a41fcd85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036278 Mar 26 21:36:56.035724 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3037/6344] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:36:56.061268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:56.061904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:56.071104 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:56.071578 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:56.072435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:56.072892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:56.214905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:56.222292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-702c4dec-8810-4640-bd51-b7e825ef5af3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.165584 Mar 26 21:36:56.222835 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3308/6345] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:56 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:57.240150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:57.240859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:57.247019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:57.247480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:57.248292 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:57.248740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:57.383618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:57.391222 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-70d716de-f738-40f5-b686-fe8908a52349 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1316 microversion: 2.1 time: 0.156290 Mar 26 21:36:57.391798 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3038/6346] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:57 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:58.408443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:58.409631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:58.416414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.416875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.417655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.418114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.549295 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:58.556962 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-787128ed-10db-4654-a23e-6d058c10a4f3 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1505 microversion: 2.1 time: 0.152445 Mar 26 21:36:58.557538 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3309/6347] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:58 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:58.572972 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:58.573501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:58.581397 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.581861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.582645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.583093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.607734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:36:58.682969 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4ed2f8e3-e37b-4ac2-b86b-a7c8ac46fdd7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 204 len: 0 microversion: 2.1 time: 0.113415 Mar 26 21:36:58.683684 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3039/6348] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:36:58 2022] DELETE /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:36:58.692569 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:58.693200 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:58.699242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.699709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.700546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:58.701014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:58.835453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:36:58.842994 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da97f9e5-3784-453d-9434-0c7bd53fcde0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1511 microversion: 2.1 time: 0.154880 Mar 26 21:36:58.843574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3310/6349] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:58 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:36:59.860653 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:36:59.862316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:36:59.868494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:59.868950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:36:59.869727 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:36:59.870167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:00.009033 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:00.016593 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a17f766d-fa43-4e1f-9042-12d4619bada0 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1511 microversion: 2.1 time: 0.160568 Mar 26 21:37:00.017169 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3040/6350] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:36:59 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:00.547434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-c0fe37ea-0729-495f-afb6-c703e411e2a7 req-539f09c5-94e1-48f0-99b5-1c0435d548c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72f5a5-66ae-476f-8fac-74b6f2bc67ee", "name": "network-vif-deleted", "tag": "69dfdada-8996-47cb-a65b-7c951d8d9343"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:00.557449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c0fe37ea-0729-495f-afb6-c703e411e2a7 req-539f09c5-94e1-48f0-99b5-1c0435d548c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:00.557924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-c0fe37ea-0729-495f-afb6-c703e411e2a7 req-539f09c5-94e1-48f0-99b5-1c0435d548c0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:00.570363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-c0fe37ea-0729-495f-afb6-c703e411e2a7 req-539f09c5-94e1-48f0-99b5-1c0435d548c0 service nova] Creating event network-vif-deleted:69dfdada-8996-47cb-a65b-7c951d8d9343 for instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee on nch1-master-1 Mar 26 21:37:00.576679 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-c0fe37ea-0729-495f-afb6-c703e411e2a7 req-539f09c5-94e1-48f0-99b5-1c0435d548c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 Mar 26 21:37:00.577506 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3311/6351] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:37:01.034269 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:01.034892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:01.044205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:01.045285 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:01.046647 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:01.047431 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:01.086069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:01.087038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:01.087799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lazy-loading 'fault' on Instance uuid 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:37:01.132639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:01.139627 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ef828646-3bb6-4a9f-852b-ec37daae66cc tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 200 len: 1306 microversion: 2.1 time: 0.110193 Mar 26 21:37:01.140244 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3041/6352] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:01 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:02.158057 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.158758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.165131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.165604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.166389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.166850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.180579 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. Mar 26 21:37:02.181185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 404 to user: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:02.182024 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bc785034-9a8a-4adf-b764-857a691066f2 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 404 len: 111 microversion: 2.1 time: 0.029241 Mar 26 21:37:02.182546 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3312/6353] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:37:02.191855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.192521 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.199233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.199692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.200495 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.200949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.333015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:02.340363 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1a602f8-9a19-409d-bad5-ec09b204dafb tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.153150 Mar 26 21:37:02.340938 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3042/6354] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:02.356908 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cabed8ed-44e8-40b7-9831-7abc978de0d7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:02.357880 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cabed8ed-44e8-40b7-9831-7abc978de0d7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 22e987d0-1a4f-456b-8379-07616d392d9c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.363701 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-cabed8ed-44e8-40b7-9831-7abc978de0d7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Instance 22e987d0-1a4f-456b-8379-07616d392d9c could not be found. Mar 26 21:37:02.364318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cabed8ed-44e8-40b7-9831-7abc978de0d7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 404 to user: Instance 22e987d0-1a4f-456b-8379-07616d392d9c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:02.365122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cabed8ed-44e8-40b7-9831-7abc978de0d7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "POST /compute/v2.1/servers/22e987d0-1a4f-456b-8379-07616d392d9c/action" status: 404 len: 111 microversion: 2.1 time: 0.012329 Mar 26 21:37:02.365633 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3313/6355] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:37:02 2022] POST /compute/v2.1/servers/22e987d0-1a4f-456b-8379-07616d392d9c/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:37:02.373083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.373701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.380280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.380737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.381666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.382021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.511098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:02.518495 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2912127-0b77-4679-a741-8ccbd95c9f29 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.149139 Mar 26 21:37:02.519063 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3043/6356] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:02.535698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.536358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.542946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.543446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.544251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.544701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.675300 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:02.682883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f0bcf08e-bfa0-4731-81f1-1356605eb62e tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.151586 Mar 26 21:37:02.683454 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3314/6357] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:37:02.698863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "28713b66-96dd-4b6d-9f87-c8e3f78b97e7"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:02.699824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.705728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.706165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.706925 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.707362 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.734196 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:02.739663 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Flavor 28713b66-96dd-4b6d-9f87-c8e3f78b97e7 could not be found. Mar 26 21:37:02.740298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 400 to user: Flavor 28713b66-96dd-4b6d-9f87-c8e3f78b97e7 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:02.741113 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4526ddc9-6490-4e38-8cd7-27d01e4ff8d6 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "POST /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531/action" status: 400 len: 107 microversion: 2.1 time: 0.046273 Mar 26 21:37:02.741659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3044/6358] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:37:02 2022] POST /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531/action => generated 107 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:37:02.749990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.750660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.756762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.757234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.758029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.758532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.891296 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:02.899308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-31ee1b8b-d2ed-4996-be08-abeef76cf927 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.153242 Mar 26 21:37:02.899878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3315/6359] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:02.916657 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:02.917271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:02.923134 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.923584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:02.924434 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:02.924877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.060999 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:03.068634 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a2014e2-92ee-43d2-9b0b-a30bf103f4f1 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.155750 Mar 26 21:37:03.069239 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3045/6360] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:02 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:03.086664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f27482f-e9cd-4eee-853f-732e2464d798 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:03.088493 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8f27482f-e9cd-4eee-853f-732e2464d798 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:03.089891 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8f27482f-e9cd-4eee-853f-732e2464d798 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "POST /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531/action" status: 400 len: 113 microversion: 2.1 time: 0.008213 Mar 26 21:37:03.090677 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3316/6361] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:37:03 2022] POST /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 26 21:37:03.099239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:03.100022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:03.106365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.106811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.107573 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.108053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.243301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:03.250752 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-95be12cd-b09c-43d0-9977-f36401f24523 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1505 microversion: 2.1 time: 0.156033 Mar 26 21:37:03.251320 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3046/6362] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:03 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:03.272256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:03.272759 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:03.281153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.281632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.282421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.282881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.295691 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. Mar 26 21:37:03.296325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 404 to user: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:03.297188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6e68441a-14ea-402b-b7dc-31bdd85f0171 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 404 len: 111 microversion: 2.1 time: 0.030453 Mar 26 21:37:03.297719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3317/6363] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:37:03 2022] DELETE /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:37:03.306073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:03.306686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:03.312607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.313067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.313830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.314268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.329511 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. Mar 26 21:37:03.330093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 404 to user: Instance 9e72f5a5-66ae-476f-8fac-74b6f2bc67ee could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:03.331549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0748128b-741c-4ec5-8261-3430c91051c7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee" status: 404 len: 111 microversion: 2.1 time: 0.029351 Mar 26 21:37:03.332252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3047/6364] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:03 2022] GET /compute/v2.1/servers/9e72f5a5-66ae-476f-8fac-74b6f2bc67ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:37:03.340006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:03.340521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:03.346398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.346870 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.347648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.348147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.371187 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:37:03.443662 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-079d6bfc-f674-4f36-9948-b1e7b2b2a162 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 204 len: 0 microversion: 2.1 time: 0.107251 Mar 26 21:37:03.444296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3318/6365] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:37:03 2022] DELETE /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:37:03.453323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:03.453953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:03.460931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.461414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.462184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:03.462622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:03.591581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:03.599144 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58d35d7a-9809-46ae-8522-b1330b084f06 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1511 microversion: 2.1 time: 0.150387 Mar 26 21:37:03.599748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3048/6366] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:03 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:04.617110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:04.617829 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:04.624590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:04.625059 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:04.625846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:04.626302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:04.758603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad1f122bc764018a18ed3d7de21be56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f5a23725414492b27c2c670de3c618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:04.766140 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-343800f0-43e5-42ae-93c4-e605f3c1a814 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 200 len: 1511 microversion: 2.1 time: 0.153452 Mar 26 21:37:04.766910 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3319/6367] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:04 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:05.227093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-df1f4f9d-0625-43b1-93cd-45230ef87565 req-a73b377b-c3b5-462b-800c-56a625ad63e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae210ac-a29a-4beb-811d-3f86358ee531", "name": "network-vif-deleted", "tag": "1eb053ef-36f6-46ba-a08a-0fa3cfa75dca"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:05.237323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-df1f4f9d-0625-43b1-93cd-45230ef87565 req-a73b377b-c3b5-462b-800c-56a625ad63e7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:05.238391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-df1f4f9d-0625-43b1-93cd-45230ef87565 req-a73b377b-c3b5-462b-800c-56a625ad63e7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:05.250026 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-df1f4f9d-0625-43b1-93cd-45230ef87565 req-a73b377b-c3b5-462b-800c-56a625ad63e7 service nova] Creating event network-vif-deleted:1eb053ef-36f6-46ba-a08a-0fa3cfa75dca for instance 3ae210ac-a29a-4beb-811d-3f86358ee531 on nch2-master-1 Mar 26 21:37:05.255535 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-df1f4f9d-0625-43b1-93cd-45230ef87565 req-a73b377b-c3b5-462b-800c-56a625ad63e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Mar 26 21:37:05.256158 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3049/6368] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:37:05.782615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:05.783248 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] [instance: 3ae210ac-a29a-4beb-811d-3f86358ee531] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:05.790208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:05.790710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:05.791497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:05.792015 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:05.806190 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] HTTP exception thrown: Instance 3ae210ac-a29a-4beb-811d-3f86358ee531 could not be found. Mar 26 21:37:05.806719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] Returning 404 to user: Instance 3ae210ac-a29a-4beb-811d-3f86358ee531 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:37:05.807564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b24a0711-653c-4521-935c-e811a40afea7 tempest-ServersNegativeTestJSON-1304077023 tempest-ServersNegativeTestJSON-1304077023-project] 10.222.0.16 "GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531" status: 404 len: 111 microversion: 2.1 time: 0.028970 Mar 26 21:37:05.808173 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3320/6369] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:05 2022] GET /compute/v2.1/servers/3ae210ac-a29a-4beb-811d-3f86358ee531 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:37:42.585466 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'create', calling method: .version_select at 0x7f6e5ed2ca60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1698297387"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:42.599183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:37:42.604277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for user 77f6288194244de28dc65b917c20c3c7 and project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:37:42.862047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:37:42.867565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for user 77f6288194244de28dc65b917c20c3c7 and project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:37:42.882630 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f45fa66c-b236-48a8-88c1-fc6af4a6ceca tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.302627 Mar 26 21:37:42.883243 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3050/6370] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:37:42 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:42.930986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2064395242", "imageRef": "eb7864e6-f178-446e-a6fd-31878cf27688", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1698297387", "networks": [{"uuid": "60de7717-dbf5-48e3-b0db-39de1feeb88d"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:42.979767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] validate_networks() for [('60de7717-dbf5-48e3-b0db-39de1feeb88d', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:37:43.345583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:37:43.346022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:37:43.346511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:37:43.347540 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:37:43.347992 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:37:43.356839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:43.357302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:43.358113 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:43.358561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:43.374680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:37:43.379884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Getting quotas for user 77f6288194244de28dc65b917c20c3c7 and project 3f9ed2569761414ba8a5c29042b497d5. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:37:43.391943 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:37:43.394630 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb7864e6-f178-446e-a6fd-31878cf27688',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:37:43.439294 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e57fbe4-1da3-4a46-ba24-f11ccfc1c09f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512457 Mar 26 21:37:43.440136 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3321/6371] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:37:43.450073 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e08f1219-2038-4863-954d-6697455747ec tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:43.450973 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e08f1219-2038-4863-954d-6697455747ec tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:43.506503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e08f1219-2038-4863-954d-6697455747ec tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:43.514615 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e08f1219-2038-4863-954d-6697455747ec tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1259 microversion: 2.1 time: 0.068395 Mar 26 21:37:43.515223 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3051/6372] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:43 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:44.532161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:44.532799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:44.541459 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:44.541937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:44.542731 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:44.543195 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:44.606365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:44.615257 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4e4719aa-764e-469b-ad28-dd7cfa362333 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1319 microversion: 2.1 time: 0.087167 Mar 26 21:37:44.616449 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3322/6373] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:44 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:45.634492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:45.635210 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:45.643859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:45.644599 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:45.645695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:45.646316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:45.793656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:45.802304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5cf54789-9bdc-4d23-980c-f68a6be40d29 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.173615 Mar 26 21:37:45.803006 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3052/6374] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:45 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:46.818528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:46.819244 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:46.826072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:46.826551 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:46.827347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:46.827806 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:46.995714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:47.004440 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-09aa618b-db4a-4bc6-9abe-4a167bce31fd tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.189622 Mar 26 21:37:47.005157 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3323/6375] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:46 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:48.023059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:48.023768 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:48.031391 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:48.031846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:48.032651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:48.033092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:48.175083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:48.183559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-755a377c-0a12-45cd-a21d-e483b7e73d37 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.164844 Mar 26 21:37:48.184372 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3053/6376] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:48 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:49.200608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:49.201221 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:49.208219 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:49.208686 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:49.209602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:49.210062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:49.361873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:49.370068 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b1983c88-d98a-423a-b440-3804cec5cd43 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.173320 Mar 26 21:37:49.379420 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3324/6377] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:49 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:50.386695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:50.387992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:50.401183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:50.401634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:50.402435 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:50.402881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:50.550868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:50.561338 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-771d5d82-9d5f-4e93-bc63-370b6939b501 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.178497 Mar 26 21:37:50.562193 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3054/6378] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:50 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:51.578328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:51.579039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:51.587155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:51.587646 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:51.588824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:51.589284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:51.735407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:51.744261 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fd6b0d2f-0b24-42d4-85a0-347b39dba134 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.169847 Mar 26 21:37:51.753795 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3325/6379] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:51 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:52.760348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:52.760961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:52.767616 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:52.768109 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:52.769013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:52.769458 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:53.324637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:53.332927 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-845f898e-75b7-4d82-9348-6cc39b2aded4 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.576015 Mar 26 21:37:53.333544 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3055/6380] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:52 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:53.588711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-de91ab52-4aa8-49b8-b9c1-6650cac83ede req-40b1a8af-2e8a-4241-958a-b605f6b89547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:53.603814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-de91ab52-4aa8-49b8-b9c1-6650cac83ede req-40b1a8af-2e8a-4241-958a-b605f6b89547 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:53.604387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-de91ab52-4aa8-49b8-b9c1-6650cac83ede req-40b1a8af-2e8a-4241-958a-b605f6b89547 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:53.622522 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-de91ab52-4aa8-49b8-b9c1-6650cac83ede req-40b1a8af-2e8a-4241-958a-b605f6b89547 service nova] Creating event network-changed:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:37:53.629704 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-de91ab52-4aa8-49b8-b9c1-6650cac83ede req-40b1a8af-2e8a-4241-958a-b605f6b89547 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044416 Mar 26 21:37:53.630499 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3326/6381] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:37:54.350596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:54.351220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:54.358083 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:54.358550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:54.359338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:54.359803 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:54.605534 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:54.613023 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-40049eaa-b249-4ffb-8a99-88ea25f3f992 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.266954 Mar 26 21:37:54.613971 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3056/6382] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:54 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:55.630541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:55.631258 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:55.637515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:55.637988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:55.638774 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:55.639234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:56.087029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:56.095071 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0306f79f-5eda-4494-b629-e3ff0be65415 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.469596 Mar 26 21:37:56.095971 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3327/6383] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:55 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:57.112828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:57.113442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:57.120369 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:57.120823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:57.121593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:57.122034 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:57.256519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:57.263751 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a4bbef23-d280-4e26-90db-249b1aaf5fea tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.154996 Mar 26 21:37:57.264371 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3057/6384] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:57 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:37:58.172172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-b7e4e648-a55b-4f7a-b132-de833bdca4f5 req-2a720742-6286-4848-9546-9a9e33ca1f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "name": "network-vif-plugged", "status": "completed", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:37:58.181275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e4e648-a55b-4f7a-b132-de833bdca4f5 req-2a720742-6286-4848-9546-9a9e33ca1f3c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:58.181783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-b7e4e648-a55b-4f7a-b132-de833bdca4f5 req-2a720742-6286-4848-9546-9a9e33ca1f3c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:58.193878 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-b7e4e648-a55b-4f7a-b132-de833bdca4f5 req-2a720742-6286-4848-9546-9a9e33ca1f3c service nova] Creating event network-vif-plugged:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:37:58.198854 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-b7e4e648-a55b-4f7a-b132-de833bdca4f5 req-2a720742-6286-4848-9546-9a9e33ca1f3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 Mar 26 21:37:58.199653 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3328/6385] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:37:58.280753 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:58.281373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:58.288437 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:58.288902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:58.289865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:58.290315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:58.455347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:58.463006 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-89f444ef-018f-446b-aa76-1580f59f5ca2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.186237 Mar 26 21:37:58.463573 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3058/6386] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:58 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:37:59.480978 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:37:59.481702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:37:59.487848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:59.488361 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:59.489166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:37:59.489633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:37:59.623406 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:37:59.632175 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9679c65-b5bd-4488-9fa9-7903727f9b28 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1359 microversion: 2.1 time: 0.156346 Mar 26 21:37:59.632764 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3329/6387] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:37:59 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:00.650190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:00.650826 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:00.657626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.658079 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:00.658844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.659283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:00.789637 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:00.796987 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-06c6bf01-a3b2-4e3b-84ef-d5098b08889d tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1548 microversion: 2.1 time: 0.150754 Mar 26 21:38:00.797558 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3059/6388] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:00 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:00.813121 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:00.813752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:00.820488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.820963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:00.821748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.822205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:00.954444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:00.962468 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-fc909343-a89b-45f1-a79f-6ddb18440be9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1548 microversion: 2.1 time: 0.153240 Mar 26 21:38:00.963041 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3330/6389] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:00 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:00.978095 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:00.981525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:00.982305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Searching by: {'deleted': False, 'project_id': '3f9ed2569761414ba8a5c29042b497d5'} {{(pid=141580) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 26 21:38:00.987651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.988155 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:00.988971 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:00.989423 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:01.012950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.multi_cell_list [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141580) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 26 21:38:01.039481 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6e72a169-b0ae-404a-808e-2010135e061e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.065188 Mar 26 21:38:01.040101 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3060/6390] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 21:38:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:38:01.050340 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:01.051054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:01.057478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:01.057952 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:01.058737 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:01.059189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:01.191206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:01.199123 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9daf3d0b-491d-4de7-8522-d2ce7978c47b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1548 microversion: 2.1 time: 0.152667 Mar 26 21:38:01.199690 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3331/6391] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:01 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:02.685904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b2eb087-9605-4220-89e1-d862ee82bfe7"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:38:02.687003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:02.694268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:02.694737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:02.695519 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:02.695985 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:02.928410 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f20fbd67-5dad-4c71-b956-7652443cfa23 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246298 Mar 26 21:38:02.929037 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3061/6392] 10.222.0.16 () {60 vars in 1322 bytes} [Sat Mar 26 21:38:02 2022] POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:38:06.248541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:06.249168 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:06.256418 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:06.256884 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:06.257664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:06.258119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:06.387088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:06.397299 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2d3a2ab-c299-4b49-b393-1b108eb4dfcc tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1594 microversion: 2.1 time: 0.152697 Mar 26 21:38:06.397874 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3332/6393] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:06 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:08.325118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-525a83d3-5ef4-4a98-9f1b-9fcbea3367fe req-0fbc691f-21fa-422b-8d7b-477259bf298f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:38:08.336500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-525a83d3-5ef4-4a98-9f1b-9fcbea3367fe req-0fbc691f-21fa-422b-8d7b-477259bf298f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:08.336974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-525a83d3-5ef4-4a98-9f1b-9fcbea3367fe req-0fbc691f-21fa-422b-8d7b-477259bf298f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:08.350348 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-525a83d3-5ef4-4a98-9f1b-9fcbea3367fe req-0fbc691f-21fa-422b-8d7b-477259bf298f service nova] Creating event network-changed:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:38:08.356230 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-525a83d3-5ef4-4a98-9f1b-9fcbea3367fe req-0fbc691f-21fa-422b-8d7b-477259bf298f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222629 Mar 26 21:38:08.357099 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3062/6394] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:38:09.096068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1271361972"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:38:09.097620 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:09.106249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:09.106724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:09.107598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:09.108098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:09.245018 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.network.security_group_api [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Adding security group ca3aeb6e-96e5-4f11-bfa4-dc4f9d6cba59 to port caef9b55-704e-4694-bfa6-9d72c89b16ac Mar 26 21:38:09.592887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9461d58-e259-486c-b79e-ba2f468bf0b1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action" status: 202 len: 0 microversion: 2.1 time: 0.501358 Mar 26 21:38:09.594838 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3333/6395] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:38:09 2022] POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:38:09.605041 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:09.606312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:09.613533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:09.614239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:09.615043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:09.615488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:09.790154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:09.798310 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3db3822-9486-43f0-970d-d8469d17ac81 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1758 microversion: 2.1 time: 0.198498 Mar 26 21:38:09.798930 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3063/6396] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:09 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:10.372845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-10da75f3-65ff-4cb3-80b2-f0c26f6af097 req-bb52ef12-2809-43c3-a7a1-6b8431dc6a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:38:10.381636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-10da75f3-65ff-4cb3-80b2-f0c26f6af097 req-bb52ef12-2809-43c3-a7a1-6b8431dc6a00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:10.382100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-10da75f3-65ff-4cb3-80b2-f0c26f6af097 req-bb52ef12-2809-43c3-a7a1-6b8431dc6a00 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:10.393694 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-10da75f3-65ff-4cb3-80b2-f0c26f6af097 req-bb52ef12-2809-43c3-a7a1-6b8431dc6a00 service nova] Creating event network-changed:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:38:10.398739 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-10da75f3-65ff-4cb3-80b2-f0c26f6af097 req-bb52ef12-2809-43c3-a7a1-6b8431dc6a00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030453 Mar 26 21:38:10.399337 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3334/6397] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:38:35.408622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:38:35.409513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:35.416661 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:35.417115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:35.417877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:35.418325 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:35.487607 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8ea322c-cd60-46cf-bc85-8ce058d4c6bf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action" status: 202 len: 0 microversion: 2.1 time: 0.082817 Mar 26 21:38:35.488285 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3064/6398] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:38:35 2022] POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:38:35.499181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:35.499905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:35.507784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:35.508289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:35.509266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:35.509726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:35.663946 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:35.672010 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0526d08e-043b-4d3a-a575-8eacf7b785b9 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1750 microversion: 2.1 time: 0.178247 Mar 26 21:38:35.672600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3335/6399] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:35 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:38:36.691524 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:36.692253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:36.699129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:36.699579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:36.700377 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:36.700814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:36.845252 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:36.853355 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c97a1c76-46fb-4ca1-b379-19b50f6c10d6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.166950 Mar 26 21:38:36.853969 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3065/6400] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:36 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:37.871390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:37.872036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:37.878809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:37.879284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:37.880100 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:37.880618 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:38.024120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:38.032025 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d6b1ac2a-2dbc-4135-bf9d-74ae838cf89e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.164545 Mar 26 21:38:38.032595 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3336/6401] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:37 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:39.049899 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:39.050522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:39.058022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:39.058477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:39.059250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:39.059695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:39.207005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:39.214983 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a0625fc3-757a-4d6e-ba28-be7f65df60ed tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.168999 Mar 26 21:38:39.215554 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3066/6402] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:39 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:40.232458 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:40.233084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:40.240482 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:40.240994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:40.241775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:40.242228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:40.385316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:40.393412 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-71382346-6de2-41a9-8f14-1389cd424d33 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.164855 Mar 26 21:38:40.393985 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3337/6403] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:40 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:41.410111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:41.410655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:41.417422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:41.417875 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:41.418660 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:41.419102 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:41.564903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:41.573336 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e206bf4a-4d59-4279-bed7-a6ce6aab34cf tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.167241 Mar 26 21:38:41.573908 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3067/6404] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:41 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:42.590609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:42.591236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:42.597887 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:42.598356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:42.599730 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:42.600236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:42.752120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:42.760208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84bbefb1-624c-4af8-83bd-e1401afc3ab1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.173419 Mar 26 21:38:42.760796 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3338/6405] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:42 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:43.776689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:43.777307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:43.784093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:43.784547 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:43.785314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:43.785750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:43.929249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:43.937916 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13e3f04e-e407-4a50-bef3-fd25b9e17f26 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.165117 Mar 26 21:38:43.938492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3068/6406] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:43 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:44.954527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:44.955153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:44.962593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:44.963062 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:44.963833 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:44.964322 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:45.109683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:45.117558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a58a47da-4ced-4ba9-8b2b-1bddbf6ae151 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.166949 Mar 26 21:38:45.118130 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3339/6407] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:44 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:46.134941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:46.135624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:46.142442 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:46.142903 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:46.143678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:46.144165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:46.292994 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:46.300893 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-db84893c-7539-4b91-a16e-e5761706b186 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1755 microversion: 2.1 time: 0.169955 Mar 26 21:38:46.301463 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3069/6408] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:46 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:38:47.319568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:38:47.320252 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:38:47.327561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:47.328073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:47.328872 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:38:47.329329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:38:47.477451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:38:47.485346 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bc38daf4-e243-4dd3-9b30-99dd91fe7e95 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1758 microversion: 2.1 time: 0.170561 Mar 26 21:38:47.485924 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3340/6409] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:38:47 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:06.610414 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:39:06.611248 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:39:20.101494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1271361972"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:20.102037 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:20.108539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:20.109002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:20.109775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:20.110221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:20.242951 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.network.security_group_api [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Removing security group ca3aeb6e-96e5-4f11-bfa4-dc4f9d6cba59 from port caef9b55-704e-4694-bfa6-9d72c89b16ac Mar 26 21:39:20.574697 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d47e232c-64cd-4b0b-af45-d9bafb29c0f7 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action" status: 202 len: 0 microversion: 2.1 time: 0.477921 Mar 26 21:39:20.579326 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3070/6410] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:39:20 2022] POST /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:39:20.586788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a48c6868-5730-4a99-abca-97b1f17aedd0 req-57455f76-a693-4f9e-bea7-759f859488a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:20.595266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a48c6868-5730-4a99-abca-97b1f17aedd0 req-57455f76-a693-4f9e-bea7-759f859488a2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:20.596303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a48c6868-5730-4a99-abca-97b1f17aedd0 req-57455f76-a693-4f9e-bea7-759f859488a2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:20.609710 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a48c6868-5730-4a99-abca-97b1f17aedd0 req-57455f76-a693-4f9e-bea7-759f859488a2 service nova] Creating event network-changed:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:39:20.619362 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a48c6868-5730-4a99-abca-97b1f17aedd0 req-57455f76-a693-4f9e-bea7-759f859488a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036764 Mar 26 21:39:20.620462 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3341/6411] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:21.685580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:21.686668 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:21.687528 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-d10b22ff-111a-4667-aee7-040923de69b6 req-0c0ea4d3-04a1-4846-874e-625b2c48e876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:21.694216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:21.694681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:21.695467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:21.695935 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:21.696983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d10b22ff-111a-4667-aee7-040923de69b6 req-0c0ea4d3-04a1-4846-874e-625b2c48e876 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:21.698329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-d10b22ff-111a-4667-aee7-040923de69b6 req-0c0ea4d3-04a1-4846-874e-625b2c48e876 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:21.709463 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-d10b22ff-111a-4667-aee7-040923de69b6 req-0c0ea4d3-04a1-4846-874e-625b2c48e876 service nova] Creating event network-changed:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:39:21.714432 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-d10b22ff-111a-4667-aee7-040923de69b6 req-0c0ea4d3-04a1-4846-874e-625b2c48e876 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032158 Mar 26 21:39:21.715035 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3342/6412] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:39:21.788493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lazy-loading 'services' on Instance uuid 42dcf983-2cbc-4b70-be5d-af510ec798e8 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:39:21.866975 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4f0dca73-3680-4d9b-bd69-39ce45918188 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments/1b2eb087-9605-4220-89e1-d862ee82bfe7" status: 202 len: 0 microversion: 2.1 time: 0.186814 Mar 26 21:39:21.868542 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3071/6413] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:39:21 2022] DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments/1b2eb087-9605-4220-89e1-d862ee82bfe7 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:39:21.878236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:21.879544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:21.886388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:21.887312 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:21.888679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:21.889547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:21.931203 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-262171b4-9b08-47c8-9ea0-5bb85ceb129b tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058186 Mar 26 21:39:21.932231 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3343/6414] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:39:21 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:22.945082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:22.946140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:22.952463 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:22.952918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:22.953716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:22.954157 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:22.980869 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e34e602e-cfb2-4e07-a527-2db50bd1211e tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041629 Mar 26 21:39:22.981418 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3072/6415] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:39:22 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 26 21:39:22.991724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:22.992261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:22.998914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:22.999386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:23.000214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:23.000823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:23.073516 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] HTTP exception thrown: Instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 is not attached to volume 1b2eb087-9605-4220-89e1-d862ee82bfe7 Mar 26 21:39:23.074143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Returning 404 to user: Instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 is not attached to volume 1b2eb087-9605-4220-89e1-d862ee82bfe7 {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:39:23.075011 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba16b289-8f65-406c-87b3-b9e8261c8f4f tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments/1b2eb087-9605-4220-89e1-d862ee82bfe7" status: 404 len: 154 microversion: 2.1 time: 0.087905 Mar 26 21:39:23.075557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3344/6416] 10.222.0.16 () {58 vars in 1415 bytes} [Sat Mar 26 21:39:22 2022] DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8/os-volume_attachments/1b2eb087-9605-4220-89e1-d862ee82bfe7 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:39:24.205238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:24.205785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:24.212568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:24.213023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:24.213787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:24.214228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:24.238022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:39:24.309138 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b702187b-0682-4df4-9a8b-7e4c64dd85e1 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 204 len: 0 microversion: 2.1 time: 0.107468 Mar 26 21:39:24.309657 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3073/6417] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:39:24 2022] DELETE /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:39:24.318369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:24.319358 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:24.326043 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:24.326515 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:24.327302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:24.327755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:24.464455 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:24.471998 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-29bcea20-3a12-484c-9d79-b1ef3545d3a2 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1554 microversion: 2.1 time: 0.157927 Mar 26 21:39:24.472570 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3345/6418] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:24 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:25.490860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:25.492183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:25.499588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:25.500072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:25.500840 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:25.501281 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:25.633996 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:25.641430 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca95c925-b1a8-4ffd-bbe9-09a4c3799271 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1554 microversion: 2.1 time: 0.154888 Mar 26 21:39:25.642050 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3074/6419] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:25 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:26.658446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:26.658995 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:26.665688 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:26.666161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:26.667120 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:26.667788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:26.739053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f6288194244de28dc65b917c20c3c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9ed2569761414ba8a5c29042b497d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:26.747778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa586316-8bd8-48af-888d-344ff78a7b61 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 200 len: 1512 microversion: 2.1 time: 0.093455 Mar 26 21:39:26.748405 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3346/6420] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:26 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:26.768237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7e30c25d-d725-49f0-b98d-1a7f327a15ab req-e535ef84-b6b2-4313-a484-67faf543dcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dcf983-2cbc-4b70-be5d-af510ec798e8", "name": "network-vif-deleted", "tag": "caef9b55-704e-4694-bfa6-9d72c89b16ac"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:26.779312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e30c25d-d725-49f0-b98d-1a7f327a15ab req-e535ef84-b6b2-4313-a484-67faf543dcc1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:26.779750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7e30c25d-d725-49f0-b98d-1a7f327a15ab req-e535ef84-b6b2-4313-a484-67faf543dcc1 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:26.792833 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7e30c25d-d725-49f0-b98d-1a7f327a15ab req-e535ef84-b6b2-4313-a484-67faf543dcc1 service nova] Creating event network-vif-deleted:caef9b55-704e-4694-bfa6-9d72c89b16ac for instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 on nch1-master-1 Mar 26 21:39:26.799530 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7e30c25d-d725-49f0-b98d-1a7f327a15ab req-e535ef84-b6b2-4313-a484-67faf543dcc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035147 Mar 26 21:39:26.800325 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3075/6421] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:27.765742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:27.766372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] [instance: 42dcf983-2cbc-4b70-be5d-af510ec798e8] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:27.773777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:27.774250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:27.775036 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:27.775497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:27.788702 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] HTTP exception thrown: Instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 could not be found. Mar 26 21:39:27.789319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Returning 404 to user: Instance 42dcf983-2cbc-4b70-be5d-af510ec798e8 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:39:27.790160 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e66b45da-53a5-45e9-8d7e-15240169bca6 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8" status: 404 len: 111 microversion: 2.1 time: 0.028497 Mar 26 21:39:27.790706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3347/6422] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:27 2022] GET /compute/v2.1/servers/42dcf983-2cbc-4b70-be5d-af510ec798e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:39:27.799568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-887d1df6-29a5-4fc5-93e6-da2da862b4b3 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] Calling method '.version_select at 0x7f6e590af820>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:27.818118 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-887d1df6-29a5-4fc5-93e6-da2da862b4b3 tempest-TestMinimumBasicScenario-1300155065 tempest-TestMinimumBasicScenario-1300155065-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1698297387" status: 202 len: 0 microversion: 2.1 time: 0.022672 Mar 26 21:39:27.818694 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3076/6423] 10.222.0.16 () {58 vars in 1271 bytes} [Sat Mar 26 21:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1698297387 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:39:37.435807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: .version_select at 0x7f6e4bdc9c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1697989690"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:37.450182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:39:37.456053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:39:37.777401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:39:37.782500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:39:37.797201 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-64b2b04b-4e5c-418b-aa0e-84fe1ae43778 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.526281 Mar 26 21:39:37.797806 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3348/6424] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:39:37 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:43.402228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-174080790", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "6ed4e4c4-47e7-4b78-84e3-ac0d7a29eba4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1697989690", "security_groups": [{"name": "tempest-secgroup-smoke-903287729"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:43.514239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] validate_networks() for [('6ed4e4c4-47e7-4b78-84e3-ac0d7a29eba4', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:39:43.985376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:39:43.985980 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:39:43.986814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:39:43.987485 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:39:43.988225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:39:43.999319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:43.999793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:44.000655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:44.001107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:44.029470 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:39:44.036964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:39:44.052924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:39:44.054807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:39:44.106938 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8383a8c4-fcb6-44f8-a9a8-7cdf967d662e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709793 Mar 26 21:39:44.107609 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3077/6425] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:39:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:39:44.118984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c04aaefd-2812-435f-a544-037211b1abc7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:44.120330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c04aaefd-2812-435f-a544-037211b1abc7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:44.185413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c04aaefd-2812-435f-a544-037211b1abc7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:44.193644 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c04aaefd-2812-435f-a544-037211b1abc7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1266 microversion: 2.1 time: 0.079816 Mar 26 21:39:44.200312 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3349/6426] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:44 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:45.212342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:45.213080 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:45.221764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:45.222583 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:45.223615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:45.224334 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:45.317645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:45.329947 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-65cb4d1f-a6af-4c51-b695-28392918b0be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1318 microversion: 2.1 time: 0.121903 Mar 26 21:39:45.330945 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3078/6427] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:45 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:46.348208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:46.348981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:46.357675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:46.358212 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:46.359027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:46.359681 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:46.504684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:46.512793 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-41169f3b-c9d3-40ad-8413-fc0cc4ef482d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.168757 Mar 26 21:39:46.515024 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3350/6428] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:46 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:46.788301 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-914a5b46-fee8-453e-aa04-bc84135c723c req-0352ef5d-f8fd-49e6-9599-dc8afb8834d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d05366-4c3e-4b43-8b45-9433161ebd42", "tag": "b8b89d90-5538-48c2-9515-f6119f6199a7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:46.815540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-914a5b46-fee8-453e-aa04-bc84135c723c req-0352ef5d-f8fd-49e6-9599-dc8afb8834d5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:46.815737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-914a5b46-fee8-453e-aa04-bc84135c723c req-0352ef5d-f8fd-49e6-9599-dc8afb8834d5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:46.831796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-914a5b46-fee8-453e-aa04-bc84135c723c req-0352ef5d-f8fd-49e6-9599-dc8afb8834d5 service nova] Creating event network-changed:b8b89d90-5538-48c2-9515-f6119f6199a7 for instance c0d05366-4c3e-4b43-8b45-9433161ebd42 on nch2-master-1 Mar 26 21:39:46.837436 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-914a5b46-fee8-453e-aa04-bc84135c723c req-0352ef5d-f8fd-49e6-9599-dc8afb8834d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054511 Mar 26 21:39:46.839691 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3079/6429] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:47.530350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:47.531085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:47.537837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:47.538385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:47.539683 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:47.540166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:47.674583 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:47.682341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f0c032bc-546b-4231-9d07-dc9deb2cf94d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.156066 Mar 26 21:39:47.682921 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3351/6430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:47 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:48.699987 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:48.700736 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:48.706927 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:48.707382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:48.708185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:48.708627 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:48.847263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:48.854559 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8078ce16-710d-4747-a0e7-8f9a70918199 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.159664 Mar 26 21:39:48.855126 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3080/6431] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:48 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:49.871352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:49.872012 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:49.878937 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:49.879414 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:49.880231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:49.880693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:50.015065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:50.023343 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-20a52c5b-2cd1-47a4-b98c-bf43cd4efd2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.156006 Mar 26 21:39:50.024141 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3352/6432] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:49 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:51.039863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:51.040515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:51.047503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:51.048000 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:51.048891 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:51.049348 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:51.183566 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:51.191024 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2f27c3ad-9e7f-4710-8f57-11fc07ebf4cf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.155694 Mar 26 21:39:51.191599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3081/6433] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:51 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:51.665549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-46bc0a11-46f8-4238-ba26-2c7ae2023cf4 req-ceffc830-4b72-4c80-9da4-9738e9b316ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d05366-4c3e-4b43-8b45-9433161ebd42", "name": "network-vif-plugged", "status": "completed", "tag": "b8b89d90-5538-48c2-9515-f6119f6199a7"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:51.674645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-46bc0a11-46f8-4238-ba26-2c7ae2023cf4 req-ceffc830-4b72-4c80-9da4-9738e9b316ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:51.675117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-46bc0a11-46f8-4238-ba26-2c7ae2023cf4 req-ceffc830-4b72-4c80-9da4-9738e9b316ea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:51.687005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-46bc0a11-46f8-4238-ba26-2c7ae2023cf4 req-ceffc830-4b72-4c80-9da4-9738e9b316ea service nova] Creating event network-vif-plugged:b8b89d90-5538-48c2-9515-f6119f6199a7 for instance c0d05366-4c3e-4b43-8b45-9433161ebd42 on nch2-master-1 Mar 26 21:39:51.691938 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-46bc0a11-46f8-4238-ba26-2c7ae2023cf4 req-ceffc830-4b72-4c80-9da4-9738e9b316ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030686 Mar 26 21:39:51.692567 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3353/6434] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:52.208085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:52.208707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:52.215263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:52.215729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:52.216538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:52.216986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:52.353296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:52.360659 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5af4d168-dba5-4437-919a-14c2f8a91484 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1391 microversion: 2.1 time: 0.156709 Mar 26 21:39:52.361232 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3082/6435] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:52 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:53.378921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:53.379710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:53.386435 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:53.386902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:53.387669 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:53.388155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:53.526586 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:53.534122 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d024c0a-9e6f-47c3-8aa8-3b3cbee8a15e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1563 microversion: 2.1 time: 0.160391 Mar 26 21:39:53.534706 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3354/6436] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:53 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:53.549921 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:53.550549 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:53.557528 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:53.557992 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:53.558807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:53.559256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:53.692436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:53.700467 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2af632ee-a439-4014-b1f7-ea635b4ac7f6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1563 microversion: 2.1 time: 0.154383 Mar 26 21:39:53.701056 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3083/6437] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:53 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:39:55.655326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:39:55.656090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:39:55.656612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-2731eb25-3a08-4314-93bd-b27f2073d490 req-b7622b3f-2b36-4969-be36-f999531244c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d05366-4c3e-4b43-8b45-9433161ebd42", "tag": "b8b89d90-5538-48c2-9515-f6119f6199a7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:39:55.664097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:55.664651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:55.665719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:55.666216 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2731eb25-3a08-4314-93bd-b27f2073d490 req-b7622b3f-2b36-4969-be36-f999531244c4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:39:55.666367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:55.667171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-2731eb25-3a08-4314-93bd-b27f2073d490 req-b7622b3f-2b36-4969-be36-f999531244c4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:39:55.680544 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-2731eb25-3a08-4314-93bd-b27f2073d490 req-b7622b3f-2b36-4969-be36-f999531244c4 service nova] Creating event network-changed:b8b89d90-5538-48c2-9515-f6119f6199a7 for instance c0d05366-4c3e-4b43-8b45-9433161ebd42 on nch2-master-1 Mar 26 21:39:55.685729 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-2731eb25-3a08-4314-93bd-b27f2073d490 req-b7622b3f-2b36-4969-be36-f999531244c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032885 Mar 26 21:39:55.686400 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3084/6438] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:39:55.808716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:39:55.816425 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dee77765-5223-4828-99a5-aa0a804a3d00 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1563 microversion: 2.1 time: 0.165859 Mar 26 21:39:55.828827 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3355/6439] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:39:55 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:17.082957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:17.084076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:17.090443 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:17.090898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:17.091670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:17.092142 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:17.141633 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d44570fc-ee93-4fe8-a7b5-71ac637d79f9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action" status: 200 len: 24563 microversion: 2.1 time: 0.063656 Mar 26 21:40:17.147094 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3085/6440] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:40:17 2022] POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action => generated 24563 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:40:28.245229 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:28.245832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:28.252167 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:28.252641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:28.253429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:28.253885 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:28.315892 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9cc816b5-c416-4146-9075-b008d29642bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action" status: 202 len: 0 microversion: 2.1 time: 0.074494 Mar 26 21:40:28.319525 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3356/6441] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:40:28 2022] POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 26 21:40:28.326190 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:28.326892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:28.334467 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:28.335511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:28.337051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:28.337503 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:28.532072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:28.539469 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8e086e90-913b-40aa-a7f8-673600aa0e2d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1687 microversion: 2.1 time: 0.217810 Mar 26 21:40:28.540150 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3086/6442] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:28 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:29.558901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:29.559647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:29.565895 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:29.566369 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:29.567157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:29.567610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:29.777503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:29.785024 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ea05d080-0a67-4f4e-899f-45b4fa32e1e8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1667 microversion: 2.1 time: 0.231916 Mar 26 21:40:29.785597 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3357/6443] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:29 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1667 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:30.875276 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:30.876228 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:30.883710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:30.884195 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:30.884959 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:30.885406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:30.932929 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2aab1b49-d9cb-46d6-89fe-3ecc741d68e0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action" status: 200 len: 32630 microversion: 2.1 time: 0.061431 Mar 26 21:40:30.933546 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3087/6444] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:40:30 2022] POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:40:30.944452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:30.945009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:30.951894 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:30.952400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:30.953184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:30.953643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:31.017102 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-315068b8-1e4e-4369-82cc-ae43b7f669ec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action" status: 202 len: 0 microversion: 2.1 time: 0.076315 Mar 26 21:40:31.020803 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3358/6445] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:40:30 2022] POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:40:31.033154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:31.033892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:31.041446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:31.041905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:31.042685 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:31.043126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:31.187113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:31.195065 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-99306655-bed3-43b8-8f4c-f2e3a3618b79 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1674 microversion: 2.1 time: 0.166034 Mar 26 21:40:31.205662 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3088/6446] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:31 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:32.214213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:32.214922 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:32.221886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:32.222350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:32.223132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:32.223589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:32.362577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:32.370588 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-58ea0273-78e3-4a69-a082-004bc976d62a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1682 microversion: 2.1 time: 0.160835 Mar 26 21:40:32.371157 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3359/6447] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:32 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:32.459997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:32.460929 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:32.468490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:32.468889 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:32.469666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:32.470112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:32.518856 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c0760438-ad76-49e7-96bf-92b1df0033c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action" status: 200 len: 38372 microversion: 2.1 time: 0.062718 Mar 26 21:40:32.519490 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3089/6448] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:40:32 2022] POST /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42/action => generated 38372 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:40:33.528868 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-29a165e7-c6ed-4c9b-935d-0e31f7e48596 req-ec79543e-c522-4468-b1aa-3d39e341bd27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d05366-4c3e-4b43-8b45-9433161ebd42", "tag": "b8b89d90-5538-48c2-9515-f6119f6199a7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:33.536447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:33.536963 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:33.538652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-29a165e7-c6ed-4c9b-935d-0e31f7e48596 req-ec79543e-c522-4468-b1aa-3d39e341bd27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:33.539113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-29a165e7-c6ed-4c9b-935d-0e31f7e48596 req-ec79543e-c522-4468-b1aa-3d39e341bd27 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:33.544448 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:33.545177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:33.545983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:33.546442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:33.550861 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-29a165e7-c6ed-4c9b-935d-0e31f7e48596 req-ec79543e-c522-4468-b1aa-3d39e341bd27 service nova] Creating event network-changed:b8b89d90-5538-48c2-9515-f6119f6199a7 for instance c0d05366-4c3e-4b43-8b45-9433161ebd42 on nch2-master-1 Mar 26 21:40:33.557292 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-29a165e7-c6ed-4c9b-935d-0e31f7e48596 req-ec79543e-c522-4468-b1aa-3d39e341bd27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031969 Mar 26 21:40:33.558198 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3090/6449] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:40:33.575593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:40:33.658182 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-531eeb13-d8ad-4292-9757-ed07dee5e3f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 204 len: 0 microversion: 2.1 time: 0.136193 Mar 26 21:40:33.658851 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3360/6450] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:40:33 2022] DELETE /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:40:33.668766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:33.669476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:33.675949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:33.676679 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:33.677940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:33.678593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:33.915318 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:33.922972 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-647e1d0e-fc34-4940-b270-8c46a8177d58 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1688 microversion: 2.1 time: 0.259067 Mar 26 21:40:33.923557 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3091/6451] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:33 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1688 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:34.941162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:34.941876 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:34.949238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:34.949701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:34.950476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:34.950928 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:35.091534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:35.098942 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0407e9c5-d14d-4988-83b6-c64aa4e71e27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 200 len: 1569 microversion: 2.1 time: 0.162120 Mar 26 21:40:35.099511 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3361/6452] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:34 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:35.670478 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-7268206a-eb73-42bd-a6e5-9516501534c3 req-1be2c15a-21ec-42cf-9bd1-3d7facf66675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d05366-4c3e-4b43-8b45-9433161ebd42", "name": "network-vif-deleted", "tag": "b8b89d90-5538-48c2-9515-f6119f6199a7"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:35.681751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7268206a-eb73-42bd-a6e5-9516501534c3 req-1be2c15a-21ec-42cf-9bd1-3d7facf66675 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:35.682302 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-7268206a-eb73-42bd-a6e5-9516501534c3 req-1be2c15a-21ec-42cf-9bd1-3d7facf66675 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:35.693853 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-7268206a-eb73-42bd-a6e5-9516501534c3 req-1be2c15a-21ec-42cf-9bd1-3d7facf66675 service nova] Creating event network-vif-deleted:b8b89d90-5538-48c2-9515-f6119f6199a7 for instance c0d05366-4c3e-4b43-8b45-9433161ebd42 on nch2-master-1 Mar 26 21:40:35.698675 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-7268206a-eb73-42bd-a6e5-9516501534c3 req-1be2c15a-21ec-42cf-9bd1-3d7facf66675 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Mar 26 21:40:35.699277 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3092/6453] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:40:36.116535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:36.117451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: c0d05366-4c3e-4b43-8b45-9433161ebd42] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:36.126758 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:36.127980 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:36.128803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:36.129279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:36.143130 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] HTTP exception thrown: Instance c0d05366-4c3e-4b43-8b45-9433161ebd42 could not be found. Mar 26 21:40:36.143678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Returning 404 to user: Instance c0d05366-4c3e-4b43-8b45-9433161ebd42 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:40:36.144558 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-011bedf0-6c50-421e-af89-8869f762c5b9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42" status: 404 len: 111 microversion: 2.1 time: 0.032093 Mar 26 21:40:36.145103 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3362/6454] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:36 2022] GET /compute/v2.1/servers/c0d05366-4c3e-4b43-8b45-9433161ebd42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:40:39.575664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5b8b78a7-b622-4d94-b85c-9619ea9f9e3f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '.version_select at 0x7f6e590af310>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:39.601629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5b8b78a7-b622-4d94-b85c-9619ea9f9e3f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1697989690" status: 202 len: 0 microversion: 2.1 time: 0.031016 Mar 26 21:40:39.603599 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3093/6455] 10.222.0.16 () {58 vars in 1283 bytes} [Sat Mar 26 21:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1697989690 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:40:39.623843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: .version_select at 0x7f6e4becb820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-375558503"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:39.642308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:40:39.649098 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:40:39.779748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:40:39.785052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:40:39.799458 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-99fbad97-7481-4999-aef0-a8c8f4a7cd80 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.179876 Mar 26 21:40:39.800094 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3363/6456] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:40:39 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:40:45.428421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1056754116", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "ed3d5eb0-8c65-4789-bb5a-bb5f63a163da"}], "key_name": "tempest-TestNetworkAdvancedServerOps-375558503", "security_groups": [{"name": "tempest-secgroup-smoke-1654228322"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:45.567242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] validate_networks() for [('ed3d5eb0-8c65-4789-bb5a-bb5f63a163da', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:40:45.981941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:40:45.982771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:40:45.983430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:40:45.983846 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:40:45.984312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:40:45.994124 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:45.994591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:45.995402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:45.995839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:46.016371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:40:46.024286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:40:46.042624 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:40:46.045555 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:40:46.093512 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-686e0476-e358-4672-8ba1-79517b525c5b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676096 Mar 26 21:40:46.094531 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3094/6457] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:40:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:40:46.105507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cefa5f21-bb79-456f-b4b9-d18777d6ec32 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:46.106483 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cefa5f21-bb79-456f-b4b9-d18777d6ec32 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:46.162365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cefa5f21-bb79-456f-b4b9-d18777d6ec32 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:46.169488 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cefa5f21-bb79-456f-b4b9-d18777d6ec32 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1266 microversion: 2.1 time: 0.069101 Mar 26 21:40:46.170192 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3364/6458] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:46 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:47.186810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4d36adf2-503e-4c70-9b75-33b2bb3a5e54 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:47.187537 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4d36adf2-503e-4c70-9b75-33b2bb3a5e54 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:47.246069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4d36adf2-503e-4c70-9b75-33b2bb3a5e54 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:47.253711 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4d36adf2-503e-4c70-9b75-33b2bb3a5e54 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1266 microversion: 2.1 time: 0.071059 Mar 26 21:40:47.263546 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3095/6459] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:47 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:47.842347 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:40:47.842847 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:40:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:40:48.270604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bb245a9e-496f-461f-8d04-b475614ed937 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:48.271242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bb245a9e-496f-461f-8d04-b475614ed937 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:48.328724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bb245a9e-496f-461f-8d04-b475614ed937 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:48.336727 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bb245a9e-496f-461f-8d04-b475614ed937 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1266 microversion: 2.1 time: 0.069343 Mar 26 21:40:48.337340 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3365/6460] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:48 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:49.353236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a45e203d-a9db-4cf3-a15d-0d1f45ac75bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:49.353785 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a45e203d-a9db-4cf3-a15d-0d1f45ac75bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:49.404983 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a45e203d-a9db-4cf3-a15d-0d1f45ac75bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:49.411445 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a45e203d-a9db-4cf3-a15d-0d1f45ac75bd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1266 microversion: 2.1 time: 0.062169 Mar 26 21:40:49.412025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3096/6461] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:49 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1266 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:50.427854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:50.428532 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:50.435393 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:50.435848 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:50.436689 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:50.437149 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:50.495622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:50.503259 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cbe039d5-c1ea-4cd1-9c50-fa66a48aa0a6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1270 microversion: 2.1 time: 0.079602 Mar 26 21:40:50.503828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3366/6462] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:50 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:51.520852 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:51.522163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:51.531055 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:51.531482 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:51.532635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:51.533104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:51.604659 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:51.611907 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d4cfc235-5a5c-448f-91e1-7f28bf326800 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1324 microversion: 2.1 time: 0.094948 Mar 26 21:40:51.612492 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3097/6463] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:51 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1324 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:52.527462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-8b7a885d-9516-4e5e-ac69-1a80e3081b49 req-faf925dd-52a6-4018-9f93-8e879e13e2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1b2c44-95f7-4d78-a980-67546d019133", "tag": "e3949449-bd9a-497d-b2fc-908e10ef222f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:52.544780 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8b7a885d-9516-4e5e-ac69-1a80e3081b49 req-faf925dd-52a6-4018-9f93-8e879e13e2d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:52.545846 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-8b7a885d-9516-4e5e-ac69-1a80e3081b49 req-faf925dd-52a6-4018-9f93-8e879e13e2d2 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:52.565126 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-8b7a885d-9516-4e5e-ac69-1a80e3081b49 req-faf925dd-52a6-4018-9f93-8e879e13e2d2 service nova] Creating event network-changed:e3949449-bd9a-497d-b2fc-908e10ef222f for instance cc1b2c44-95f7-4d78-a980-67546d019133 on nch2-master-1 Mar 26 21:40:52.573849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-8b7a885d-9516-4e5e-ac69-1a80e3081b49 req-faf925dd-52a6-4018-9f93-8e879e13e2d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055506 Mar 26 21:40:52.574739 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3367/6464] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:40:52.629136 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:52.629853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:52.637462 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:52.638054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:52.639071 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:52.639634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:52.852502 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:52.859818 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-26e66cfa-7fbc-48ae-afad-b860aace8f49 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.234730 Mar 26 21:40:52.860502 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3098/6465] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:52 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:53.877985 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:53.878655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:53.885921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:53.886384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:53.887162 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:53.887615 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:54.024197 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:54.031564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a945166e-1828-45d7-84b9-e195883a1360 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.158228 Mar 26 21:40:54.032159 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3368/6466] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:53 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:55.048784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:55.049408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:55.056580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:55.057038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:55.057810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:55.058323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:55.200926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:55.208311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2c573c06-6e69-454c-9cd7-0566692336f8 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.163424 Mar 26 21:40:55.208898 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3099/6467] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:55 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:56.224951 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:56.225609 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:56.232387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:56.232860 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:56.233753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:56.234237 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:56.378211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:56.386569 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2eb66085-0f21-455b-9f10-1e10c9de7a13 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.165554 Mar 26 21:40:56.387183 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3369/6468] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:56 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:57.403317 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:57.403952 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:57.410373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:57.410832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:57.411608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:57.412084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:57.544844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:57.552041 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-38a73cee-1968-45a5-8a1e-298360e60fae tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.152839 Mar 26 21:40:57.552863 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3100/6469] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:57 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:57.964511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ba06290b-4da8-4e37-8464-859beba23fd9 req-640af550-c867-49f9-8fdb-2f202646f3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1b2c44-95f7-4d78-a980-67546d019133", "name": "network-vif-plugged", "status": "completed", "tag": "e3949449-bd9a-497d-b2fc-908e10ef222f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:40:57.973301 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ba06290b-4da8-4e37-8464-859beba23fd9 req-640af550-c867-49f9-8fdb-2f202646f3cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:57.973775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ba06290b-4da8-4e37-8464-859beba23fd9 req-640af550-c867-49f9-8fdb-2f202646f3cf service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:57.984730 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ba06290b-4da8-4e37-8464-859beba23fd9 req-640af550-c867-49f9-8fdb-2f202646f3cf service nova] Creating event network-vif-plugged:e3949449-bd9a-497d-b2fc-908e10ef222f for instance cc1b2c44-95f7-4d78-a980-67546d019133 on nch2-master-1 Mar 26 21:40:57.989586 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ba06290b-4da8-4e37-8464-859beba23fd9 req-640af550-c867-49f9-8fdb-2f202646f3cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029510 Mar 26 21:40:57.990189 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3370/6470] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:40:58.569015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:58.569631 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:58.576396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:58.576854 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:58.577632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:58.578260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:58.715345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:58.722741 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0a6c1bd2-8267-4628-88a2-34bc96ce8b01 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1392 microversion: 2.1 time: 0.157622 Mar 26 21:40:58.723310 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3101/6471] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:58 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:59.741416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:59.742632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:59.748820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:59.749289 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:59.750067 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:59.750519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:59.885621 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:40:59.893028 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7ee37a7f-a8b6-48df-a889-e61754a30faf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1564 microversion: 2.1 time: 0.156754 Mar 26 21:40:59.893600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3371/6472] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:59 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:40:59.908879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:40:59.909494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:40:59.916209 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:59.916664 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:40:59.917430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:40:59.917872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:00.051242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:00.059387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1ed03ee0-6a57-4038-8bf3-152261b5768c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1564 microversion: 2.1 time: 0.154432 Mar 26 21:41:00.059972 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3102/6473] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:40:59 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:01.994304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:01.995004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:01.996856 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5c6c37f8-6557-461e-87cd-7d285210d604 req-66cceccc-b775-4bb9-95c7-1948f9746db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1b2c44-95f7-4d78-a980-67546d019133", "tag": "e3949449-bd9a-497d-b2fc-908e10ef222f"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:41:02.002372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:02.003125 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:02.004024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:02.004557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:02.017112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5c6c37f8-6557-461e-87cd-7d285210d604 req-66cceccc-b775-4bb9-95c7-1948f9746db4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:02.017563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5c6c37f8-6557-461e-87cd-7d285210d604 req-66cceccc-b775-4bb9-95c7-1948f9746db4 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:02.030240 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5c6c37f8-6557-461e-87cd-7d285210d604 req-66cceccc-b775-4bb9-95c7-1948f9746db4 service nova] Creating event network-changed:e3949449-bd9a-497d-b2fc-908e10ef222f for instance cc1b2c44-95f7-4d78-a980-67546d019133 on nch2-master-1 Mar 26 21:41:02.035813 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5c6c37f8-6557-461e-87cd-7d285210d604 req-66cceccc-b775-4bb9-95c7-1948f9746db4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043198 Mar 26 21:41:02.036533 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3103/6474] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:41:02.162354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:02.171367 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4774bef3-ea56-429e-ae4f-04f34b7c986f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1564 microversion: 2.1 time: 0.181298 Mar 26 21:41:02.172274 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3372/6475] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:01 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:23.428162 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:41:23.429167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:23.436243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:23.436704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:23.437480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:23.437926 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:23.484304 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-974d2c2d-9a72-455b-bb92-c4644e05ff4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action" status: 200 len: 24571 microversion: 2.1 time: 0.061437 Mar 26 21:41:23.484924 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3104/6476] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:41:23 2022] POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:41:34.489441 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:41:34.490428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:34.496716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:34.497189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:34.497969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:34.498420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:34.566877 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7d1e8679-45a9-47ee-86d6-da722fe380d7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action" status: 202 len: 0 microversion: 2.1 time: 0.081316 Mar 26 21:41:34.567511 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3373/6477] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:41:34 2022] POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:41:34.576947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:34.577656 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:34.585237 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:34.585744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:34.586526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:34.587049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:34.822918 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:34.830342 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-549355b9-1e97-46e2-9706-e1f95a924f3d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1674 microversion: 2.1 time: 0.258398 Mar 26 21:41:34.831329 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3105/6478] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:34 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:35.849206 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:35.849925 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:35.856920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:35.857403 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:35.858193 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:35.858654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:35.991604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:35.999085 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ba462a88-996a-4d29-9436-728953043f41 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.155309 Mar 26 21:41:35.999654 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3374/6479] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:35 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:37.017307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:37.017970 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:37.025673 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:37.026140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:37.027382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:37.027382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:37.246002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:37.253664 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7f2c11e2-c5f7-46a5-a7ff-76499e7d173e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.240344 Mar 26 21:41:37.254252 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3106/6480] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:37 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:38.270653 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:38.271280 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:38.278097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:38.278513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:38.279297 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:38.279756 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:38.417274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:38.424726 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5ba71e6e-5627-4119-a07f-a7f056cf1e44 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.157989 Mar 26 21:41:38.425289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3375/6481] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:38 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:39.442744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:39.443372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:39.450851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:39.451316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:39.452123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:39.452575 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:39.586615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:39.594040 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d5bc76d6-6c6a-465e-acbb-9bcc8952305d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.155283 Mar 26 21:41:39.594626 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3107/6482] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:39 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:40.612013 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:40.612635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:40.619969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:40.620429 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:40.621205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:40.621655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:40.755996 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:40.763983 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a4164323-9690-42b7-8e52-40d93bc67983 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.155907 Mar 26 21:41:40.764556 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3376/6483] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:40 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:41.781477 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:41.782087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:41.788914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:41.789373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:41.790151 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:41.791231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:41.927271 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:41.934585 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c33a3f2a-f8b0-44b1-b253-40d38dc38b92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.157030 Mar 26 21:41:41.935156 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3108/6484] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:41 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:42.950795 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:42.951424 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:42.957935 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:42.958412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:42.959210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:42.959678 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:43.097488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:43.105473 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6aff9578-02d8-4630-a1fb-e7ffde258a76 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.158810 Mar 26 21:41:43.106043 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3377/6485] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:42 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:44.125065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:44.125677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:44.132756 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:44.133220 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:44.134051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:44.135149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:44.268158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:44.275590 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-33e46b68-6e4f-47d0-97e1-5d8fb51f96f0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.155910 Mar 26 21:41:44.276203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3109/6486] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:44 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:45.292594 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:45.293233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:45.300099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:45.300580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:45.301373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:45.301835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:45.440026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:45.447520 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c527e848-2ba9-4774-acc1-d107dc6e1a81 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.158858 Mar 26 21:41:45.448118 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3378/6487] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:45 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:46.464588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:46.465234 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:46.472111 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:46.472600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:46.473384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:46.473824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:46.609780 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:46.617030 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-58d5beb9-0038-4e5d-b5c3-d2bb258283a5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.156432 Mar 26 21:41:46.617596 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3110/6488] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:46 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:47.634006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:47.634636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:47.642123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:47.642596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:47.643379 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:47.643840 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:47.774518 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:47.782032 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-69104fc2-f907-469f-8a54-551754181078 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.152038 Mar 26 21:41:47.782602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3379/6489] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:47 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:48.798755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:48.799419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:48.806507 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:48.807187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:48.808346 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:48.808795 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:48.942905 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:48.950824 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-05b7aa6a-b7b2-4d34-a3d8-7b5b8719be4c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.156009 Mar 26 21:41:48.951608 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3111/6490] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:48 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:49.967302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:49.968080 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:49.974824 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:49.975291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:49.976105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:49.976562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:50.114865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:50.122206 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ec1bb2e9-7250-4856-a894-3de12dcfe43a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1679 microversion: 2.1 time: 0.159294 Mar 26 21:41:50.122786 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3380/6491] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:49 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:41:51.139300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:41:51.139897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:41:51.146789 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:51.147246 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:51.148054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:41:51.148501 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:41:51.284110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:41:51.292376 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9c5eb448-a1e9-4d9e-a25d-bb4c1ff56c0c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1682 microversion: 2.1 time: 0.156307 Mar 26 21:41:51.292958 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3112/6492] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:41:51 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:15.478182 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:15.479131 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:15.485762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:15.486233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:15.487048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:15.487508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:15.537612 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f232703e-a849-4769-a4b3-1962813ea4cb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action" status: 200 len: 69474 microversion: 2.1 time: 0.063549 Mar 26 21:42:15.538265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3381/6493] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:42:15 2022] POST /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133/action => generated 69474 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:42:22.686838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:22.688135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:22.697696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:22.698586 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:22.699680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:22.700546 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:22.727197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:42:22.787685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-0eced016-9878-4836-9eb8-f044172c9c8d req-0862255f-2b05-4aee-b52f-41d0a8f06d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1b2c44-95f7-4d78-a980-67546d019133", "tag": "e3949449-bd9a-497d-b2fc-908e10ef222f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:22.798150 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0eced016-9878-4836-9eb8-f044172c9c8d req-0862255f-2b05-4aee-b52f-41d0a8f06d3b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:22.798708 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-0eced016-9878-4836-9eb8-f044172c9c8d req-0862255f-2b05-4aee-b52f-41d0a8f06d3b service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:22.810052 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-0eced016-9878-4836-9eb8-f044172c9c8d req-0862255f-2b05-4aee-b52f-41d0a8f06d3b service nova] Creating event network-changed:e3949449-bd9a-497d-b2fc-908e10ef222f for instance cc1b2c44-95f7-4d78-a980-67546d019133 on nch2-master-1 Mar 26 21:42:22.817994 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-0eced016-9878-4836-9eb8-f044172c9c8d req-0862255f-2b05-4aee-b52f-41d0a8f06d3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131222 Mar 26 21:42:22.819432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3382/6494] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:42:22.820247 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-13c9723b-fca5-4cca-9450-e1566b76c04d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 204 len: 0 microversion: 2.1 time: 0.137875 Mar 26 21:42:22.824025 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3113/6495] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:42:22 2022] DELETE /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:42:22.831101 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:22.832056 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:22.840641 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:22.841116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:22.841921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:22.842395 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:22.989881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:22.999815 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-70355616-6dd0-4ca1-81d7-6de87d1b8b09 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1688 microversion: 2.1 time: 0.172769 Mar 26 21:42:23.000875 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3383/6496] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:22 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:24.017792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:24.018496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:24.025410 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:24.025863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:24.026636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:24.027078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:24.159368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:24.166667 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b2a68296-4e61-410c-86a7-a041696b3f4e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1570 microversion: 2.1 time: 0.153180 Mar 26 21:42:24.167762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3114/6497] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:24 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:24.840390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-104cfff6-a55d-4b05-bcd4-0e19a9300f8f req-a780bd73-1822-4267-8ad2-71205e2d8dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1b2c44-95f7-4d78-a980-67546d019133", "name": "network-vif-deleted", "tag": "e3949449-bd9a-497d-b2fc-908e10ef222f"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:24.849557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-104cfff6-a55d-4b05-bcd4-0e19a9300f8f req-a780bd73-1822-4267-8ad2-71205e2d8dc9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:24.850019 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-104cfff6-a55d-4b05-bcd4-0e19a9300f8f req-a780bd73-1822-4267-8ad2-71205e2d8dc9 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:24.861604 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-104cfff6-a55d-4b05-bcd4-0e19a9300f8f req-a780bd73-1822-4267-8ad2-71205e2d8dc9 service nova] Creating event network-vif-deleted:e3949449-bd9a-497d-b2fc-908e10ef222f for instance cc1b2c44-95f7-4d78-a980-67546d019133 on nch2-master-1 Mar 26 21:42:24.866316 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-104cfff6-a55d-4b05-bcd4-0e19a9300f8f req-a780bd73-1822-4267-8ad2-71205e2d8dc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030360 Mar 26 21:42:24.866906 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3384/6498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:42:25.184757 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:25.185439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:25.193127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:25.193640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:25.194640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:25.195307 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:25.228738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:25.229201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:25.229695 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lazy-loading 'fault' on Instance uuid cc1b2c44-95f7-4d78-a980-67546d019133 {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:42:25.271483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:25.278749 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f4f8e6d6-0799-40d1-9637-43c512653f9f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 200 len: 1356 microversion: 2.1 time: 0.098462 Mar 26 21:42:25.279232 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3115/6499] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:25 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:26.297164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:26.297808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: cc1b2c44-95f7-4d78-a980-67546d019133] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:26.304325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:26.304784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:26.305574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:26.306038 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:26.318841 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] HTTP exception thrown: Instance cc1b2c44-95f7-4d78-a980-67546d019133 could not be found. Mar 26 21:42:26.319440 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Returning 404 to user: Instance cc1b2c44-95f7-4d78-a980-67546d019133 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:42:26.320301 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d47885d-1520-4949-9f74-ade27f20e6f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133" status: 404 len: 111 microversion: 2.1 time: 0.028390 Mar 26 21:42:26.320822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3385/6500] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:26 2022] GET /compute/v2.1/servers/cc1b2c44-95f7-4d78-a980-67546d019133 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:42:29.701709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-540ceee6-3618-4ab8-b008-d235422eb227 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '.version_select at 0x7f6e5ec5cd30>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:29.720895 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-540ceee6-3618-4ab8-b008-d235422eb227 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375558503" status: 202 len: 0 microversion: 2.1 time: 0.023547 Mar 26 21:42:29.721519 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3116/6501] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 21:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375558503 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:42:29.751496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: .version_select at 0x7f6e4bdf64c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38934640"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:29.769409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:42:29.775603 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:42:30.424143 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:42:30.429567 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:42:30.443627 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1588105c-f717-4c1b-a954-bf96105685ff tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.699863 Mar 26 21:42:30.444267 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3386/6502] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:42:29 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:35.773062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1205372255", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "03ddffa5-452d-4e20-9b18-f10db853ae3a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38934640", "security_groups": [{"name": "tempest-secgroup-smoke-1963130195"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:35.887421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] validate_networks() for [('03ddffa5-452d-4e20-9b18-f10db853ae3a', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:42:36.283581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:42:36.284069 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:42:36.284557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:42:36.285094 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:42:36.285526 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:42:36.296888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:36.297632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:36.298678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:36.299320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:36.320497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:42:36.327760 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:42:36.342747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:42:36.345131 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:42:36.395036 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b7f9f86f-5e61-43d9-8dde-8f762f6ae7b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.627239 Mar 26 21:42:36.396626 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3117/6503] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:42:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:42:36.407372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a5711c3d-93ea-471e-bd0d-5c166b554679 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:36.408099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a5711c3d-93ea-471e-bd0d-5c166b554679 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:36.474871 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a5711c3d-93ea-471e-bd0d-5c166b554679 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:36.483000 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a5711c3d-93ea-471e-bd0d-5c166b554679 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1265 microversion: 2.1 time: 0.080618 Mar 26 21:42:36.484191 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3387/6504] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:36 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:42:37.501405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:37.502201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:37.508076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:37.508751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:37.509744 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:37.510183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:37.593714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:37.601264 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3f3a1249-67d7-46c2-b0fe-4c796caa2ec6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1325 microversion: 2.1 time: 0.104722 Mar 26 21:42:37.602042 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3118/6505] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:37 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:38.619151 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:38.620136 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:38.629787 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:38.630436 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:38.631261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:38.631807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:38.796906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:38.816592 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-19e4f7cf-22ff-4381-a115-263f6da16932 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.201619 Mar 26 21:42:38.817607 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3388/6506] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:38 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:39.275251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e40d20a3-d60c-4dd0-8ca8-a8d687fd253e req-d4d44ab6-75c6-4a81-a54b-37e469bcac72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:39.307049 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e40d20a3-d60c-4dd0-8ca8-a8d687fd253e req-d4d44ab6-75c6-4a81-a54b-37e469bcac72 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:39.308027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e40d20a3-d60c-4dd0-8ca8-a8d687fd253e req-d4d44ab6-75c6-4a81-a54b-37e469bcac72 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:39.343827 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e40d20a3-d60c-4dd0-8ca8-a8d687fd253e req-d4d44ab6-75c6-4a81-a54b-37e469bcac72 service nova] Creating event network-changed:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch1-master-1 Mar 26 21:42:39.350229 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e40d20a3-d60c-4dd0-8ca8-a8d687fd253e req-d4d44ab6-75c6-4a81-a54b-37e469bcac72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082576 Mar 26 21:42:39.352242 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3119/6507] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:42:39.833742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:39.834500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:39.841360 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:39.841983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:39.842776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:39.843238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:39.978819 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:39.986778 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-edd2eb33-5279-4af9-a8b4-779a7511421f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.156958 Mar 26 21:42:39.987354 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3389/6508] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:39 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:41.003874 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:41.004602 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:41.012250 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:41.012710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:41.013486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:41.013930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:41.152031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:41.160182 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-eff8bb05-b79d-475b-8b98-4bc62a3ae1f7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.160533 Mar 26 21:42:41.160753 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3120/6509] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:40 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:42.177738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:42.178373 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:42.185742 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:42.186214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:42.187032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:42.187501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:42.323489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:42.331539 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aa54491b-8f85-4840-bae8-8cca67c4147e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.158038 Mar 26 21:42:42.332149 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3390/6510] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:42 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:43.347641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:43.348297 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:43.354751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:43.355203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:43.356046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:43.356489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:43.492518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:43.499942 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fb26d60d-1a35-46ac-8447-b199e176d423 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.156149 Mar 26 21:42:43.500523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3121/6511] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:43 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:44.518799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:44.519434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:44.526105 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:44.526577 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:44.527862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:44.528355 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:44.664016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:44.671978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-022c92e4-ad1e-4e8a-8581-1ef5c20534e6 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.157071 Mar 26 21:42:44.672551 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3391/6512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:44 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:45.525419 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-67fd5267-fb47-41eb-87de-c1cc08dbda7b req-8a2ed41e-d8e4-4ce4-8b25-2ec5e01cdfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "name": "network-vif-plugged", "status": "completed", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:45.533347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67fd5267-fb47-41eb-87de-c1cc08dbda7b req-8a2ed41e-d8e4-4ce4-8b25-2ec5e01cdfd0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:45.533801 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-67fd5267-fb47-41eb-87de-c1cc08dbda7b req-8a2ed41e-d8e4-4ce4-8b25-2ec5e01cdfd0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:45.544863 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-67fd5267-fb47-41eb-87de-c1cc08dbda7b req-8a2ed41e-d8e4-4ce4-8b25-2ec5e01cdfd0 service nova] Creating event network-vif-plugged:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch1-master-1 Mar 26 21:42:45.549687 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-67fd5267-fb47-41eb-87de-c1cc08dbda7b req-8a2ed41e-d8e4-4ce4-8b25-2ec5e01cdfd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094784 Mar 26 21:42:45.550258 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3122/6513] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:42:45.689722 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:45.690348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:45.697099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:45.697635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:45.698430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:45.698883 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:45.837198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:45.844547 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-aef4c38d-dfcc-406e-9435-7292f61ffde1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1391 microversion: 2.1 time: 0.158786 Mar 26 21:42:45.845128 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3392/6514] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:45 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:46.862701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:46.864185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:46.872132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:46.872955 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:46.875163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:46.876046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:47.018681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:47.026238 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9848b4fb-de06-4daf-b365-52d49632cffb tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1564 microversion: 2.1 time: 0.168872 Mar 26 21:42:47.026812 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3123/6515] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:46 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:47.042030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:47.042660 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:47.049906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:47.050380 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:47.051166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:47.051625 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:47.186557 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:47.193972 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e3265b89-9bfe-418d-a999-b528c6721858 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1564 microversion: 2.1 time: 0.155785 Mar 26 21:42:47.194579 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3393/6516] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:47 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:42:49.160786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:42:49.161489 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:42:49.163032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-9ef9e173-c4e3-43da-a099-8053a51c9933 req-64a42191-f460-47c6-8162-475d6633f293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:42:49.169054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:49.169788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:49.170888 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:49.171670 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:49.174556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9ef9e173-c4e3-43da-a099-8053a51c9933 req-64a42191-f460-47c6-8162-475d6633f293 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:42:49.175659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-9ef9e173-c4e3-43da-a099-8053a51c9933 req-64a42191-f460-47c6-8162-475d6633f293 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:42:49.187435 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-9ef9e173-c4e3-43da-a099-8053a51c9933 req-64a42191-f460-47c6-8162-475d6633f293 service nova] Creating event network-changed:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch1-master-1 Mar 26 21:42:49.192849 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-9ef9e173-c4e3-43da-a099-8053a51c9933 req-64a42191-f460-47c6-8162-475d6633f293 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033486 Mar 26 21:42:49.193826 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3394/6517] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:42:49.409516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:42:49.417207 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b3a1fbf-c13d-4226-ba1f-3803424d129e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1564 microversion: 2.1 time: 0.260489 Mar 26 21:42:49.428815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3124/6518] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:42:49 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1564 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:14.674309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:14.675330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:14.682097 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:14.682562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:14.683350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:14.683862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:14.732981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c53317f0-fcc8-47ad-9b0d-d5fea6922aa3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action" status: 200 len: 24563 microversion: 2.1 time: 0.064430 Mar 26 21:43:14.733607 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3395/6519] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:43:14 2022] POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action => generated 24563 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 26 21:43:25.787360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:25.788373 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:25.794897 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:25.795356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:25.796163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:25.796608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:25.836593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:25.843178 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Old instance type m1.heat2, new instance type m1.heat {{(pid=141580) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 26 21:43:25.849320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:43:25.849745 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:43:25.850226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:43:25.850641 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:43:25.851057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:43:25.911184 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ebc97604-df28-43aa-8e54-48b457114dfe tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action" status: 202 len: 0 microversion: 2.1 time: 0.128124 Mar 26 21:43:25.911805 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3125/6520] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:43:25 2022] POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:43:25.921108 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:25.921830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:25.929283 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:25.929752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:25.930645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:25.931010 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:26.115570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:26.124284 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-896db66c-bd54-4311-9e95-e826aeef4fb7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1691 microversion: 2.1 time: 0.207921 Mar 26 21:43:26.129179 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3396/6521] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:25 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:27.143649 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:27.144259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:27.150282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:27.150741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:27.151513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:27.151978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:27.321201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:27.329263 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-93287e1b-b5fb-43bf-98f6-8a286bef4936 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1691 microversion: 2.1 time: 0.190579 Mar 26 21:43:27.329839 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3126/6522] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:27 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:28.347539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:28.348114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:28.355473 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:28.355981 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:28.356773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:28.357231 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:28.491022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:28.498394 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-021f0277-7c42-4538-982e-c3ab9f69b78f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.154835 Mar 26 21:43:28.498967 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3397/6523] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:28 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:29.516386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:29.517059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:29.523818 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:29.524315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:29.525096 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:29.525542 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:29.659045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:29.666452 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4dc1d8cb-2f85-4e6e-ae36-e21145d7085d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.154602 Mar 26 21:43:29.667031 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3127/6524] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:29 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:30.683547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:30.684238 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:30.691083 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:30.691555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:30.692376 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:30.692834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:30.832810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:30.840782 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9b2eb7eb-3633-4d10-b2ab-6d972c01d823 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.161169 Mar 26 21:43:30.841366 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3398/6525] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:30 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:31.858332 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:31.858978 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:31.865764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:31.866221 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:31.866993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:31.867439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:32.007882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:32.015536 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f1ff9321-1eef-4b7d-8174-8dbdae16e06b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.161741 Mar 26 21:43:32.016137 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3128/6526] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:31 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:33.032907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:33.033533 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:33.040272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:33.040736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:33.041511 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:33.041965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:33.175433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:33.183208 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8db1aae3-7c53-457c-8122-a23c10839c42 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.154194 Mar 26 21:43:33.183778 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3399/6527] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:33 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:34.200480 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:34.201103 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:34.207872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:34.208374 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:34.209158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:34.209604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:34.342148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:34.349371 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c8a89ac8-012a-4499-a53a-e755b0f8c0c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.153460 Mar 26 21:43:34.349944 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3129/6528] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:34 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:35.366837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:35.367466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:35.374717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:35.375186 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:35.376000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:35.376463 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:35.516607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:35.524004 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-28eb0ba1-0bb6-4220-a224-e6af99022ac5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.161063 Mar 26 21:43:35.524600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3400/6529] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:35 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:36.540154 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:36.540777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:36.547511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:36.548002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:36.548773 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:36.549213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:36.681036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:36.688409 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b7c2558b-9b4f-4f01-a90a-da5ef86345bc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.152264 Mar 26 21:43:36.688985 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3130/6530] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:36 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:37.704793 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:37.705447 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:37.712241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:37.712714 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:37.713504 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:37.713961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:37.852843 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:37.860852 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01d9ad65-1ee4-494e-ba18-2591bfd20eb0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.160014 Mar 26 21:43:37.861600 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3401/6531] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:37 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:38.878303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:38.878914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:38.886005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:38.886468 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:38.887255 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:38.887704 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:39.092408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:39.099962 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d2af3263-ca0b-407e-ba7f-55c3848df8fc tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.225517 Mar 26 21:43:39.100554 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3131/6532] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:38 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:40.117986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:40.118642 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:40.126115 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:40.126519 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:40.127309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:40.127763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:40.261866 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:40.269761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ac5b0599-f0ba-4a83-821a-508064b376fa tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.155652 Mar 26 21:43:40.270330 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3402/6533] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:40 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:41.286523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:41.287123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:41.294499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:41.294948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:41.295716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:41.296185 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:41.432015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:41.439294 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-86cfd327-c255-439a-a794-86e944f0ae1f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.156663 Mar 26 21:43:41.440038 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3132/6534] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:41 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:42.456920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:42.457575 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:42.464400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:42.464865 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:42.465643 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:42.466091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:42.601979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:42.609796 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-dc87e4e0-261c-4966-9b57-67d7746d4c72 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.156739 Mar 26 21:43:42.610367 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3403/6535] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:42 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:43.627152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:43.627771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:43.634707 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:43.635163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:43.635969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:43.636559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:43.772738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:43.780178 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-02044a6b-2060-48d0-bdec-2c2f8e57fdec tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.156962 Mar 26 21:43:43.780746 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3133/6536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:43 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:44.797170 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:44.797801 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:44.804924 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:44.805344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:44.806156 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:44.806634 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:44.942385 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:44.950502 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c958979e-4d17-4e44-bb0c-b4d1c6ebffad tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1696 microversion: 2.1 time: 0.156676 Mar 26 21:43:44.951087 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3404/6537] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:44 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:45.623314 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "name": "network-vif-unplugged", "status": "completed", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:45.632304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:45.632832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:45.645407 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] Creating event network-vif-unplugged:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch2-master-1 Mar 26 21:43:45.650917 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] Instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141580) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:43:45.661847 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ff44386b-c086-4859-aeb7-23080c77015f req-90d2673f-638d-4970-a509-322743da4cf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043084 Mar 26 21:43:45.662472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3134/6538] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:43:45.968298 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:45.968927 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:45.975701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:45.976205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:45.976991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:45.977446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:46.160291 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:46.167942 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1d15a3a9-ba52-43f3-a20e-8ddf2095df1d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1695 microversion: 2.1 time: 0.203799 Mar 26 21:43:46.183987 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3405/6539] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:45 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:47.188075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:47.188781 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:47.194969 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:47.195424 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:47.196226 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:47.196671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:47.330158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:47.337453 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-af453f0f-d418-46e1-abec-f563a4e64a62 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1693 microversion: 2.1 time: 0.155113 Mar 26 21:43:47.338020 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3135/6540] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:47 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:47.678070 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:47.687368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:47.687834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:47.699124 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] Creating event network-changed:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch2-master-1 Mar 26 21:43:47.704993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] Instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=141581) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 26 21:43:47.715883 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-21fb65d1-eb6e-456b-895a-f2547fef97d6 req-d07b9954-b87c-424f-a309-f0353aed01f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041849 Mar 26 21:43:47.716622 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3406/6541] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:43:48.354775 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:48.355405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:48.362810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:48.363273 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:48.364091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:48.364545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.006243 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:49.014437 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa55009e-95ad-4e66-944e-ab77ee34df7b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1690 microversion: 2.1 time: 0.663730 Mar 26 21:43:49.015021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3136/6542] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:48 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1690 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:49.032433 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:49.033090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:49.039606 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.040126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.040932 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.041451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.098508 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-744b9aeb-2a7d-4b26-96a5-faa406252639 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action" status: 204 len: 0 microversion: 2.1 time: 0.071224 Mar 26 21:43:49.099145 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3407/6543] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:43:49 2022] POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:43:49.108378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:49.109135 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:49.115579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.116367 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.118865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.118865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.342500 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:49.349995 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2dfaeff-9cf4-4d2e-b3e0-67b53a9f72bf tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1690 microversion: 2.1 time: 0.246675 Mar 26 21:43:49.350576 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3137/6544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:49 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1690 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:49.367336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:49.368091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:49.375052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.375558 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.376410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:49.376854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:49.515116 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:49.523365 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf30d592-8557-4c9d-bb86-08051792191f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1690 microversion: 2.1 time: 0.159894 Mar 26 21:43:49.524381 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3408/6545] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:49 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:50.541031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:43:50.541650 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:43:50.549059 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:50.549516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:50.550289 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:50.550734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:50.684488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:43:50.692466 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dece796e-7eab-4deb-a698-3751d9032897 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1682 microversion: 2.1 time: 0.155387 Mar 26 21:43:50.693260 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3138/6546] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:43:50 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:43:50.845666 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-39dcd65d-74cf-4797-aa39-a0a64a3bd7be req-8c1cd56f-a78d-4c08-a47d-bfa6215a4767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "name": "network-vif-plugged", "status": "completed", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:43:50.855037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-39dcd65d-74cf-4797-aa39-a0a64a3bd7be req-8c1cd56f-a78d-4c08-a47d-bfa6215a4767 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:43:50.855507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-39dcd65d-74cf-4797-aa39-a0a64a3bd7be req-8c1cd56f-a78d-4c08-a47d-bfa6215a4767 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:43:50.866830 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-39dcd65d-74cf-4797-aa39-a0a64a3bd7be req-8c1cd56f-a78d-4c08-a47d-bfa6215a4767 service nova] Creating event network-vif-plugged:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch2-master-1 Mar 26 21:43:50.872235 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-39dcd65d-74cf-4797-aa39-a0a64a3bd7be req-8c1cd56f-a78d-4c08-a47d-bfa6215a4767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 Mar 26 21:43:50.872828 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3409/6547] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:44:07.850757 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:44:07.851486 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:44:12.890215 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:12.891172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:12.897770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:12.898256 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:12.899075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:12.899548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:12.947371 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b4193112-7bcb-42e3-b0ed-6fab50f38838 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action" status: 200 len: 24580 microversion: 2.1 time: 0.061626 Mar 26 21:44:12.948015 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3139/6548] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:44:12 2022] POST /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28/action => generated 24580 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:44:20.049527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:20.050773 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:20.054266 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-b389bc17-8987-436e-b5ac-a193cb850423 req-285b6b62-4296-4a8a-9c04-79e4f6185f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:20.058835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:20.059396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:20.060309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:20.060841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:20.064104 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b389bc17-8987-436e-b5ac-a193cb850423 req-285b6b62-4296-4a8a-9c04-79e4f6185f28 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:20.064564 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-b389bc17-8987-436e-b5ac-a193cb850423 req-285b6b62-4296-4a8a-9c04-79e4f6185f28 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:20.076579 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-b389bc17-8987-436e-b5ac-a193cb850423 req-285b6b62-4296-4a8a-9c04-79e4f6185f28 service nova] Creating event network-changed:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch2-master-1 Mar 26 21:44:20.082629 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-b389bc17-8987-436e-b5ac-a193cb850423 req-285b6b62-4296-4a8a-9c04-79e4f6185f28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Mar 26 21:44:20.083246 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3140/6549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:44:20.087408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:44:20.175103 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0f087261-8442-433c-a228-b012eba9f33d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 204 len: 0 microversion: 2.1 time: 0.129554 Mar 26 21:44:20.179105 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3410/6550] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:44:20 2022] DELETE /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:44:20.186772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:20.187490 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:20.194116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:20.194579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:20.195368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:20.195817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:20.425615 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:20.433494 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1cf9b156-cabf-4473-a707-1bc4fe3dee9d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1688 microversion: 2.1 time: 0.252510 Mar 26 21:44:20.434082 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3141/6551] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:20 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:21.451792 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:21.452548 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:21.462262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:21.462732 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:21.463527 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:21.464094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:21.601309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:21.610190 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-de9e7525-514f-4ebc-96ea-3040d37b90d9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 200 len: 1570 microversion: 2.1 time: 0.163280 Mar 26 21:44:21.610766 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3411/6552] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:21 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:22.097515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-9d6fb7d4-d362-4914-b84d-329eacfbd686 req-fcf2c5f5-60e2-4f9d-9eb1-5c4ddbc654a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd2d7c7d-5b67-4376-aa77-0cd4c1844b28", "name": "network-vif-deleted", "tag": "52b6dc59-4403-42f1-9a0f-d45c6ffd93a9"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:22.106652 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9d6fb7d4-d362-4914-b84d-329eacfbd686 req-fcf2c5f5-60e2-4f9d-9eb1-5c4ddbc654a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:22.107323 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-9d6fb7d4-d362-4914-b84d-329eacfbd686 req-fcf2c5f5-60e2-4f9d-9eb1-5c4ddbc654a6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:22.119887 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-9d6fb7d4-d362-4914-b84d-329eacfbd686 req-fcf2c5f5-60e2-4f9d-9eb1-5c4ddbc654a6 service nova] Creating event network-vif-deleted:52b6dc59-4403-42f1-9a0f-d45c6ffd93a9 for instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 on nch2-master-1 Mar 26 21:44:22.127161 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-9d6fb7d4-d362-4914-b84d-329eacfbd686 req-fcf2c5f5-60e2-4f9d-9eb1-5c4ddbc654a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 Mar 26 21:44:22.127787 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3142/6553] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:44:22.627827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:22.628404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: dd2d7c7d-5b67-4376-aa77-0cd4c1844b28] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:22.635030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:22.635500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:22.636307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:22.636763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:22.650341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] HTTP exception thrown: Instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 could not be found. Mar 26 21:44:22.650938 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Returning 404 to user: Instance dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:44:22.651789 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7a52fb97-2462-4e22-8904-380f9657e867 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28" status: 404 len: 111 microversion: 2.1 time: 0.027973 Mar 26 21:44:22.652339 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3412/6554] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:22 2022] GET /compute/v2.1/servers/dd2d7c7d-5b67-4376-aa77-0cd4c1844b28 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:44:25.991805 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-31ed35aa-8d59-42a1-80c4-bb7cda20975f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '.version_select at 0x7f6e5ec79ee0>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:26.022474 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-31ed35aa-8d59-42a1-80c4-bb7cda20975f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38934640" status: 202 len: 0 microversion: 2.1 time: 0.036797 Mar 26 21:44:26.023070 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3143/6555] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 21:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38934640 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:44:26.048144 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: .version_select at 0x7f6e4bdac310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-537052790"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:26.063495 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:44:26.068789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:44:26.524727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:44:26.530464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:44:26.546761 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e9bd9d65-aa60-4110-9db6-49941bed07b7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.503246 Mar 26 21:44:26.547365 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3413/6556] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:44:26 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:32.072770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1310201730", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "6b90a392-9408-4e9d-9639-01ba9f404000"}], "key_name": "tempest-TestNetworkAdvancedServerOps-537052790", "security_groups": [{"name": "tempest-secgroup-smoke-1924695551"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:32.203117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] validate_networks() for [('6b90a392-9408-4e9d-9639-01ba9f404000', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:44:32.620205 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:44:32.620635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:44:32.621117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:44:32.621529 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:44:32.621947 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:44:32.630913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:32.631365 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:32.632192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:32.632700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:32.650024 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:44:32.655790 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:44:32.667881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:44:32.670936 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:44:32.718589 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0e3b088-3be9-4117-b16e-992cb371435f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.649996 Mar 26 21:44:32.719556 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3144/6557] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:44:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:44:32.729468 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ffde9c55-2caf-4545-a9b1-fe48c1fb5978 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:32.730837 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ffde9c55-2caf-4545-a9b1-fe48c1fb5978 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:32.790085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ffde9c55-2caf-4545-a9b1-fe48c1fb5978 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:32.797134 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ffde9c55-2caf-4545-a9b1-fe48c1fb5978 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1266 microversion: 2.1 time: 0.071478 Mar 26 21:44:32.798264 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3414/6558] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:32 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:44:33.815422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:33.817741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:33.827399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:33.828167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:33.829331 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:33.829960 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:33.927610 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:33.936492 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a3bf61e3-8f01-4293-b54a-b2fe24558d21 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1336 microversion: 2.1 time: 0.126711 Mar 26 21:44:33.937693 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3145/6559] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:33 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:34.956822 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:34.957682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:34.964048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:34.964601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:34.965475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:34.966004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:35.195090 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:35.204887 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-62de23e5-e196-4bf0-bf39-c359b62c95f5 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.252010 Mar 26 21:44:35.206919 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3415/6560] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:34 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:35.307686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-72e20feb-844e-479c-933c-e7a264fd6cb4 req-59a249b4-3fd8-4678-97d6-973848ad9b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae70161d-4d4a-4f05-8989-4386e64311e3", "tag": "7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:35.323699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-72e20feb-844e-479c-933c-e7a264fd6cb4 req-59a249b4-3fd8-4678-97d6-973848ad9b69 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:35.324456 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-72e20feb-844e-479c-933c-e7a264fd6cb4 req-59a249b4-3fd8-4678-97d6-973848ad9b69 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:35.337766 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-72e20feb-844e-479c-933c-e7a264fd6cb4 req-59a249b4-3fd8-4678-97d6-973848ad9b69 service nova] Creating event network-changed:7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4 for instance ae70161d-4d4a-4f05-8989-4386e64311e3 on nch1-master-1 Mar 26 21:44:35.343341 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-72e20feb-844e-479c-933c-e7a264fd6cb4 req-59a249b4-3fd8-4678-97d6-973848ad9b69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041526 Mar 26 21:44:35.344461 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3146/6561] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:44:36.223230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:36.223854 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:36.230309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:36.230777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:36.231553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:36.232041 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:36.366507 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:36.373926 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b17805b8-1fb7-4dc3-be0f-5e06a01fe6c1 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.154600 Mar 26 21:44:36.374493 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3416/6562] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:36 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:37.439755 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:37.440514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:37.446658 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:37.447117 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:37.447892 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:37.448366 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:37.589204 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:37.597152 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e53ead05-b2c2-43d6-b750-3ee97cc16839 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.210260 Mar 26 21:44:37.597728 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3147/6563] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:37 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:38.613849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:38.614487 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:38.621314 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:38.621797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:38.622595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:38.623561 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:38.761659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:38.769308 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1e1e57b6-2227-4be2-9052-b6eff72c666e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.159397 Mar 26 21:44:38.769890 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3417/6564] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:38 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:39.786461 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:39.787197 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:39.794158 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:39.794626 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:39.795414 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:39.795863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:39.928440 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:39.936305 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0b42129-442f-41c3-92aa-d448079cdaac tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.153780 Mar 26 21:44:39.936886 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3148/6565] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:39 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:40.953602 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:40.954172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:40.960926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:40.961378 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:40.962153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:40.962605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:41.096503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:41.103762 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c553f7ba-d77a-48aa-9333-51b538feb144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.154647 Mar 26 21:44:41.104364 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3418/6566] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:40 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:42.119681 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4bc76221-b20b-44b0-aae1-1d75edaa13f1 req-8c650442-b32f-4843-bb2a-e9101f1bcdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae70161d-4d4a-4f05-8989-4386e64311e3", "name": "network-vif-plugged", "status": "completed", "tag": "7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:42.121082 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:42.121898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:42.129259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4bc76221-b20b-44b0-aae1-1d75edaa13f1 req-8c650442-b32f-4843-bb2a-e9101f1bcdc5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:42.129943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4bc76221-b20b-44b0-aae1-1d75edaa13f1 req-8c650442-b32f-4843-bb2a-e9101f1bcdc5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:42.130426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:42.131054 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:42.132266 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:42.132830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:42.142700 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4bc76221-b20b-44b0-aae1-1d75edaa13f1 req-8c650442-b32f-4843-bb2a-e9101f1bcdc5 service nova] Creating event network-vif-plugged:7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4 for instance ae70161d-4d4a-4f05-8989-4386e64311e3 on nch1-master-1 Mar 26 21:44:42.148219 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4bc76221-b20b-44b0-aae1-1d75edaa13f1 req-8c650442-b32f-4843-bb2a-e9101f1bcdc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032563 Mar 26 21:44:42.149060 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3149/6567] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:44:42.272556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:42.280645 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-72b22492-d991-4284-bb65-b1e8c7504322 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.164086 Mar 26 21:44:42.281398 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3419/6568] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:42 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:43.299043 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:43.299749 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:43.306402 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:43.306898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:43.307690 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:43.308160 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:43.450459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:43.457828 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-993756c9-314a-4e39-8675-c2552367ed40 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1392 microversion: 2.1 time: 0.164380 Mar 26 21:44:43.458412 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3150/6569] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:43 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:44.474803 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:44.475430 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:44.481850 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:44.482313 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:44.483084 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:44.483580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:44.621007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:44.629053 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-994cc060-9bab-4b40-88cc-00f6c16e6b22 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1565 microversion: 2.1 time: 0.158389 Mar 26 21:44:44.629637 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3420/6570] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:44 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:44.645400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:44.646009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:44.652728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:44.653182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:44.653943 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:44.654382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:44.790091 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:44.797961 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f64e8b28-ba91-43d1-9822-9b745c71ae92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1565 microversion: 2.1 time: 0.156452 Mar 26 21:44:44.798528 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3151/6571] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:44 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:44:46.480190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:44:46.481000 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:44:46.482275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-e9fd16c3-478e-43a2-a47a-f24572a64205 req-56165ee2-d951-49bd-9b64-997438d1eec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae70161d-4d4a-4f05-8989-4386e64311e3", "tag": "7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:44:46.489348 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:46.490279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:46.491096 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:46.491772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:46.492759 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e9fd16c3-478e-43a2-a47a-f24572a64205 req-56165ee2-d951-49bd-9b64-997438d1eec8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:44:46.493291 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-e9fd16c3-478e-43a2-a47a-f24572a64205 req-56165ee2-d951-49bd-9b64-997438d1eec8 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:44:46.510121 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-e9fd16c3-478e-43a2-a47a-f24572a64205 req-56165ee2-d951-49bd-9b64-997438d1eec8 service nova] Creating event network-changed:7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4 for instance ae70161d-4d4a-4f05-8989-4386e64311e3 on nch1-master-1 Mar 26 21:44:46.516449 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-e9fd16c3-478e-43a2-a47a-f24572a64205 req-56165ee2-d951-49bd-9b64-997438d1eec8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Mar 26 21:44:46.517470 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3152/6572] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:44:46.635484 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:44:46.644857 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-78c9ca1e-3c4c-46e6-83d1-3d2868700a98 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1565 microversion: 2.1 time: 0.169134 Mar 26 21:44:46.645765 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3421/6573] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:44:46 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:09.899057 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:45:09.900092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:09.906872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:09.907333 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:09.908267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:09.908725 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:09.958458 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2b9b31c5-5d17-4262-acd8-35593c7097f3 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action" status: 200 len: 24567 microversion: 2.1 time: 0.064550 Mar 26 21:45:09.959062 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3153/6574] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:45:09 2022] POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action => generated 24567 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:45:20.919766 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0b2d79c7-0834-4847-9f22-936b3a1a319b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:45:20.926261 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-0834-4847-9f22-936b3a1a319b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:20.926724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0b2d79c7-0834-4847-9f22-936b3a1a319b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:20.947316 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0b2d79c7-0834-4847-9f22-936b3a1a319b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Going to try to stop instance {{(pid=141581) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 26 21:45:20.987901 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0b2d79c7-0834-4847-9f22-936b3a1a319b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action" status: 202 len: 0 microversion: 2.1 time: 0.072027 Mar 26 21:45:20.988613 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3422/6575] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:45:20 2022] POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:45:20.997224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:20.997931 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:21.006092 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:21.006684 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:21.007493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:21.007950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:21.153182 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:21.160553 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-456d50f3-3cc0-46d0-a1cc-bc60f6491144 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.167534 Mar 26 21:45:21.161119 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3154/6576] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:20 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:22.179725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:22.180475 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:22.186739 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:22.187218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:22.188033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:22.188497 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:22.325209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:22.333155 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-445cef95-1269-4f3b-9937-feee75ebbed0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.158961 Mar 26 21:45:22.333733 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3423/6577] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:22 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:23.350486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:23.351101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:23.357847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:23.358304 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:23.359068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:23.359512 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:23.492596 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:23.499887 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fc1eba8e-c981-41e2-a83c-980afb6eb2b2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.153297 Mar 26 21:45:23.500472 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3155/6578] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:23 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:45:24.517205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:24.517867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:24.524328 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:24.524796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:24.525570 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:24.526025 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:24.657275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:24.664698 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2b9337e-eb47-475e-84bf-2e462436befd tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.151597 Mar 26 21:45:24.665262 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3424/6579] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:24 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:25.682384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:25.683003 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:25.690310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:25.690793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:25.691557 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:25.692023 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:25.823146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:25.833220 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e757ba14-556b-4733-87bd-eabc5c865167 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.154400 Mar 26 21:45:25.834228 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3156/6580] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:25 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:26.851338 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:26.851997 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:26.858746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:26.859218 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:26.860030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:26.860491 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:26.997858 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:27.005884 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-035b3c80-b7a1-4057-8030-a5736d1cce92 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.158607 Mar 26 21:45:27.006474 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3425/6581] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:26 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:28.022172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:28.022940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:28.029726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:28.030192 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:28.030974 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:28.031430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:28.168545 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:28.176265 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1cf17f08-13df-4a42-97d4-4ec1e3cd4c08 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.157714 Mar 26 21:45:28.176847 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3157/6582] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:28 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:29.193920 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:29.194465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:29.201276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:29.201753 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:29.202550 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:29.203011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:29.384139 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:29.391605 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2e9185f1-74cf-403a-9644-8bf3ce405143 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.202267 Mar 26 21:45:29.392239 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3426/6583] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:29 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:30.410084 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:30.410711 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:30.417788 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:30.418251 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:30.419070 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:30.419523 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:30.600061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:30.607476 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-da5b58e2-887e-4aa7-a563-1884d3302a67 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1694 microversion: 2.1 time: 0.201957 Mar 26 21:45:30.608084 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3158/6584] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:30 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:31.624652 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:31.625277 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:31.632500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:31.633003 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:31.633796 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:31.634255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:31.767321 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:31.774703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-8d5ec4c7-288b-4b59-8239-b8be09e9a92b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1671 microversion: 2.1 time: 0.153979 Mar 26 21:45:31.775277 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3427/6585] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:31 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:32.870407 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:45:32.871322 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:32.877359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:32.878484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:32.879259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:32.879706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:32.933598 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f177556f-b430-4c8f-bb43-ac5950d87b8c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action" status: 200 len: 37737 microversion: 2.1 time: 0.067853 Mar 26 21:45:32.934575 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3159/6586] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:45:32 2022] POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action => generated 37737 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:45:32.945906 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4f23d35d-af35-4753-b6b0-b1dd1efaa567 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:45:32.952811 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f23d35d-af35-4753-b6b0-b1dd1efaa567 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:32.953287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4f23d35d-af35-4753-b6b0-b1dd1efaa567 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:32.974407 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4f23d35d-af35-4753-b6b0-b1dd1efaa567 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Going to try to start instance {{(pid=141581) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 26 21:45:33.016129 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4f23d35d-af35-4753-b6b0-b1dd1efaa567 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action" status: 202 len: 0 microversion: 2.1 time: 0.073943 Mar 26 21:45:33.016749 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3428/6587] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:45:32 2022] POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:45:33.026779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:33.027484 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:33.034446 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:33.035002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:33.035750 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:33.036219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:33.241026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:33.248543 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0d9db8a-0355-4e68-9123-07dd592a0257 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1680 microversion: 2.1 time: 0.227248 Mar 26 21:45:33.249115 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3160/6588] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:33 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:45:34.267354 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:45:34.268160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:45:34.274409 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:34.274834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:34.275656 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:45:34.276161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:45:34.407064 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:45:34.414636 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b3c3744d-fcf2-4faa-abcb-70538ac31a5c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1684 microversion: 2.1 time: 0.152417 Mar 26 21:45:34.415220 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3429/6589] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:45:34 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:00.614823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:00.615686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:00.622258 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:00.622716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:00.623483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:00.623937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:00.685311 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fbfad27b-1b79-4c67-b3eb-bae70da268be tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action" status: 200 len: 62299 microversion: 2.1 time: 0.074414 Mar 26 21:46:00.685952 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3161/6590] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:46:00 2022] POST /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3/action => generated 62299 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:46:08.124198 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:08.124841 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:08.131842 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:08.132365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:08.133134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:08.133772 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:08.159934 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:46:08.194316 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-81b68897-a918-47dd-9dba-2bc71e1f7116 req-ca89257f-bb38-4017-9f17-a143fb134502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae70161d-4d4a-4f05-8989-4386e64311e3", "tag": "7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:08.205554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-81b68897-a918-47dd-9dba-2bc71e1f7116 req-ca89257f-bb38-4017-9f17-a143fb134502 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:08.206011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-81b68897-a918-47dd-9dba-2bc71e1f7116 req-ca89257f-bb38-4017-9f17-a143fb134502 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:08.216908 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-81b68897-a918-47dd-9dba-2bc71e1f7116 req-ca89257f-bb38-4017-9f17-a143fb134502 service nova] Creating event network-changed:7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4 for instance ae70161d-4d4a-4f05-8989-4386e64311e3 on nch1-master-1 Mar 26 21:46:08.224023 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-81b68897-a918-47dd-9dba-2bc71e1f7116 req-ca89257f-bb38-4017-9f17-a143fb134502 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101199 Mar 26 21:46:08.224939 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3162/6591] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:46:08.249292 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-23dd3737-3bce-4333-9183-8db70f7e69a9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 204 len: 0 microversion: 2.1 time: 0.128636 Mar 26 21:46:08.252001 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3430/6592] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:46:08 2022] DELETE /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:46:08.267636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:08.268459 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:08.276582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:08.277048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:08.277965 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:08.278418 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:08.556848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:08.565074 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bee8104c-700f-48ab-b9e5-ee5c6148efd0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1690 microversion: 2.1 time: 0.308293 Mar 26 21:46:08.565961 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3163/6593] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:08 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1690 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:09.582349 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:09.583066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:09.589940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:09.590412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:09.591201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:09.591661 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:09.725228 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:09.732615 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2aac8dd2-29e2-4ba6-9156-29e7568ff7a4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1571 microversion: 2.1 time: 0.154565 Mar 26 21:46:09.733187 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3431/6594] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:09 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:10.491118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d4707773-6eb9-45f2-a2a8-b174f3dca8c0 req-9af72559-761e-41e3-a611-dcec045e8a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae70161d-4d4a-4f05-8989-4386e64311e3", "name": "network-vif-deleted", "tag": "7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:10.500548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d4707773-6eb9-45f2-a2a8-b174f3dca8c0 req-9af72559-761e-41e3-a611-dcec045e8a0e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:10.501006 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d4707773-6eb9-45f2-a2a8-b174f3dca8c0 req-9af72559-761e-41e3-a611-dcec045e8a0e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:10.513313 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d4707773-6eb9-45f2-a2a8-b174f3dca8c0 req-9af72559-761e-41e3-a611-dcec045e8a0e service nova] Creating event network-vif-deleted:7a14f006-13f4-4444-8ba5-9b6ef1a8a1e4 for instance ae70161d-4d4a-4f05-8989-4386e64311e3 on nch1-master-1 Mar 26 21:46:10.519223 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d4707773-6eb9-45f2-a2a8-b174f3dca8c0 req-9af72559-761e-41e3-a611-dcec045e8a0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031790 Mar 26 21:46:10.519895 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3164/6595] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:46:10.749391 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:10.750048 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:10.757508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:10.757984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:10.758789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:10.759254 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:10.791029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:10.791505 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:10.792011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lazy-loading 'fault' on Instance uuid ae70161d-4d4a-4f05-8989-4386e64311e3 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:46:10.837285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:10.845342 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-17665acb-c32d-4074-b26b-28d573c12c68 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 200 len: 1356 microversion: 2.1 time: 0.099718 Mar 26 21:46:10.845933 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3432/6596] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:10 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:11.863786 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:11.864518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: ae70161d-4d4a-4f05-8989-4386e64311e3] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:11.870710 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:11.871163 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:11.871937 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:11.872390 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:11.885349 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] HTTP exception thrown: Instance ae70161d-4d4a-4f05-8989-4386e64311e3 could not be found. Mar 26 21:46:11.885930 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Returning 404 to user: Instance ae70161d-4d4a-4f05-8989-4386e64311e3 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:46:11.886735 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f2a38917-4332-4c17-9425-24b0dea85648 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3" status: 404 len: 111 microversion: 2.1 time: 0.028087 Mar 26 21:46:11.887253 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3165/6597] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:11 2022] GET /compute/v2.1/servers/ae70161d-4d4a-4f05-8989-4386e64311e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:46:14.962939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db0958ce-e120-421a-9d22-9f43aa13b38c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '.version_select at 0x7f6e4856f790>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:14.985422 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db0958ce-e120-421a-9d22-9f43aa13b38c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537052790" status: 202 len: 0 microversion: 2.1 time: 0.027324 Mar 26 21:46:14.986230 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3433/6598] 10.222.0.16 () {58 vars in 1280 bytes} [Sat Mar 26 21:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537052790 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:46:15.015861 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: .version_select at 0x7f6e58598dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1867250552"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:15.032213 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:46:15.037384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:46:15.245235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:46:15.250531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:46:15.266732 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4a805b42-e774-4dbf-b32d-dfa54679d356 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.254789 Mar 26 21:46:15.269139 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3166/6599] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:46:15 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:21.049593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-622314460", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "networks": [{"uuid": "6dd4df8e-946d-4430-a38f-980c52504e1a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1867250552", "security_groups": [{"name": "tempest-secgroup-smoke-1726060079"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:21.172214 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] validate_networks() for [('6dd4df8e-946d-4430-a38f-980c52504e1a', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:46:21.757775 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:46:21.758665 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:46:21.759189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:46:21.759627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:46:21.760411 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:46:21.772276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:21.773370 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:21.775088 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:21.775942 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:21.807749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:46:21.816814 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Getting quotas for user aed79c52100946f2aa1052b012f8aa3c and project 01928d3d430a4ee085f0f02b34539ca4. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:46:21.833682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:46:21.836222 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:46:21.897223 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-383a9b06-deab-426b-8a76-9806b192a83d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852412 Mar 26 21:46:21.897878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3434/6600] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:46:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:46:21.909121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e191bdd2-3e82-42ca-b2ae-6852fe30b320 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:21.909743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e191bdd2-3e82-42ca-b2ae-6852fe30b320 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:21.993691 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e191bdd2-3e82-42ca-b2ae-6852fe30b320 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:22.004822 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e191bdd2-3e82-42ca-b2ae-6852fe30b320 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1266 microversion: 2.1 time: 0.100678 Mar 26 21:46:22.005427 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3167/6601] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:21 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:46:23.029174 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:23.029830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:23.042282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:23.043005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:23.044042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:23.044832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:23.134020 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:23.151087 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2151cc3e-fa70-4ccc-8868-6c2f84deb6f2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1326 microversion: 2.1 time: 0.132527 Mar 26 21:46:23.152001 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3435/6602] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:23 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:24.168865 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:24.169636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:24.177792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:24.178238 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:24.179028 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:24.179476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:24.410058 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:24.417510 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7d17068f-b34a-49e3-9dad-a9ec7aafb101 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.252670 Mar 26 21:46:24.418132 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3168/6603] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:24 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:24.518595 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-3292fc9b-20a1-48fa-8b19-679377138b81 req-5f9a1844-06a7-4670-a4ee-5388290e0af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb56db9-21df-4c24-adb7-6c135ea5365d", "tag": "ea6d5e75-614e-40be-9d38-1eb58add1727"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:24.527957 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3292fc9b-20a1-48fa-8b19-679377138b81 req-5f9a1844-06a7-4670-a4ee-5388290e0af5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:24.528745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-3292fc9b-20a1-48fa-8b19-679377138b81 req-5f9a1844-06a7-4670-a4ee-5388290e0af5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:24.540565 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-3292fc9b-20a1-48fa-8b19-679377138b81 req-5f9a1844-06a7-4670-a4ee-5388290e0af5 service nova] Creating event network-changed:ea6d5e75-614e-40be-9d38-1eb58add1727 for instance abb56db9-21df-4c24-adb7-6c135ea5365d on nch2-master-1 Mar 26 21:46:24.549258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-3292fc9b-20a1-48fa-8b19-679377138b81 req-5f9a1844-06a7-4670-a4ee-5388290e0af5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033967 Mar 26 21:46:24.549885 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3436/6604] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:46:25.434593 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:25.435224 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:25.442582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:25.443042 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:25.443825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:25.444305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:25.580582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:25.588082 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-2d36106a-2d42-474a-9344-5826b270a79e tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.157300 Mar 26 21:46:25.588674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3169/6605] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:25 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:26.606341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:26.607068 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:26.613456 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:26.613931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:26.614726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:26.615185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:26.749610 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:26.757083 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a212dc01-e904-4ecb-8ca7-47d2a04f1f3a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.155876 Mar 26 21:46:26.757655 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3437/6606] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:26 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:27.774008 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:27.774585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:27.780956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:27.781411 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:27.782880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:27.783319 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:27.922821 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:27.931180 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d97ef0dc-eab2-4007-9183-b8ca79b2c235 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.161362 Mar 26 21:46:27.931762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3170/6607] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:27 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:28.947014 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:28.947637 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:28.955004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:28.955611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:28.956485 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:28.957051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:29.093542 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:29.100911 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-da4ae014-52f8-468b-b732-402692867154 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.157813 Mar 26 21:46:29.101497 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3438/6608] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:28 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:29.609700 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4cb99c35-721b-4710-9a7f-16a01c9d0650 req-1fc0825e-caf0-4022-bd07-f886d4d12d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb56db9-21df-4c24-adb7-6c135ea5365d", "name": "network-vif-plugged", "status": "completed", "tag": "ea6d5e75-614e-40be-9d38-1eb58add1727"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:29.618591 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4cb99c35-721b-4710-9a7f-16a01c9d0650 req-1fc0825e-caf0-4022-bd07-f886d4d12d0f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:29.619051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4cb99c35-721b-4710-9a7f-16a01c9d0650 req-1fc0825e-caf0-4022-bd07-f886d4d12d0f service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:29.630402 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4cb99c35-721b-4710-9a7f-16a01c9d0650 req-1fc0825e-caf0-4022-bd07-f886d4d12d0f service nova] Creating event network-vif-plugged:ea6d5e75-614e-40be-9d38-1eb58add1727 for instance abb56db9-21df-4c24-adb7-6c135ea5365d on nch2-master-1 Mar 26 21:46:29.635353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4cb99c35-721b-4710-9a7f-16a01c9d0650 req-1fc0825e-caf0-4022-bd07-f886d4d12d0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029480 Mar 26 21:46:29.635979 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3171/6609] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:46:30.117712 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:30.118350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:30.125176 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:30.125654 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:30.126449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:30.127437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:30.265877 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:30.274005 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5affca7a-b618-48ff-9558-3cd1da8941e2 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1392 microversion: 2.1 time: 0.160144 Mar 26 21:46:30.274524 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3439/6610] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:30 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:31.291554 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:31.292229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:31.298671 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:31.299123 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:31.299890 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:31.300355 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:31.437465 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:31.445227 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e91c7037-cab8-48d3-90d5-0978337af773 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1564 microversion: 2.1 time: 0.158849 Mar 26 21:46:31.445797 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3172/6611] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:31 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:31.461545 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:31.462234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:31.468977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:31.469446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:31.470233 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:31.470693 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:31.606488 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:31.613978 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bbc76266-ba46-4f59-84da-2aad4c405204 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1564 microversion: 2.1 time: 0.156268 Mar 26 21:46:31.614557 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3440/6612] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:31 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:33.250211 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:46:33.250825 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:33.258359 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:33.258967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:33.259616 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-af81eb16-b4f7-449c-b18a-3ea9b2a0193f req-a4d34b68-e8b3-45c2-9c74-041cc2d1cfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb56db9-21df-4c24-adb7-6c135ea5365d", "tag": "ea6d5e75-614e-40be-9d38-1eb58add1727"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:33.260133 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:33.260525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:33.269852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-af81eb16-b4f7-449c-b18a-3ea9b2a0193f req-a4d34b68-e8b3-45c2-9c74-041cc2d1cfac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:33.270309 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-af81eb16-b4f7-449c-b18a-3ea9b2a0193f req-a4d34b68-e8b3-45c2-9c74-041cc2d1cfac service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:33.282030 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-af81eb16-b4f7-449c-b18a-3ea9b2a0193f req-a4d34b68-e8b3-45c2-9c74-041cc2d1cfac service nova] Creating event network-changed:ea6d5e75-614e-40be-9d38-1eb58add1727 for instance abb56db9-21df-4c24-adb7-6c135ea5365d on nch2-master-1 Mar 26 21:46:33.287607 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-af81eb16-b4f7-449c-b18a-3ea9b2a0193f req-a4d34b68-e8b3-45c2-9c74-041cc2d1cfac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031515 Mar 26 21:46:33.288545 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3441/6613] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:46:33.496870 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:46:33.506601 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0d07c319-0b1c-43d8-8987-0e77b05c29b4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1564 microversion: 2.1 time: 0.260401 Mar 26 21:46:33.515893 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3173/6614] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:46:33 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1564 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:46:56.752786 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:46:56.753812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:46:56.760383 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:56.760862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:56.761648 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:46:56.762109 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:46:56.809256 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45916863-a5cb-4ca4-ab90-dbd79a996f27 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action" status: 200 len: 24569 microversion: 2.1 time: 0.060769 Mar 26 21:46:56.809878 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3442/6615] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:46:56 2022] POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action => generated 24569 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:47:03.192823 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:03.193400 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:03.199469 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:03.199944 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:03.200734 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:03.201180 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:03.223310 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lazy-loading 'flavor' on Instance uuid abb56db9-21df-4c24-adb7-6c135ea5365d {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:47:03.288719 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88fe3e06-ef9d-4fa6-aa49-ba6f85c7524f tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action" status: 202 len: 0 microversion: 2.1 time: 0.099893 Mar 26 21:47:03.292369 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3174/6616] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:47:03 2022] POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:47:03.298213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:03.298921 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:03.308413 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:03.308917 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:03.309706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:03.310163 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:03.501421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:03.509641 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35a2fbcd-381c-4295-9874-85c7a3cec808 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1691 microversion: 2.1 time: 0.215739 Mar 26 21:47:03.510207 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3443/6617] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:03 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:47:04.528148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:04.528863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:04.535098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:04.535563 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:04.536372 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:04.536829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:04.707510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:04.714943 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c029b31c-1869-4eac-b154-88eac690964b tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1674 microversion: 2.1 time: 0.192073 Mar 26 21:47:04.715524 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3175/6618] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:04 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:05.806384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:05.807320 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:05.814914 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.815396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:05.816209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.816673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:05.863736 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9dbbf673-d387-4fa0-8d50-f2200a93b9c9 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action" status: 200 len: 35742 microversion: 2.1 time: 0.061184 Mar 26 21:47:05.864660 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3444/6619] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:47:05 2022] POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action => generated 35742 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:47:05.875320 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:05.875838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:05.883044 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.883494 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:05.884283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.884720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:05.946733 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-971470de-b2b9-400d-8725-9d3907c3a44a tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action" status: 202 len: 0 microversion: 2.1 time: 0.075155 Mar 26 21:47:05.947382 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3176/6620] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:47:05 2022] POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:47:05.956886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:05.957604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:05.965607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.966205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:05.967017 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:05.967486 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:06.106438 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:06.114013 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6d0f17ed-ae2f-40b5-8365-097ada0dd03c tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1680 microversion: 2.1 time: 0.162184 Mar 26 21:47:06.114591 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3445/6621] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:05 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:07.133559 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:07.134259 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:07.141239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:07.141732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:07.142604 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:07.143127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:07.280496 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:07.287957 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f477a6ac-6524-41a1-8ed2-69a7fdf72945 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1680 microversion: 2.1 time: 0.159578 Mar 26 21:47:07.288539 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3177/6622] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:07 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:08.305040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:08.305592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:08.312502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:08.312973 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:08.313763 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:08.314257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:08.450873 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:08.459048 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6a6f314e-24b2-41a9-a52d-1d10de67c308 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1683 microversion: 2.1 time: 0.158106 Mar 26 21:47:08.459626 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3446/6623] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:08 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:08.554793 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:08.555779 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:08.562600 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:08.563067 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:08.563847 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:08.564382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:08.602727 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e1d3424d-72a1-4bef-9d4c-cda2d68ba57d tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action" status: 200 len: 35742 microversion: 2.1 time: 0.052030 Mar 26 21:47:08.603601 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3178/6624] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:47:08 2022] POST /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d/action => generated 35742 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 26 21:47:10.018502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:10.019715 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:10.024595 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-742029d6-1c65-46af-9a1e-1b9d64c6c72d req-08177e8a-311b-4705-a043-20e4c3d9902e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb56db9-21df-4c24-adb7-6c135ea5365d", "tag": "ea6d5e75-614e-40be-9d38-1eb58add1727"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:10.028365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:10.029047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:10.030039 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:10.030500 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:10.033520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-742029d6-1c65-46af-9a1e-1b9d64c6c72d req-08177e8a-311b-4705-a043-20e4c3d9902e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:10.034048 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-742029d6-1c65-46af-9a1e-1b9d64c6c72d req-08177e8a-311b-4705-a043-20e4c3d9902e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:10.044927 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-742029d6-1c65-46af-9a1e-1b9d64c6c72d req-08177e8a-311b-4705-a043-20e4c3d9902e service nova] Creating event network-changed:ea6d5e75-614e-40be-9d38-1eb58add1727 for instance abb56db9-21df-4c24-adb7-6c135ea5365d on nch2-master-1 Mar 26 21:47:10.050912 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-742029d6-1c65-46af-9a1e-1b9d64c6c72d req-08177e8a-311b-4705-a043-20e4c3d9902e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Mar 26 21:47:10.051947 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3179/6625] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:47:10.058310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:47:10.146089 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e7ab2fa3-29ec-4bf8-88a6-cd2d6dca0625 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 204 len: 0 microversion: 2.1 time: 0.131403 Mar 26 21:47:10.147289 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3447/6626] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:47:10 2022] DELETE /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:47:10.156223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:10.156961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:10.163957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:10.164662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:10.165187 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:10.165634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:10.473877 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:10.482346 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c1ca6a00-c785-4b81-805f-99a04c1c45c0 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1689 microversion: 2.1 time: 0.330430 Mar 26 21:47:10.482942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3180/6627] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:10 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1689 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:47:11.501377 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:11.502021 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:11.509599 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:11.510069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:11.510863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:11.511323 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:11.726968 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aed79c52100946f2aa1052b012f8aa3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01928d3d430a4ee085f0f02b34539ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:11.734592 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7d8f6a4-9830-4240-8799-f72097cebff7 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 200 len: 1570 microversion: 2.1 time: 0.237603 Mar 26 21:47:11.735183 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3448/6628] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:11 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:12.194808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4ed8675f-334f-48ca-82c5-43e37669cf4a req-bf965f2f-a66b-45d7-be5b-c5abf4916e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb56db9-21df-4c24-adb7-6c135ea5365d", "name": "network-vif-deleted", "tag": "ea6d5e75-614e-40be-9d38-1eb58add1727"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:12.206239 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4ed8675f-334f-48ca-82c5-43e37669cf4a req-bf965f2f-a66b-45d7-be5b-c5abf4916e48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:12.206701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4ed8675f-334f-48ca-82c5-43e37669cf4a req-bf965f2f-a66b-45d7-be5b-c5abf4916e48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:12.218662 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4ed8675f-334f-48ca-82c5-43e37669cf4a req-bf965f2f-a66b-45d7-be5b-c5abf4916e48 service nova] Creating event network-vif-deleted:ea6d5e75-614e-40be-9d38-1eb58add1727 for instance abb56db9-21df-4c24-adb7-6c135ea5365d on nch2-master-1 Mar 26 21:47:12.230450 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4ed8675f-334f-48ca-82c5-43e37669cf4a req-bf965f2f-a66b-45d7-be5b-c5abf4916e48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 Mar 26 21:47:12.231065 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3181/6629] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:47:12.752953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:12.753529 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] [instance: abb56db9-21df-4c24-adb7-6c135ea5365d] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:12.759832 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:12.760335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:12.761114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:12.761565 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:12.775007 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] HTTP exception thrown: Instance abb56db9-21df-4c24-adb7-6c135ea5365d could not be found. Mar 26 21:47:12.775601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Returning 404 to user: Instance abb56db9-21df-4c24-adb7-6c135ea5365d could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:47:12.776464 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d4ea4156-80c1-41c9-a163-222bf56d1763 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d" status: 404 len: 111 microversion: 2.1 time: 0.028227 Mar 26 21:47:12.776990 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3449/6630] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:12 2022] GET /compute/v2.1/servers/abb56db9-21df-4c24-adb7-6c135ea5365d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:47:16.160614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fdf2b0c3-fd19-44ff-9b68-9eeed4cfd1f4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] Calling method '.version_select at 0x7f6e588c0790>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:16.179865 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fdf2b0c3-fd19-44ff-9b68-9eeed4cfd1f4 tempest-TestNetworkAdvancedServerOps-963757299 tempest-TestNetworkAdvancedServerOps-963757299-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1867250552" status: 202 len: 0 microversion: 2.1 time: 0.024910 Mar 26 21:47:16.180722 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3182/6631] 10.222.0.16 () {58 vars in 1283 bytes} [Sat Mar 26 21:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1867250552 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:47:25.344815 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:47:25.345790 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:47:27.677931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'create', calling method: .version_select at 0x7f6e4bdabb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2036471939"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:27.696184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:47:27.706397 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:47:28.081972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:47:28.087073 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:47:28.101938 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c502424c-c757-4335-bcd6-6e682e66f9f3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.608019 Mar 26 21:47:28.102552 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3450/6632] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:47:27 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:29.035859 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2985358", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2036471939", "security_groups": [{"name": "tempest-secgroup-smoke-1221408534"}], "networks": [{"uuid": "41a18bfe-8e8c-4ee1-9eee-56dd5a6da0f1"}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:29.146138 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] validate_networks() for [('41a18bfe-8e8c-4ee1-9eee-56dd5a6da0f1', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:47:29.630223 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:47:29.630662 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:47:29.631298 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:47:29.631735 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:47:29.632227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:47:29.640993 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:29.641492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:29.642832 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:29.643280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:29.664628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:47:29.670176 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:47:29.682902 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:47:29.685486 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:47:29.731945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4e542fe7-7571-4b79-a76b-9f92f9348a95 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701873 Mar 26 21:47:29.732885 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3183/6633] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:47:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:47:29.743777 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a4ff7669-07ab-4710-b600-0a7dbadddbc4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:29.745188 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a4ff7669-07ab-4710-b600-0a7dbadddbc4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:29.804310 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a4ff7669-07ab-4710-b600-0a7dbadddbc4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:29.812340 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a4ff7669-07ab-4710-b600-0a7dbadddbc4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1244 microversion: 2.1 time: 0.073193 Mar 26 21:47:29.814916 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3451/6634] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:29 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:47:30.830758 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:30.831375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:30.838137 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:30.838588 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:30.839368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:30.839816 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:30.906740 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:30.915799 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7546e780-9a83-43f5-97fb-6405ae0b6f5d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1296 microversion: 2.1 time: 0.089686 Mar 26 21:47:30.916454 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3184/6635] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:30 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:31.934945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:31.936764 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:31.945644 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:31.946346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:31.947257 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:31.948022 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:32.092117 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:32.099757 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7f3ad7ab-e953-4bd1-a24a-2958f17b7e7b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.169710 Mar 26 21:47:32.100357 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3452/6636] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:31 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:32.583378 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f12ca524-f4ad-477b-a94a-ffe1b2488c03 req-a875fb39-5826-4fca-9c0d-e4f89b9abc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:32.592056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f12ca524-f4ad-477b-a94a-ffe1b2488c03 req-a875fb39-5826-4fca-9c0d-e4f89b9abc70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:32.592508 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f12ca524-f4ad-477b-a94a-ffe1b2488c03 req-a875fb39-5826-4fca-9c0d-e4f89b9abc70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:32.607315 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f12ca524-f4ad-477b-a94a-ffe1b2488c03 req-a875fb39-5826-4fca-9c0d-e4f89b9abc70 service nova] Creating event network-changed:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch1-master-1 Mar 26 21:47:32.613117 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f12ca524-f4ad-477b-a94a-ffe1b2488c03 req-a875fb39-5826-4fca-9c0d-e4f89b9abc70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117696 Mar 26 21:47:32.613734 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3185/6637] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:47:33.116962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:33.117627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:33.124797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:33.125262 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:33.126055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:33.126530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:33.271030 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:33.278754 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c476eb56-a12d-4c7f-9e2a-d465a63607a8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.165756 Mar 26 21:47:33.279673 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3453/6638] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:33 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:34.297497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:34.298188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:34.305150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:34.305607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:34.306370 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:34.306808 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:34.444280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:34.451600 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-09d6e292-6c0c-44f7-951e-4bf2e9ddb9b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.159154 Mar 26 21:47:34.452203 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3186/6639] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:34 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:35.468272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:35.468899 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:35.475623 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:35.476205 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:35.476986 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:35.477437 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:35.612454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:35.619773 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d51930c9-3d11-4158-a4c4-138e0961d084 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.155451 Mar 26 21:47:35.620373 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3454/6640] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:35 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:36.637245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:36.637799 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:36.645184 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:36.645636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:36.646399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:36.646839 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:36.781207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:36.792693 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a1cd10b3-cb93-40ce-a764-43e8436e96bc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.159359 Mar 26 21:47:36.793674 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3187/6641] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:36 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:36.988208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-e183f4f4-f889-4ebd-a832-2843d309699f req-bbe8c15d-aa0c-444d-b9d9-ccbdc0e963f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "name": "network-vif-plugged", "status": "completed", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:36.996047 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e183f4f4-f889-4ebd-a832-2843d309699f req-bbe8c15d-aa0c-444d-b9d9-ccbdc0e963f5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:36.996509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-e183f4f4-f889-4ebd-a832-2843d309699f req-bbe8c15d-aa0c-444d-b9d9-ccbdc0e963f5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:37.007652 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-e183f4f4-f889-4ebd-a832-2843d309699f req-bbe8c15d-aa0c-444d-b9d9-ccbdc0e963f5 service nova] Creating event network-vif-plugged:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch1-master-1 Mar 26 21:47:37.012697 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-e183f4f4-f889-4ebd-a832-2843d309699f req-bbe8c15d-aa0c-444d-b9d9-ccbdc0e963f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077668 Mar 26 21:47:37.013286 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3455/6642] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:47:37.810148 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:37.810739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:37.817497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:37.817948 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:37.818714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:37.819149 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:37.955967 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:37.963251 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4fece774-3878-46f9-83ab-71bb0d42e235 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1370 microversion: 2.1 time: 0.157120 Mar 26 21:47:37.963826 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3188/6643] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:37 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:38.981726 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:38.982454 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:38.988727 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:38.989208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:38.989993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:38.990451 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:39.128388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:39.135751 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5c43749-8ff2-4cef-911c-4dd10e66cf9e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1554 microversion: 2.1 time: 0.159178 Mar 26 21:47:39.136348 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3456/6644] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:38 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:39.152580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:47:39.153193 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:47:39.159845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:39.160347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:39.161110 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:39.161550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:39.292315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:47:39.300343 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-78256d8c-bc5a-48f8-8dda-07174418391b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1554 microversion: 2.1 time: 0.150848 Mar 26 21:47:39.300918 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3189/6645] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:47:39 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:47:41.287494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-ec6890c3-d01d-4506-8e1d-97b6d8d8a9eb req-6f961941-68ad-4a53-9a54-93b446b8a9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:47:41.296420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec6890c3-d01d-4506-8e1d-97b6d8d8a9eb req-6f961941-68ad-4a53-9a54-93b446b8a9d7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:47:41.296902 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-ec6890c3-d01d-4506-8e1d-97b6d8d8a9eb req-6f961941-68ad-4a53-9a54-93b446b8a9d7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:47:41.308651 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-ec6890c3-d01d-4506-8e1d-97b6d8d8a9eb req-6f961941-68ad-4a53-9a54-93b446b8a9d7 service nova] Creating event network-changed:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch1-master-1 Mar 26 21:47:41.313613 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-ec6890c3-d01d-4506-8e1d-97b6d8d8a9eb req-6f961941-68ad-4a53-9a54-93b446b8a9d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030380 Mar 26 21:47:41.314412 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3457/6646] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:49:07.861428 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:49:07.862149 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:49:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:49:35.623475 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:49:35.624070 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:49:38.749453 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:49:38.753743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:49:38.754275 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:38.760376 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:38.760829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:38.761787 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:38.762541 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:38.793582 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lazy-loading 'flavor' on Instance uuid 77aa3255-a998-420b-b1f0-2d232eedcc2c {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:49:39.050730 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ad69fc90-ad8f-42a9-a0b9-d6e15acdc753 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.302917 Mar 26 21:49:39.054399 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3190/6647] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:49:38 2022] POST /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:49:39.058306 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 26 21:49:39.059126 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:49:39.063738 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:39.064580 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:39.079005 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:39.079474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:39.080319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:39.080783 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:39.230771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:39.238395 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e8529fbf-fdde-4e7e-be19-258f0ba65a65 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.182055 Mar 26 21:49:39.238963 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3458/6648] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:39 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:40.257913 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:40.258639 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:40.267870 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36566. Mar 26 21:49:40.269594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:40.270047 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:40.270810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:40.271249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:40.415723 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:40.423127 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-4b4dce14-82f5-47ee-bfbd-0d570abf8341 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.170980 Mar 26 21:49:40.423957 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3191/6649] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:40 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:41.441063 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:41.441680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:41.456282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:41.456751 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:41.457539 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:41.457989 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:41.458687 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36582. Mar 26 21:49:41.459402 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36584. Mar 26 21:49:41.600177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:41.607511 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a43d7562-c649-4f63-8bbd-74a3da0a549c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.170384 Mar 26 21:49:41.608108 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3459/6650] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:41 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:42.625629 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:42.626231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:42.633689 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:42.634144 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:42.634914 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:42.635354 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:42.767347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:42.775370 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8f32b215-7be0-4fcd-9ac8-223db2701349 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.154311 Mar 26 21:49:42.775957 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3192/6651] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:42 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:43.795523 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:43.796181 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:43.803052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:43.803513 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:43.804318 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:43.804771 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:43.940675 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:43.948582 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82559d77-8b96-47d3-804f-18f1a4b12d7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.157001 Mar 26 21:49:43.949160 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3460/6652] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:43 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:44.966128 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:44.966771 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:44.973587 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:44.974045 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:44.974817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:44.975263 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:45.112303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:45.120281 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f7b1f7dd-3d5c-4ff1-8d8d-b032ae7d85a0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.158136 Mar 26 21:49:45.120861 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3193/6653] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:44 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:46.137834 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:46.138499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:46.144918 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:46.145384 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:46.146164 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:46.146619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:46.287444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:46.294871 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f4f1e346-1fdd-4d83-a00c-e258952d4dbb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.160973 Mar 26 21:49:46.295715 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3461/6654] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:46 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:47.312953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:47.313499 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:47.320958 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:47.321422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:47.322203 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:47.322655 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:47.458737 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:47.466208 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-77ece8d8-faed-47a3-9d8b-e2856f71aa8e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.157218 Mar 26 21:49:47.466784 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3194/6655] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:47 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:48.482547 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:48.483179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:48.490060 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:48.490530 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:48.491319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:48.491776 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:48.626366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:48.634341 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9a7702a-9cea-4d79-84ec-c0ec0bfc5e75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.155749 Mar 26 21:49:48.634915 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3462/6656] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:48 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:49.651731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:49.652382 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:49.659152 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:49.659618 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:49.660430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:49.660881 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:49.798942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:49.806437 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e051e51f-001e-467c-976a-c29bd6fd9eaa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1700 microversion: 2.1 time: 0.158700 Mar 26 21:49:49.807012 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3195/6657] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:49 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:50.823695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:50.824350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:50.831042 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:50.831508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:50.832356 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:50.832808 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:50.965256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:50.972605 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-40dfcfae-6f63-4409-9c8c-64bdde31f29c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1700 microversion: 2.1 time: 0.152788 Mar 26 21:49:50.973211 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3463/6658] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:50 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:51.990677 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:51.991479 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:51.998386 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:51.998855 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:51.999640 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:52.000121 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:52.150338 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:52.158242 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-56a889b5-1642-4815-a12a-985418513ee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.171981 Mar 26 21:49:52.159065 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3196/6659] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:51 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:53.176285 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:53.176940 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:53.184649 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:53.185122 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:53.185948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:53.186402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:53.347464 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:53.361009 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f9439577-2694-4cb3-a116-61e4a6fad51b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.188802 Mar 26 21:49:53.361617 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3464/6660] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:53 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:53.478353 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ac38dec1-3838-4474-8a77-eef9eee457e2 req-d9885339-865b-4c5e-9db1-459c28dae904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "name": "network-vif-plugged", "status": "completed", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:49:53.495351 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac38dec1-3838-4474-8a77-eef9eee457e2 req-d9885339-865b-4c5e-9db1-459c28dae904 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:53.495810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ac38dec1-3838-4474-8a77-eef9eee457e2 req-d9885339-865b-4c5e-9db1-459c28dae904 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:53.512721 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ac38dec1-3838-4474-8a77-eef9eee457e2 req-d9885339-865b-4c5e-9db1-459c28dae904 service nova] Creating event network-vif-plugged:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch1-master-1 Mar 26 21:49:53.532740 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ac38dec1-3838-4474-8a77-eef9eee457e2 req-d9885339-865b-4c5e-9db1-459c28dae904 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057819 Mar 26 21:49:53.534138 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3197/6661] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:49:54.378664 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:54.380173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:54.388401 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:54.389190 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:54.390364 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:54.390890 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:54.542635 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:54.552726 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5d839c3a-5425-4b1b-b00e-752de7b07e6e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.176251 Mar 26 21:49:54.563189 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3465/6662] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:54 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:55.573268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:55.574722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:55.584488 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:55.585701 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:55.586699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:55.587277 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:55.747866 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:55.756855 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0913b962-fa5b-44b4-9a15-b74a8a1110b5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.189979 Mar 26 21:49:55.757370 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3198/6663] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:55 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:56.775018 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:56.776839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:56.783762 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:56.784282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:56.785085 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:56.785544 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:56.952081 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:56.961823 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4737acb3-01c6-4e0c-a94d-8593c241b7c3 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.191804 Mar 26 21:49:56.962602 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3466/6664] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:56 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:57.981115 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:57.982438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:57.990533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:57.991002 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:57.991791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:57.992309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:58.147408 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:58.158172 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53186e81-e973-4af1-ac0c-03629b61dd97 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.183151 Mar 26 21:49:58.158999 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3199/6665] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:57 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:49:59.177445 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:49:59.178559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:49:59.185893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:59.186752 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:59.187562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:49:59.188053 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:49:59.351477 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:49:59.359501 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-bed40d4c-c456-4a47-81d6-163b83daa1d6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.186369 Mar 26 21:49:59.360296 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3467/6666] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:49:59 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:00.377085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:00.377698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:00.385851 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:00.387201 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:00.388313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:00.389021 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:00.534429 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:00.545067 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-130764cc-9099-4a68-bed3-dafa67b36a2f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1695 microversion: 2.1 time: 0.172010 Mar 26 21:50:00.545814 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3200/6667] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:00 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:01.564007 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:01.564667 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:01.571869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:01.572367 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:01.573148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:01.573608 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:01.708647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:01.716040 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-45111ed9-3468-4428-9d1b-e57ba2fe134d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1677 microversion: 2.1 time: 0.156605 Mar 26 21:50:01.716614 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3468/6668] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:01 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:02.733562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:02.734167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:02.741082 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:02.742005 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:02.742829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:02.743364 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:02.881714 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:02.889549 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1a8404fc-c924-4c71-97ea-9bbce109f2d1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1677 microversion: 2.1 time: 0.159939 Mar 26 21:50:02.890130 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3201/6669] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:02 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:03.907604 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:03.908268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:03.914994 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:03.915465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:03.916281 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:03.916740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:04.062033 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:04.070972 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-74b30b63-fe7c-496f-86f1-f4ed0a367653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1677 microversion: 2.1 time: 0.167282 Mar 26 21:50:04.071566 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3469/6670] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:03 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:05.088140 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:05.088761 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:05.095510 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.096001 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.096783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.097235 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.235172 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:05.242583 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a18d29fb-2ced-4971-9560-56dabcc8f177 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1620 microversion: 2.1 time: 0.158503 Mar 26 21:50:05.243176 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3202/6671] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:05 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1620 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:05.259210 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:50:05.259807 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:05.266489 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.266960 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.267745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.268243 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.439609 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e5ec2387-e35d-4e27-a0c2-4306fd9dee23 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.184673 Mar 26 21:50:05.440270 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3470/6672] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:50:05 2022] POST /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:50:05.448963 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:05.449682 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:05.455880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.456375 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.457360 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.457986 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.463893 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-86151f75-2481-45bb-9c84-7c4dbfc707c2 req-1348073f-ba67-4759-9160-1063429d3eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "name": "network-vif-unplugged", "status": "completed", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:50:05.473939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86151f75-2481-45bb-9c84-7c4dbfc707c2 req-1348073f-ba67-4759-9160-1063429d3eea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:05.474270 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-86151f75-2481-45bb-9c84-7c4dbfc707c2 req-1348073f-ba67-4759-9160-1063429d3eea service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:05.488196 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.compute.server_external_events [req-86151f75-2481-45bb-9c84-7c4dbfc707c2 req-1348073f-ba67-4759-9160-1063429d3eea service nova] Unable to find a host for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c. Dropping event network-vif-unplugged {{(pid=141581) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 26 21:50:05.490218 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-86151f75-2481-45bb-9c84-7c4dbfc707c2 req-1348073f-ba67-4759-9160-1063429d3eea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030684 Mar 26 21:50:05.491365 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3471/6673] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 26 21:50:05.604696 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:05.611874 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c890ee6e-3297-4637-a980-4e97e930182b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1628 microversion: 2.1 time: 0.166793 Mar 26 21:50:05.612473 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3203/6674] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:05 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1628 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:06.630052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:06.630632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:06.637346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:06.637820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:06.638607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:06.639066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:06.781647 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:06.789808 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a2343bf1-f452-4351-89a3-a201d29838a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.163733 Mar 26 21:50:06.790394 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3472/6675] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:06 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:07.569309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-84b9d01d-cf19-4ea7-91e4-bbb5d5c5fe1a req-7993e738-5c10-4e8c-97f8-be7a05ca420c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:50:07.578636 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-84b9d01d-cf19-4ea7-91e4-bbb5d5c5fe1a req-7993e738-5c10-4e8c-97f8-be7a05ca420c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:07.579064 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-84b9d01d-cf19-4ea7-91e4-bbb5d5c5fe1a req-7993e738-5c10-4e8c-97f8-be7a05ca420c service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:07.592405 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-84b9d01d-cf19-4ea7-91e4-bbb5d5c5fe1a req-7993e738-5c10-4e8c-97f8-be7a05ca420c service nova] Creating event network-changed:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch2-master-1 Mar 26 21:50:07.597904 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-84b9d01d-cf19-4ea7-91e4-bbb5d5c5fe1a req-7993e738-5c10-4e8c-97f8-be7a05ca420c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033584 Mar 26 21:50:07.598994 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3204/6676] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:50:07.807035 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:07.807697 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:07.814394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:07.814878 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:07.815657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:07.816140 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:07.952426 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:07.959927 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-91b5013d-8081-4abe-a20e-a0273c160d75 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.157327 Mar 26 21:50:07.960723 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3473/6677] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:07 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:08.977598 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:08.978635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:08.986887 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:08.987729 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:08.988962 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:08.989635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:09.139309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:09.146713 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b6be92cd-8f37-4d49-bcac-20b8b8af6d0a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.173479 Mar 26 21:50:09.147282 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3205/6678] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:08 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:10.165990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:10.166794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:10.174879 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:10.175346 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:10.176179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:10.176645 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:10.325161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:10.333443 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4438be5f-8a6f-4230-b02e-5ca1013e57fa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.172816 Mar 26 21:50:10.334340 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3474/6679] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:10 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:11.351019 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:11.351648 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:11.358159 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:11.358622 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:11.359403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:11.359942 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:11.523483 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:11.531682 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-faf6cb8b-892d-46d2-ac42-2bf9c67bfe93 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.184839 Mar 26 21:50:11.532321 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3206/6680] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:11 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:12.548755 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:12.550245 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:12.557092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:12.557926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:12.559004 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:12.559701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:12.722317 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:12.730467 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b8a957b0-8995-4b41-9400-fad68e13a932 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.186262 Mar 26 21:50:12.731047 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3475/6681] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:12 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:13.746783 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:13.748460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:13.756441 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:13.757260 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:13.758398 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:13.758895 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:13.918699 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:13.926952 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6f12dfa9-a8a4-4285-87da-5b0b794649e2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.184191 Mar 26 21:50:13.927974 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3207/6682] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:13 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:14.943633 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:14.944386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:14.951343 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:14.951818 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:14.952668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:14.953119 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:15.104862 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:15.112647 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-ff16fea5-64af-47f7-a42e-eaf7396571dd tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.172978 Mar 26 21:50:15.113241 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3476/6683] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:14 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:16.129909 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:16.130471 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:16.137940 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:16.138403 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:16.139183 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:16.139632 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:16.278350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:16.285746 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76e715f9-bed8-4bdb-8f31-78914c58b2b1 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.159916 Mar 26 21:50:16.286323 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3208/6684] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:16 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:17.304173 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:17.304757 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:17.311386 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:17.311849 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:17.312682 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:17.313134 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:17.449627 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:17.456946 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b9af521d-9dae-4980-be5f-9a37f6ab0f5b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.157245 Mar 26 21:50:17.457521 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3477/6685] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:17 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:18.474078 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:18.474791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:18.481401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:18.481848 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:18.482608 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:18.483046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:18.616777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:18.624007 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-8c55d704-c78f-4c4b-b8df-06579db9163b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.153786 Mar 26 21:50:18.624576 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3209/6686] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:18 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:19.641428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:19.642052 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:19.649382 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:19.649845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:19.650619 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:19.651072 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:19.784066 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:19.792139 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-2b6f1f1d-006a-4695-b9d3-385eb9ed4da2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.154581 Mar 26 21:50:19.792719 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3478/6687] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:19 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:20.810249 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:20.811516 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:20.821594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:20.822313 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:20.823065 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:20.824120 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:20.863622 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "name": "network-vif-plugged", "status": "completed", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:50:20.876976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:20.877442 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:20.892023 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] Creating event network-vif-plugged:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch2-master-1 Mar 26 21:50:20.895693 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] [ef9909e3-57ea-4e92-963a-c3aee50e7857] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:50:20.981579 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:20.989211 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-15a4428b-9f53-421f-891a-c375e890e65d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.183024 Mar 26 21:50:20.989815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3210/6688] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:20 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:21.902205 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] [ef9909e3-57ea-4e92-963a-c3aee50e7857] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36808. Mar 26 21:50:21.905769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-2be4d24c-5760-4344-843d-4ca9004f6067 req-80fdc069-0401-4381-becd-cbc77db89032 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.047744 Mar 26 21:50:21.906376 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3479/6689] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:50:22.007862 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:22.008520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:22.015548 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:22.016053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:22.016845 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:22.017296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:22.194093 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:22.201566 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-76bfd958-cfee-45f9-9242-b3d6aad1dee6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.198731 Mar 26 21:50:22.202143 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3211/6690] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:22 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:23.219767 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:23.220670 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:23.227191 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:23.227657 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:23.228559 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:23.229016 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:23.377172 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:23.385938 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db9a1e2f-3e96-4d7c-8861-3de003c9d716 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1686 microversion: 2.1 time: 0.171036 Mar 26 21:50:23.387225 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3480/6691] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:23 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:50:24.403287 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:50:24.403872 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:50:24.410574 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:24.411035 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:24.412422 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:50:24.412873 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:50:24.548827 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:50:24.556133 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bed5867c-ea77-4712-9598-3cf13ae170bb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1673 microversion: 2.1 time: 0.156803 Mar 26 21:50:24.556709 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3212/6692] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:50:24 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:50:45.354970 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:50:45.355635 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:50:46.628426 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:50:46.629105 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:51:37.477830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:37.478399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:37.486959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:37.487366 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:37.488659 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:37.489126 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:37.518617 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:51:37.570597 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-a08badaa-ee6a-4218-8e95-fbaf88faf887 req-177c32ba-01a9-45d5-aa3a-41ad21f0edff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:37.578863 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a08badaa-ee6a-4218-8e95-fbaf88faf887 req-177c32ba-01a9-45d5-aa3a-41ad21f0edff service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:37.579308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-a08badaa-ee6a-4218-8e95-fbaf88faf887 req-177c32ba-01a9-45d5-aa3a-41ad21f0edff service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:37.598916 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-a08badaa-ee6a-4218-8e95-fbaf88faf887 req-177c32ba-01a9-45d5-aa3a-41ad21f0edff service nova] Creating event network-changed:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch2-master-1 Mar 26 21:51:37.600576 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-52535afb-6759-47f1-9d26-82109a6d07a7 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 204 len: 0 microversion: 2.1 time: 0.127368 Mar 26 21:51:37.601374 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3481/6693] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:51:37 2022] DELETE /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:51:37.608998 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-a08badaa-ee6a-4218-8e95-fbaf88faf887 req-177c32ba-01a9-45d5-aa3a-41ad21f0edff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097759 Mar 26 21:51:37.609942 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3213/6694] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:51:37.612794 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:37.613396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:37.619466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:37.619961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:37.620810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:37.621276 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:37.770611 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:37.779469 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-84441eca-cc41-495d-9e3e-c88b0f657472 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1679 microversion: 2.1 time: 0.171473 Mar 26 21:51:37.780111 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3482/6695] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:37 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:51:38.800219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:38.800928 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:38.807279 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:38.807739 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:38.808543 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:38.808984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:38.943038 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:38.951067 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-49da1dea-96d4-40ed-a813-6ea5058dd271 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1560 microversion: 2.1 time: 0.156465 Mar 26 21:51:38.951659 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3214/6696] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:38 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:39.752400 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-06a715f0-35c2-4b2b-b8f5-099a59be4cf1 req-af68e709-ad94-4ee9-b15a-380f19a65ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77aa3255-a998-420b-b1f0-2d232eedcc2c", "name": "network-vif-deleted", "tag": "6001885e-afe7-4bdd-9b17-e95872fb5d9c"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:39.763153 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-06a715f0-35c2-4b2b-b8f5-099a59be4cf1 req-af68e709-ad94-4ee9-b15a-380f19a65ef7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:39.763898 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-06a715f0-35c2-4b2b-b8f5-099a59be4cf1 req-af68e709-ad94-4ee9-b15a-380f19a65ef7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:39.776514 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-06a715f0-35c2-4b2b-b8f5-099a59be4cf1 req-af68e709-ad94-4ee9-b15a-380f19a65ef7 service nova] Creating event network-vif-deleted:6001885e-afe7-4bdd-9b17-e95872fb5d9c for instance 77aa3255-a998-420b-b1f0-2d232eedcc2c on nch2-master-1 Mar 26 21:51:39.782455 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-06a715f0-35c2-4b2b-b8f5-099a59be4cf1 req-af68e709-ad94-4ee9-b15a-380f19a65ef7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 Mar 26 21:51:39.783059 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3483/6697] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:51:39.968012 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:39.968572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:39.975357 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:39.975814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:39.976613 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:39.977054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:40.010242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:40.010703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:40.011165 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.objects.instance [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lazy-loading 'fault' on Instance uuid 77aa3255-a998-420b-b1f0-2d232eedcc2c {{(pid=141580) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:51:40.051762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:40.060055 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-66d774fa-7300-4377-8328-24cfd1c366b8 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 200 len: 1334 microversion: 2.1 time: 0.095982 Mar 26 21:51:40.060644 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3215/6698] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:39 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:41.078875 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:41.079598 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 77aa3255-a998-420b-b1f0-2d232eedcc2c] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:41.086563 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:41.087029 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:41.087817 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:41.088304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:41.101349 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] HTTP exception thrown: Instance 77aa3255-a998-420b-b1f0-2d232eedcc2c could not be found. Mar 26 21:51:41.101964 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Returning 404 to user: Instance 77aa3255-a998-420b-b1f0-2d232eedcc2c could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:51:41.102820 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-061a8748-18f5-49e0-8ace-170d5ff58080 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c" status: 404 len: 111 microversion: 2.1 time: 0.029047 Mar 26 21:51:41.103362 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3484/6699] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:41 2022] GET /compute/v2.1/servers/77aa3255-a998-420b-b1f0-2d232eedcc2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:51:41.267072 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d9657224-9d6c-4795-b27e-8f563983708d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '.version_select at 0x7f6e586e9c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:41.287509 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d9657224-9d6c-4795-b27e-8f563983708d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036471939" status: 202 len: 0 microversion: 2.1 time: 0.025285 Mar 26 21:51:41.288129 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3216/6700] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036471939 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:51:41.308217 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'create', calling method: .version_select at 0x7f6e4851adc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1912806852"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:41.324901 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:51:41.329990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:51:41.413549 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:51:41.418555 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'key_pairs'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:51:41.432859 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-82e37b77-d925-45a9-9c43-c5de35e8e8a9 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.128614 Mar 26 21:51:41.433467 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3485/6701] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:51:41 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:44.807879 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-234766782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1912806852", "security_groups": [{"name": "tempest-secgroup-smoke-278840506"}], "networks": [{"uuid": "41a18bfe-8e8c-4ee1-9eee-56dd5a6da0f1"}], "block_device_mapping_v2": [{"uuid": "326c9686-53ea-47d5-9695-e8318f3bc5e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:44.915743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.network.neutron [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] validate_networks() for [('41a18bfe-8e8c-4ee1-9eee-56dd5a6da0f1', None, None, None, None, None)] {{(pid=141580) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:51:45.370850 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Flavor limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:51:45.371306 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Image limits 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:51:45.371815 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Flavor pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:51:45.372262 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Image pref 0:0:0 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:51:45.372678 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.virt.hardware [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141580) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:51:45.384253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:45.384706 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:45.385506 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:45.385950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:45.405522 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:51:45.410822 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Getting quotas for user 6687c6fa06d244b0a3ddad87237a5d30 and project 7f82e50b0f4249b889d84b7c46dbb448. Resources: {'instances', 'cores', 'ram'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:51:45.467838 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Going to run 1 instances... {{(pid=141580) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:51:45.470004 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='326c9686-53ea-47d5-9695-e8318f3bc5e7',volume_size=None,volume_type=None)] {{(pid=141580) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:51:45.590668 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6b587c03-3fed-4667-8e41-96c1b5318208 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788279 Mar 26 21:51:45.591311 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3217/6702] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:51:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:51:45.602889 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c8c79797-c4c8-40cb-91a3-e0113a3da49f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:45.604157 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c8c79797-c4c8-40cb-91a3-e0113a3da49f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:45.656979 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c8c79797-c4c8-40cb-91a3-e0113a3da49f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:45.664232 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c8c79797-c4c8-40cb-91a3-e0113a3da49f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1088 microversion: 2.1 time: 0.066858 Mar 26 21:51:45.664808 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3486/6703] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:45 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:46.682179 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b3f463dc-fe77-4357-9c69-7e130367d0f6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:46.682829 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b3f463dc-fe77-4357-9c69-7e130367d0f6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:46.733628 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b3f463dc-fe77-4357-9c69-7e130367d0f6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:46.741010 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b3f463dc-fe77-4357-9c69-7e130367d0f6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1088 microversion: 2.1 time: 0.064052 Mar 26 21:51:46.741578 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3218/6704] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:46 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:47.759452 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6c6d3926-0fdc-431f-a57a-77f6c117cec2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:47.760128 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6c6d3926-0fdc-431f-a57a-77f6c117cec2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:47.819287 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6c6d3926-0fdc-431f-a57a-77f6c117cec2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:47.826564 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6c6d3926-0fdc-431f-a57a-77f6c117cec2 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1088 microversion: 2.1 time: 0.072780 Mar 26 21:51:47.828063 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3487/6705] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:47 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:48.845013 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9f7be188-01a0-4e92-92a8-87653909b08e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:48.845612 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9f7be188-01a0-4e92-92a8-87653909b08e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:48.905129 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9f7be188-01a0-4e92-92a8-87653909b08e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:48.913226 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9f7be188-01a0-4e92-92a8-87653909b08e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1088 microversion: 2.1 time: 0.072280 Mar 26 21:51:48.913803 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3219/6706] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:48 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:49.932389 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:49.933055 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:49.940351 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:49.940851 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:49.941636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:49.942094 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:50.001494 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:50.011490 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3654cc2c-6cdb-467d-80e0-d6dd4b729eee tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1138 microversion: 2.1 time: 0.083315 Mar 26 21:51:50.012111 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3488/6707] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:49 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:51.028885 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:51.029568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:51.036406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:51.036949 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:51.037764 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:51.038342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:51.126837 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:51.135018 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-3496c92a-2b21-4159-b320-e5d21ffb808f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1204 microversion: 2.1 time: 0.110984 Mar 26 21:51:51.136156 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3220/6708] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:51 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:52.039705 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1d3dd43f-e51b-4f35-bb02-b2861041fe7d req-929de031-3940-47ab-b292-c217122b7227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:52.058587 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1d3dd43f-e51b-4f35-bb02-b2861041fe7d req-929de031-3940-47ab-b292-c217122b7227 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:52.059065 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1d3dd43f-e51b-4f35-bb02-b2861041fe7d req-929de031-3940-47ab-b292-c217122b7227 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:52.072570 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1d3dd43f-e51b-4f35-bb02-b2861041fe7d req-929de031-3940-47ab-b292-c217122b7227 service nova] Creating event network-changed:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch1-master-1 Mar 26 21:51:52.079258 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1d3dd43f-e51b-4f35-bb02-b2861041fe7d req-929de031-3940-47ab-b292-c217122b7227 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053965 Mar 26 21:51:52.079876 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3489/6709] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:51:52.152562 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:52.153283 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:52.161214 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:52.162022 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:52.164538 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:52.164997 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:52.375732 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:52.383719 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d320ebd8-f997-4a1d-9282-f7d8c8349037 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.235050 Mar 26 21:51:52.384340 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3221/6710] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:52 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:53.400959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:53.401597 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:53.408512 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:53.408982 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:53.409761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:53.410215 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:53.543556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:53.551159 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-7844a9fb-7323-43ec-bdb9-a58c919b8d5e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.155114 Mar 26 21:51:53.551728 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3490/6711] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:53 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:54.567828 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:54.568476 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:54.575177 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:54.575654 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:54.576439 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:54.576884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:54.709245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:54.716619 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7e0da21b-1e4e-4937-a6c6-c31ade7957c5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.152660 Mar 26 21:51:54.717191 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3222/6712] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:54 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:55.733239 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:55.733798 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:55.741091 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:55.741562 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:55.742344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:55.742800 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:55.878655 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:55.886338 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a0f034ed-466f-4b55-85a3-b3c5fa8573d4 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.157254 Mar 26 21:51:55.887175 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3491/6713] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:55 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:56.903777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:56.904413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:56.910716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:56.911171 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:56.911956 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:56.912401 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:57.052984 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:57.060246 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6d638e43-529a-4ce1-a3e3-069ceba7e785 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.160475 Mar 26 21:51:57.060815 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3223/6714] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:56 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:57.998387 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-127020ee-9238-4ade-9057-b7a2c482005f req-73f99f8b-f82d-4956-9527-2e15ec1a44d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "name": "network-vif-plugged", "status": "completed", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:51:58.007746 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-127020ee-9238-4ade-9057-b7a2c482005f req-73f99f8b-f82d-4956-9527-2e15ec1a44d6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:58.008268 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-127020ee-9238-4ade-9057-b7a2c482005f req-73f99f8b-f82d-4956-9527-2e15ec1a44d6 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:58.020226 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-127020ee-9238-4ade-9057-b7a2c482005f req-73f99f8b-f82d-4956-9527-2e15ec1a44d6 service nova] Creating event network-vif-plugged:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch1-master-1 Mar 26 21:51:58.025735 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-127020ee-9238-4ade-9057-b7a2c482005f req-73f99f8b-f82d-4956-9527-2e15ec1a44d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Mar 26 21:51:58.026324 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3492/6715] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:51:58.077296 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:58.077945 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:58.085474 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:58.085961 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:58.086810 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:58.087293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:58.264638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:58.272069 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-661513b0-c863-4eaa-a3ea-70f0cc451446 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.198697 Mar 26 21:51:58.272641 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3224/6716] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:58 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:51:59.291869 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:51:59.292546 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:51:59.299508 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:59.299993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:59.300788 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:51:59.301236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:51:59.438961 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:51:59.446974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-01d85961-6784-47d5-ac35-fdec55c0b746 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1259 microversion: 2.1 time: 0.160846 Mar 26 21:51:59.447555 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3493/6717] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:51:59 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:52:00.463884 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:52:00.464531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:52:00.471208 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:52:00.471667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:52:00.472497 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:52:00.472941 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:52:00.607405 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:52:00.614760 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-cee98999-bf59-405f-9cb3-b61a7b22a9cf tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1443 microversion: 2.1 time: 0.155314 Mar 26 21:52:00.615332 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3225/6718] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:52:00 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:52:00.630701 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:52:00.631325 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:52:00.638443 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:52:00.638907 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:52:00.639680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:52:00.640160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:52:00.771234 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:52:00.778699 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-db99ccc3-cc44-42a1-b6a9-5dde735a1247 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1443 microversion: 2.1 time: 0.151894 Mar 26 21:52:00.779265 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3494/6719] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:52:00 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:52:02.409504 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-d9f9df51-7fca-4d99-a52c-be20465b44d2 req-ccf52f1d-32a5-4acc-a98d-330785ce285e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:52:02.416268 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d9f9df51-7fca-4d99-a52c-be20465b44d2 req-ccf52f1d-32a5-4acc-a98d-330785ce285e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:52:02.416719 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-d9f9df51-7fca-4d99-a52c-be20465b44d2 req-ccf52f1d-32a5-4acc-a98d-330785ce285e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:52:02.428353 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-d9f9df51-7fca-4d99-a52c-be20465b44d2 req-ccf52f1d-32a5-4acc-a98d-330785ce285e service nova] Creating event network-changed:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch1-master-1 Mar 26 21:52:02.434137 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-d9f9df51-7fca-4d99-a52c-be20465b44d2 req-ccf52f1d-32a5-4acc-a98d-330785ce285e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030250 Mar 26 21:52:02.434792 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3226/6720] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:52:27.869644 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:52:27.870296 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:54:05.325599 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:54:05.326160 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:54:06.637242 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:54:06.637840 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:54:16.276232 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:54:16.277117 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:54:16.335651 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:54:16.336246 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:16.342830 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:16.343307 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:16.344132 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:16.344601 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:16.368668 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lazy-loading 'flavor' on Instance uuid 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:54:16.724001 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f488dda8-bc68-42a5-afeb-390e186f5b28 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76/action" status: 202 len: 0 microversion: 2.1 time: 0.449794 Mar 26 21:54:16.724574 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3495/6721] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:54:16 2022] POST /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:54:16.730847 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96c36a72-ce92-4e02-8bcc-23bb36b0df50] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:54:16.731655 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:54:16.735791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:16.736558 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:16.743242 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:16.743693 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:16.744570 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:16.745027 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:16.945472 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:16.952940 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-ca884fa8-b272-4adc-b34a-92e6da276614 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.223776 Mar 26 21:54:16.953504 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3227/6722] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:16 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:17.972863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:17.973593 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:17.981939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:17.982416 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:17.983211 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:17.983673 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:17.990226 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37232. Mar 26 21:54:17.990933 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37230. Mar 26 21:54:18.177517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:18.185002 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-356b603e-f2c5-475c-a7f3-40fce3243653 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.218474 Mar 26 21:54:18.185569 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3496/6723] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:17 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:19.202127 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:19.202754 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:19.212976 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:19.213460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:19.214229 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:19.214666 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:19.221699 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] [96c36a72-ce92-4e02-8bcc-23bb36b0df50] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37244. Mar 26 21:54:19.222449 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37246. Mar 26 21:54:19.351118 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:19.358577 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a5497934-88e2-4f5a-8acc-ac11e93936b6 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.160394 Mar 26 21:54:19.359146 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3228/6724] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:19 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:20.375613 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:20.376230 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:20.382983 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:20.383461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:20.384334 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:20.385123 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:20.517740 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:20.525267 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-c81f63a4-d583-446e-a745-582f31c5c0aa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.153819 Mar 26 21:54:20.525838 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3497/6725] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:20 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:21.542686 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:21.543347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:21.550578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:21.551036 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:21.551814 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:21.552293 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:21.692356 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:21.699775 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-fa4924eb-adb4-405c-ae6d-8eca39238c2c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.161049 Mar 26 21:54:21.700387 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3229/6726] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:21 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:22.717336 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:22.717967 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:22.724718 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:22.725189 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:22.725972 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:22.726428 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:22.862568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:22.870135 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cb097db4-6ecd-44bb-9c7e-93eb70f54f0c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.156785 Mar 26 21:54:22.870700 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3498/6727] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:22 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:23.887578 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:23.888219 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:23.894924 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:23.895384 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:23.896188 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:23.896633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:24.035907 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:24.043456 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-0ee4227c-45a1-4813-9dc0-4c1c58a31493 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.159728 Mar 26 21:54:24.044044 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3230/6728] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:23 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:25.060311 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:25.060945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:25.068365 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:25.068835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:25.069628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:25.070071 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:25.205700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:25.213131 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-10379027-4d47-4407-aa4e-d57d555fa60d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.156718 Mar 26 21:54:25.213701 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3499/6729] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:25 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:26.229915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:26.230565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:26.238126 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:26.238581 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:26.239350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:26.239792 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:26.372716 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:26.380161 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-53d549ec-7498-44f7-a64b-618394380498 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.154121 Mar 26 21:54:26.380734 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3231/6730] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:26 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:27.397789 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:27.398446 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:27.405160 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:27.405631 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:27.406419 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:27.406874 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:27.544037 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:27.551897 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-146fadf0-b9c4-4822-b3e2-bac7ab1b5fdb tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.158599 Mar 26 21:54:27.552492 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3500/6731] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:27 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:28.569017 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:28.569623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:28.576381 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:28.576844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:28.577614 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:28.578056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:28.713791 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:28.721170 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d3ee5a1a-c581-4c40-8576-fb5a328093b0 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.156081 Mar 26 21:54:28.722293 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3232/6732] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:28 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:29.738589 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:29.739224 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:29.746516 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:29.747040 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:29.752525 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:29.753008 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:29.892785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:29.901054 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-80981b5b-0110-40c0-96c4-5e43caa1c328 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1568 microversion: 2.1 time: 0.166384 Mar 26 21:54:29.901641 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3501/6733] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:29 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:29.917784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:54:29.918371 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:29.925580 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:29.926040 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:29.926830 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:29.927282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:30.012506 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-dc8ae2fe-5a2f-48b0-96aa-89a420edba3e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "POST /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76/action" status: 202 len: 0 microversion: 2.1 time: 0.098446 Mar 26 21:54:30.013008 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3233/6734] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:54:29 2022] POST /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:54:30.021568 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:30.022450 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:30.029146 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:30.030027 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:30.030845 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:30.031368 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:30.215503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:30.223363 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-18173658-6d2e-443c-83c3-1cc71049ce08 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1516 microversion: 2.1 time: 0.205998 Mar 26 21:54:30.223973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3502/6735] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:30 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:31.242396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:31.243009 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:31.249068 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:31.249531 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:31.250299 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:31.250741 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:31.387954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:31.395557 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1eba4756-33b8-4a5a-a00d-fe7fb275b67d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1518 microversion: 2.1 time: 0.158450 Mar 26 21:54:31.396173 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3234/6736] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:31 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:32.352769 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-09694358-2d02-48bf-8390-e97d04ec378e req-931a458c-6ce7-41d1-8f78-c1ab43fece77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "name": "network-vif-unplugged", "status": "completed", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:54:32.361636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-09694358-2d02-48bf-8390-e97d04ec378e req-931a458c-6ce7-41d1-8f78-c1ab43fece77 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:32.362110 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-09694358-2d02-48bf-8390-e97d04ec378e req-931a458c-6ce7-41d1-8f78-c1ab43fece77 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:32.373769 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-09694358-2d02-48bf-8390-e97d04ec378e req-931a458c-6ce7-41d1-8f78-c1ab43fece77 service nova] Creating event network-vif-unplugged:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch2-master-1 Mar 26 21:54:32.378828 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-09694358-2d02-48bf-8390-e97d04ec378e req-931a458c-6ce7-41d1-8f78-c1ab43fece77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080825 Mar 26 21:54:32.379438 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3503/6737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:54:32.413347 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:32.414567 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:32.431031 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:32.431731 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:32.432772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:32.433420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:32.681916 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:32.689891 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d0e39892-40de-479c-a475-87ea4f32c16c tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.280601 Mar 26 21:54:32.690478 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3235/6738] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:32 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:33.707993 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:33.708716 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:33.715499 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:33.716001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:33.716781 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:33.717235 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:33.853327 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:33.861535 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6fd55ab9-0fad-4083-abdc-1e193dfd5c4a tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.158674 Mar 26 21:54:33.862116 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3504/6739] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:33 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:34.401709 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-30d0e448-7ec7-4ef6-ae9f-9477d328c9e9 req-a1a9f157-f613-4980-9718-272cc2793322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:54:34.410413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-30d0e448-7ec7-4ef6-ae9f-9477d328c9e9 req-a1a9f157-f613-4980-9718-272cc2793322 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:34.410871 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-30d0e448-7ec7-4ef6-ae9f-9477d328c9e9 req-a1a9f157-f613-4980-9718-272cc2793322 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:34.424803 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-30d0e448-7ec7-4ef6-ae9f-9477d328c9e9 req-a1a9f157-f613-4980-9718-272cc2793322 service nova] Creating event network-changed:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch2-master-1 Mar 26 21:54:34.430560 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-30d0e448-7ec7-4ef6-ae9f-9477d328c9e9 req-a1a9f157-f613-4980-9718-272cc2793322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032821 Mar 26 21:54:34.431154 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3236/6740] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:54:34.879408 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:34.880102 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:34.886969 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:34.887476 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:34.888439 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:34.888909 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:35.031809 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:35.039966 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-b2f56e46-5933-40d2-b0f1-719ae134836f tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.164587 Mar 26 21:54:35.040539 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3505/6741] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:34 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:54:36.058572 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:36.059282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:36.065638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:36.066098 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:36.066864 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:36.067342 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:36.206132 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:36.214269 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c2583456-a9bc-41d8-b68b-1d9607d9633d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.160715 Mar 26 21:54:36.214822 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3237/6742] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:36 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:37.232061 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:37.232695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:37.239490 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:37.240001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:37.240881 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:37.241341 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:37.374213 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:37.382245 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3a3b8dca-5cf9-440b-807e-6c8d7fbf15a5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.154255 Mar 26 21:54:37.382822 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3506/6743] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:37 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:38.399309 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:38.400046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:38.406703 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:38.407156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:38.407954 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:38.408399 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:38.542726 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:38.550273 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5e3f07c2-8c2d-4697-b3de-14bddb50abcc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.154930 Mar 26 21:54:38.550843 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3238/6744] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:38 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:39.567517 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:39.568179 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:39.575501 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:39.576011 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:39.576804 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:39.577263 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:39.710582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:39.717960 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cd807c7b-4dd7-4ef8-9ea4-f01c6dda592d tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.154403 Mar 26 21:54:39.718536 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3507/6745] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:39 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:40.051634 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-483f5553-91d9-4da0-b79f-2d1b03d0725b req-50c3815a-ea08-4912-828d-c8f54066f5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "name": "network-vif-plugged", "status": "completed", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:54:40.059820 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-483f5553-91d9-4da0-b79f-2d1b03d0725b req-50c3815a-ea08-4912-828d-c8f54066f5e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:40.060312 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-483f5553-91d9-4da0-b79f-2d1b03d0725b req-50c3815a-ea08-4912-828d-c8f54066f5e5 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:40.071421 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-483f5553-91d9-4da0-b79f-2d1b03d0725b req-50c3815a-ea08-4912-828d-c8f54066f5e5 service nova] Creating event network-vif-plugged:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch2-master-1 Mar 26 21:54:40.076425 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-483f5553-91d9-4da0-b79f-2d1b03d0725b req-50c3815a-ea08-4912-828d-c8f54066f5e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081729 Mar 26 21:54:40.077021 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3239/6746] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:54:40.734931 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:40.735590 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:40.742904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:40.743420 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:40.744242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:40.744706 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:40.880710 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:40.888837 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-d2ab184c-a11a-4461-85ca-931cc3ba3c34 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1574 microversion: 2.1 time: 0.157901 Mar 26 21:54:40.889413 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3508/6747] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:40 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:54:41.907345 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:54:41.908116 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:54:41.914305 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:41.914762 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:41.915540 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:54:41.916011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:54:42.053267 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:54:42.060671 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-5a013074-a64a-4dd2-96c8-f4d1d00db178 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1561 microversion: 2.1 time: 0.158448 Mar 26 21:54:42.061251 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3240/6748] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:54:41 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:55:47.880396 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:55:47.881026 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:55:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:56:01.614302 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:01.615541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:01.616113 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-18289edc-1e2f-4231-9ab7-93eff32cc312 req-51c90484-f24c-434e-a8fd-f9f2fd2ec527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:01.621991 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:01.622460 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:01.623462 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:01.624189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-18289edc-1e2f-4231-9ab7-93eff32cc312 req-51c90484-f24c-434e-a8fd-f9f2fd2ec527 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:01.624399 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:01.624667 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-18289edc-1e2f-4231-9ab7-93eff32cc312 req-51c90484-f24c-434e-a8fd-f9f2fd2ec527 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:01.636321 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-18289edc-1e2f-4231-9ab7-93eff32cc312 req-51c90484-f24c-434e-a8fd-f9f2fd2ec527 service nova] Creating event network-changed:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch2-master-1 Mar 26 21:56:01.642598 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-18289edc-1e2f-4231-9ab7-93eff32cc312 req-51c90484-f24c-434e-a8fd-f9f2fd2ec527 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031697 Mar 26 21:56:01.647261 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3241/6749] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 26 21:56:01.650847 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 21:56:01.746974 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f7ff5f12-b609-4298-9b4f-870d679abcfa tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 204 len: 0 microversion: 2.1 time: 0.136878 Mar 26 21:56:01.751432 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3509/6750] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:56:01 2022] DELETE /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 21:56:01.757515 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:01.758778 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:01.766904 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:01.767368 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:01.768425 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:01.768880 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:02.003777 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:02.015889 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-11a81dc1-79c0-41da-afec-f7843bf11adc tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1567 microversion: 2.1 time: 0.262585 Mar 26 21:56:02.026701 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3242/6751] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:01 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:03.034521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:03.035372 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:03.042303 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:03.042784 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:03.043582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:03.044350 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:03.179434 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:03.187772 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-4de9fe1f-2888-48f5-ba86-34a484fc9a7e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1449 microversion: 2.1 time: 0.157804 Mar 26 21:56:03.188378 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3510/6752] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:03 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:03.771492 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f7ea6296-a893-40c0-a9ea-bb29d0a1346a req-421d3b99-6011-4806-8c87-0d0867c760f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a763d2-9b93-4f41-826d-c6e8bc7a3d76", "name": "network-vif-deleted", "tag": "94ea6a56-4477-4271-9344-cff1ac399553"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:03.784207 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7ea6296-a893-40c0-a9ea-bb29d0a1346a req-421d3b99-6011-4806-8c87-0d0867c760f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:03.784743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f7ea6296-a893-40c0-a9ea-bb29d0a1346a req-421d3b99-6011-4806-8c87-0d0867c760f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:03.798939 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f7ea6296-a893-40c0-a9ea-bb29d0a1346a req-421d3b99-6011-4806-8c87-0d0867c760f0 service nova] Creating event network-vif-deleted:94ea6a56-4477-4271-9344-cff1ac399553 for instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 on nch2-master-1 Mar 26 21:56:03.804059 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f7ea6296-a893-40c0-a9ea-bb29d0a1346a req-421d3b99-6011-4806-8c87-0d0867c760f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036879 Mar 26 21:56:03.804655 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3243/6753] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:56:04.205357 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:04.206166 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:04.213839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:04.214415 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:04.215553 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:04.216185 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:04.255936 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:04.256410 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:04.256886 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.objects.instance [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lazy-loading 'fault' on Instance uuid 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 {{(pid=141581) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 26 21:56:04.308768 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6687c6fa06d244b0a3ddad87237a5d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82e50b0f4249b889d84b7c46dbb448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:04.322834 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-733dd29f-f4ef-40d9-9d5e-64f9f931d78b tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 200 len: 1224 microversion: 2.1 time: 0.121735 Mar 26 21:56:04.323565 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3511/6754] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:04 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 21:56:05.340436 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:05.341085 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] [instance: 83a763d2-9b93-4f41-826d-c6e8bc7a3d76] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:05.348772 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:05.349233 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:05.350015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:05.350460 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:05.365563 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.wsgi [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] HTTP exception thrown: Instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 could not be found. Mar 26 21:56:05.366150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Returning 404 to user: Instance 83a763d2-9b93-4f41-826d-c6e8bc7a3d76 could not be found. {{(pid=141580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 21:56:05.366965 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-f381b5bd-f562-463c-b3b3-d004bdefc25e tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76" status: 404 len: 111 microversion: 2.1 time: 0.030953 Mar 26 21:56:05.367491 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3244/6755] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:05 2022] GET /compute/v2.1/servers/83a763d2-9b93-4f41-826d-c6e8bc7a3d76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 21:56:05.526749 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-9d2c7fca-f336-4598-b15c-b3239d6dd1d5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] Calling method '.version_select at 0x7f6e4becbaf0>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:05.550850 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-9d2c7fca-f336-4598-b15c-b3239d6dd1d5 tempest-TestShelveInstance-2053873640 tempest-TestShelveInstance-2053873640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1912806852" status: 202 len: 0 microversion: 2.1 time: 0.027979 Mar 26 21:56:05.551564 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3512/6756] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:56:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1912806852 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 21:56:23.548421 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Action: 'create', calling method: .version_select at 0x7f6e5ed50d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1757504335"}} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:23.565105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for project 91377f5443a24bebb01fc02288b2f172. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:56:23.571324 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for user 87eef87dfbe04b4f8fadb5d4a9287a14 and project 91377f5443a24bebb01fc02288b2f172. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:56:23.709770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for project 91377f5443a24bebb01fc02288b2f172. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:56:23.715253 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.quota [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for user 87eef87dfbe04b4f8fadb5d4a9287a14 and project 91377f5443a24bebb01fc02288b2f172. Resources: {'key_pairs'} {{(pid=141580) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:56:23.731642 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-88d0b420-e751-4ee1-80bf-e67ef97f690a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.384617 Mar 26 21:56:23.737057 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3245/6757] 10.222.0.16 () {60 vars in 1157 bytes} [Sat Mar 26 21:56:23 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:24.710461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1622769152", "imageRef": "4c68d3e3-5768-41fa-883a-78a7564bdbcb", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1757504335", "security_groups": [{"name": "tempest-secgroup-smoke-147969856"}], "networks": [{"uuid": "22db34bd-067f-45b8-9697-d649f5453140"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:24.814155 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] validate_networks() for [('22db34bd-067f-45b8-9697-d649f5453140', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:56:25.300626 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:56:25.301192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:56:25.301724 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:56:25.302592 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:56:25.303169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:56:25.322754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:25.323236 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:25.324099 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:25.324566 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:25.346390 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for project 91377f5443a24bebb01fc02288b2f172. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:56:25.351791 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for user 87eef87dfbe04b4f8fadb5d4a9287a14 and project 91377f5443a24bebb01fc02288b2f172. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:56:25.364347 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:56:25.366684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4c68d3e3-5768-41fa-883a-78a7564bdbcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:56:25.413730 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-35c82d92-aea5-43d7-a696-ca456fe42e79 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708068 Mar 26 21:56:25.416069 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3513/6758] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:56:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:56:25.425270 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-7be7006e-1b11-4b8a-b6e5-5258fdcff703 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:25.426642 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-7be7006e-1b11-4b8a-b6e5-5258fdcff703 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:25.496571 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-7be7006e-1b11-4b8a-b6e5-5258fdcff703 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:25.504985 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-7be7006e-1b11-4b8a-b6e5-5258fdcff703 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1249 microversion: 2.1 time: 0.083765 Mar 26 21:56:25.505581 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3246/6759] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:25 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:26.525284 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:26.526754 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:26.540704 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:26.541275 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:26.544118 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:26.544896 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:26.630326 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:26.643013 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-944ce4e5-6c7b-40b4-b6bd-6e9ef6a8a3c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1309 microversion: 2.1 time: 0.123962 Mar 26 21:56:26.656100 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3514/6760] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:26 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:27.661156 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:27.661817 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:27.674550 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:27.675011 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:27.676100 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:27.676544 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:27.933635 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:27.942945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-b81a9b6d-b3e1-417d-b02f-c578430b2ad4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.285714 Mar 26 21:56:27.944169 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3247/6761] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:27 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:28.157816 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-1b709950-564f-417c-aaa0-65ea5674d725 req-0a535553-9f93-4199-80d6-c1d8fcba5e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:28.178274 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1b709950-564f-417c-aaa0-65ea5674d725 req-0a535553-9f93-4199-80d6-c1d8fcba5e09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:28.178765 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-1b709950-564f-417c-aaa0-65ea5674d725 req-0a535553-9f93-4199-80d6-c1d8fcba5e09 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:28.200162 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-1b709950-564f-417c-aaa0-65ea5674d725 req-0a535553-9f93-4199-80d6-c1d8fcba5e09 service nova] Creating event network-changed:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 21:56:28.206386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-1b709950-564f-417c-aaa0-65ea5674d725 req-0a535553-9f93-4199-80d6-c1d8fcba5e09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057381 Mar 26 21:56:28.208576 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3515/6762] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:56:28.960225 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:28.961026 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:28.968350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:28.968811 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:28.969605 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:28.970054 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:29.196748 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:29.205042 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1d880e3d-28c7-4bd3-90a5-afa800de2227 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.248697 Mar 26 21:56:29.205543 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3248/6763] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:28 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:30.223959 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:30.224685 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:30.231001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:30.231472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:30.232294 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:30.232761 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:30.373009 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:30.380436 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f68a3034-cc8e-455a-9c54-9b39d7f3a611 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.161816 Mar 26 21:56:30.381011 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3516/6764] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:30 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:31.397607 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:31.398231 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:31.405061 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:31.405525 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:31.406303 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:31.406751 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:31.545101 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:31.552641 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a111434b-2c4a-433e-9760-3699a390a704 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.158977 Mar 26 21:56:31.553224 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3249/6765] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:31 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:32.569904 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:32.570534 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:32.578078 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:32.578543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:32.579331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:32.579785 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:32.713988 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:32.721379 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e6aac21e-e123-4fde-9788-6fc2ec8e4639 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.155370 Mar 26 21:56:32.721953 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3517/6766] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:32 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:33.230105 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-925d6fec-8b65-46c3-a954-ddf1b65eab08 req-72bf4b1d-b7d4-478c-b317-a878241a5412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "name": "network-vif-plugged", "status": "completed", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:33.240964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-925d6fec-8b65-46c3-a954-ddf1b65eab08 req-72bf4b1d-b7d4-478c-b317-a878241a5412 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:33.241420 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-925d6fec-8b65-46c3-a954-ddf1b65eab08 req-72bf4b1d-b7d4-478c-b317-a878241a5412 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:33.252824 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-925d6fec-8b65-46c3-a954-ddf1b65eab08 req-72bf4b1d-b7d4-478c-b317-a878241a5412 service nova] Creating event network-vif-plugged:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 21:56:33.258252 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-925d6fec-8b65-46c3-a954-ddf1b65eab08 req-72bf4b1d-b7d4-478c-b317-a878241a5412 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Mar 26 21:56:33.259380 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3250/6767] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:56:33.738596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:33.739255 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:33.746001 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:33.746472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:33.747249 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:33.747700 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:33.885329 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:33.892729 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-cf492630-70f2-4a19-8944-b29ab469233b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1374 microversion: 2.1 time: 0.158077 Mar 26 21:56:33.893297 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3518/6768] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:33 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:34.910511 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:34.911130 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:34.918076 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:34.918533 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:34.919585 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:34.920052 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:35.056272 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:35.064194 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c253db74-6845-42af-8b9b-cde1fd4d42f5 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1559 microversion: 2.1 time: 0.158103 Mar 26 21:56:35.064762 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3251/6769] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:34 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:35.080839 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:56:35.081472 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:56:35.088241 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:35.088719 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:35.089509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:35.089971 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:35.237330 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:56:35.244705 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-3db5033d-ca48-473a-a523-d086d5eab05a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1559 microversion: 2.1 time: 0.168394 Mar 26 21:56:35.245276 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3519/6770] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:56:35 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:56:37.318551 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-5aeb30a6-0b81-4d63-a03f-e9a52125acd5 req-cd8ef609-a160-4956-870a-75c50fa4324d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:56:37.335286 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5aeb30a6-0b81-4d63-a03f-e9a52125acd5 req-cd8ef609-a160-4956-870a-75c50fa4324d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:56:37.335784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-5aeb30a6-0b81-4d63-a03f-e9a52125acd5 req-cd8ef609-a160-4956-870a-75c50fa4324d service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:56:37.347339 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-5aeb30a6-0b81-4d63-a03f-e9a52125acd5 req-cd8ef609-a160-4956-870a-75c50fa4324d service nova] Creating event network-changed:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 21:56:37.352799 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-5aeb30a6-0b81-4d63-a03f-e9a52125acd5 req-cd8ef609-a160-4956-870a-75c50fa4324d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096303 Mar 26 21:56:37.353486 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3252/6771] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:57:25.366705 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:57:25.367304 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:57:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:58:34.763472 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:58:34.764433 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:58:34.768226 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1748567192"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:58:34.769279 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:34.775265 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:34.775736 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:34.776552 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:34.777006 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:35.040703 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-af1d4415-6f66-47c1-a766-984536cba192 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "POST /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e/action" status: 202 len: 0 microversion: 2.1 time: 0.278767 Mar 26 21:58:35.041343 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3520/6772] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 21:58:34 2022] POST /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 21:58:39.958750 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96c36a72-ce92-4e02-8bcc-23bb36b0df50] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:58:39.960042 ncdv-master-1 devstack@n-api.service[141580]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 26 21:58:39.964046 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-444c1a6c-eb87-4772-855b-7286b6b2d09b req-5f9716f8-aed5-4563-a049-d1b8aa6ccd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "name": "network-vif-plugged", "status": "completed", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:58:39.981236 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-444c1a6c-eb87-4772-855b-7286b6b2d09b req-5f9716f8-aed5-4563-a049-d1b8aa6ccd70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:39.981692 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-444c1a6c-eb87-4772-855b-7286b6b2d09b req-5f9716f8-aed5-4563-a049-d1b8aa6ccd70 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:40.005834 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-444c1a6c-eb87-4772-855b-7286b6b2d09b req-5f9716f8-aed5-4563-a049-d1b8aa6ccd70 service nova] Creating event network-vif-plugged:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 21:58:40.014060 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-444c1a6c-eb87-4772-855b-7286b6b2d09b req-5f9716f8-aed5-4563-a049-d1b8aa6ccd70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057561 Mar 26 21:58:40.014697 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3253/6773] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:58:48.540474 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1822970775", "imageRef": "d2cc29a1-8b40-4a1b-9b1a-bfd23bcda7b9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1757504335", "security_groups": [{"name": "tempest-secgroup-smoke-147969856"}], "networks": [{"uuid": "22db34bd-067f-45b8-9697-d649f5453140"}]}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:58:48.565253 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [77dab926-da37-41fd-afe8-2fee05709842] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37806. Mar 26 21:58:48.568591 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] [86cd97e5-a656-4152-9ee7-d751e24d414d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37808. Mar 26 21:58:48.652962 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.network.neutron [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] validate_networks() for [('22db34bd-067f-45b8-9697-d649f5453140', None, None, None, None, None)] {{(pid=141581) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 26 21:58:49.020251 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Flavor limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 26 21:58:49.020695 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Image limits 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 26 21:58:49.021208 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Flavor pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 26 21:58:49.021636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Image pref 0:0:0 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 26 21:58:49.022093 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.virt.hardware [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141581) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 26 21:58:49.031024 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:49.031496 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:49.032352 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:49.032820 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:49.049725 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for project 91377f5443a24bebb01fc02288b2f172. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 26 21:58:49.055032 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.quota [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Getting quotas for user 87eef87dfbe04b4f8fadb5d4a9287a14 and project 91377f5443a24bebb01fc02288b2f172. Resources: {'instances', 'cores', 'ram'} {{(pid=141581) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 26 21:58:49.067852 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Going to run 1 instances... {{(pid=141581) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 26 21:58:49.070345 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2cc29a1-8b40-4a1b-9b1a-bfd23bcda7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141581) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 26 21:58:49.113108 ncdv-master-1 devstack@n-api.service[141581]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [eea742f8-9db5-4751-8d2b-8caf6745c464] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 26 21:58:50.120652 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [eea742f8-9db5-4751-8d2b-8caf6745c464] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37820. Mar 26 21:58:50.124981 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e4349df7-bb5e-4a89-8617-cb0a826f9c4a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.588935 Mar 26 21:58:50.125635 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3521/6774] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:58:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 26 21:58:50.138146 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-d8c35099-e414-4deb-af59-77e04e8fb99f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:50.138853 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-d8c35099-e414-4deb-af59-77e04e8fb99f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:50.150397 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] [d167d7a8-a3ee-4539-b1e7-c8205e86ad82] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37826. Mar 26 21:58:50.152214 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] [96c36a72-ce92-4e02-8bcc-23bb36b0df50] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37824. Mar 26 21:58:50.198245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-d8c35099-e414-4deb-af59-77e04e8fb99f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:50.205974 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-d8c35099-e414-4deb-af59-77e04e8fb99f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1249 microversion: 2.1 time: 0.073994 Mar 26 21:58:50.206543 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3254/6775] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:50 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:51.222535 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:51.223304 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:51.230461 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:51.231114 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:51.231926 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:51.232394 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:51.306319 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:51.315352 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-11bbe14f-3ff0-4963-9709-a3e0bcce58ed tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1307 microversion: 2.1 time: 0.096500 Mar 26 21:58:51.316499 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3522/6776] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:51 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:52.027747 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-4e35c764-70ed-4510-ad10-ec24c39bf03f req-83e66343-1049-490d-88aa-12dd542920aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "name": "network-vif-unplugged", "status": "completed", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:58:52.047308 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4e35c764-70ed-4510-ad10-ec24c39bf03f req-83e66343-1049-490d-88aa-12dd542920aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:52.047766 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-4e35c764-70ed-4510-ad10-ec24c39bf03f req-83e66343-1049-490d-88aa-12dd542920aa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:52.067243 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-4e35c764-70ed-4510-ad10-ec24c39bf03f req-83e66343-1049-490d-88aa-12dd542920aa service nova] Creating event network-vif-unplugged:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 21:58:52.083886 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-4e35c764-70ed-4510-ad10-ec24c39bf03f req-83e66343-1049-490d-88aa-12dd542920aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059905 Mar 26 21:58:52.084727 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3255/6777] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:58:52.332748 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:52.333984 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:52.341242 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:52.341799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:52.342679 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:52.343745 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:52.519315 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:52.527402 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-6986bf1f-b34f-49c6-aad1-09210c6c1f23 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.198670 Mar 26 21:58:52.536797 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3523/6778] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:52 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:53.546350 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:53.547053 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:53.553594 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:53.554056 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:53.554836 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:53.555280 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:53.710770 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:53.720508 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-1f280af1-94aa-49b7-89a7-b6ad540d7597 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.179283 Mar 26 21:58:53.723998 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3256/6779] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:53 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:54.737827 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:54.738541 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:54.745509 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:54.745987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:54.746797 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:54.747256 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:54.900502 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:54.908237 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-260b217f-6aac-4596-9f08-74ba9c27d79b tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.174761 Mar 26 21:58:54.908834 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3524/6780] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:54 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:55.925953 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:55.926568 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:55.933623 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:55.934090 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:55.934882 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:55.935329 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:56.091767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:56.102127 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-85ad3a60-29bc-4b83-bba0-224fb1d88de4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.179988 Mar 26 21:58:56.102828 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3257/6781] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:55 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:57.118835 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:57.119466 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:57.127388 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:57.127867 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:57.128711 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:57.129161 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:57.289543 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:57.298540 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-61133572-d2a0-4827-a914-bc4823ac1b3d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.183668 Mar 26 21:58:57.299131 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3525/6782] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:57 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:58.335633 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:58.336964 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:58.346189 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:58.346644 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:58.347430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:58.347869 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:58.502857 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:58.510454 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-55d6d1a0-23dc-49b0-a6cb-6e68e40fddb6 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.199536 Mar 26 21:58:58.513088 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3258/6783] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:58 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:58:59.527092 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:58:59.528449 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:58:59.536148 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:59.536640 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:59.537939 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:59.538404 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:59.552175 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-bc9c88c9-1539-402d-9314-47790ab06f11 req-f38fac41-a9aa-4d3e-9810-97039d485c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:58:59.564518 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bc9c88c9-1539-402d-9314-47790ab06f11 req-f38fac41-a9aa-4d3e-9810-97039d485c48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:58:59.565290 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-bc9c88c9-1539-402d-9314-47790ab06f11 req-f38fac41-a9aa-4d3e-9810-97039d485c48 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:58:59.586796 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-bc9c88c9-1539-402d-9314-47790ab06f11 req-f38fac41-a9aa-4d3e-9810-97039d485c48 service nova] Creating event network-changed:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 21:58:59.592442 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-bc9c88c9-1539-402d-9314-47790ab06f11 req-f38fac41-a9aa-4d3e-9810-97039d485c48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044223 Mar 26 21:58:59.594249 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3259/6784] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:58:59.703581 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:58:59.711562 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1394b325-9cc0-46ee-84e6-0fced7ab0ce2 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.188364 Mar 26 21:58:59.721523 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3526/6785] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:58:59 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:00.730584 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:00.731315 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:00.738066 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:00.738520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:00.739282 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:00.739721 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:00.873539 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:00.881388 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-c9f0e81f-d75c-4adb-8fb2-104c138859d8 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.155896 Mar 26 21:59:00.881954 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3260/6786] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:00 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:01.898269 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:01.898905 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:01.905709 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:01.906184 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:01.907574 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:01.908069 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:02.044556 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:02.052078 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-42c8d9c4-5eed-4e8c-80a9-aec7c84133cf tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.157647 Mar 26 21:59:02.052664 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3527/6787] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:01 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:03.068475 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:03.069107 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:03.076645 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:03.077112 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:03.077915 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:03.078651 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:03.237617 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:03.245723 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-508c305f-172a-4bde-9977-2db99bf92e78 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.181175 Mar 26 21:59:03.246523 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3261/6788] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:03 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:04.262344 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:04.262977 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:04.270335 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:04.270812 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:04.271596 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:04.272087 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:04.412582 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:04.420207 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a9ab508b-51b9-49e7-80ce-0b155d1a02d1 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.161813 Mar 26 21:59:04.420778 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3528/6789] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:04 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:05.174767 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-3e2b1655-d7ae-4e52-9596-b5423fa93754 req-67b2d63a-c37b-4310-b82f-5822fbca0c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "name": "network-vif-plugged", "status": "completed", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:59:05.183513 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3e2b1655-d7ae-4e52-9596-b5423fa93754 req-67b2d63a-c37b-4310-b82f-5822fbca0c12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:05.184062 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-3e2b1655-d7ae-4e52-9596-b5423fa93754 req-67b2d63a-c37b-4310-b82f-5822fbca0c12 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:05.195990 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-3e2b1655-d7ae-4e52-9596-b5423fa93754 req-67b2d63a-c37b-4310-b82f-5822fbca0c12 service nova] Creating event network-vif-plugged:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 21:59:05.201344 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-3e2b1655-d7ae-4e52-9596-b5423fa93754 req-67b2d63a-c37b-4310-b82f-5822fbca0c12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 Mar 26 21:59:05.201946 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3262/6790] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 21:59:05.337627 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:59:05.338055 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 21:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:59:05.436521 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:05.437152 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:05.443892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:05.444396 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:05.445177 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:05.445632 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:05.579026 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:05.586386 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-a7b8d071-2bf2-4371-b464-ee0170222d2c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1374 microversion: 2.1 time: 0.153876 Mar 26 21:59:05.586982 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3529/6791] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:05 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:06.604806 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:06.605514 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:06.612438 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:06.612898 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:06.613720 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:06.614167 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:06.647170 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 21:59:06.647660 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 21:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 21:59:06.749738 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:06.757071 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-6feb916f-a9e0-4f83-b5ca-1ba24619165d tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1560 microversion: 2.1 time: 0.157351 Mar 26 21:59:06.757647 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3263/6792] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:06 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:06.773421 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 21:59:06.774051 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 21:59:06.780863 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:06.781331 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:06.782605 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:06.783147 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:06.918250 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 21:59:06.926411 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-0ef4c5eb-58b1-475b-9e2d-8515fb0b59c3 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1560 microversion: 2.1 time: 0.156976 Mar 26 21:59:06.926973 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3530/6793] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:59:06 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 21:59:08.569075 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-ec44a483-c223-491b-a6a0-edfac08bbb95 req-3fdc2c83-03a5-455d-b22f-71a1545c217e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 21:59:08.577565 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec44a483-c223-491b-a6a0-edfac08bbb95 req-3fdc2c83-03a5-455d-b22f-71a1545c217e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 21:59:08.578015 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-ec44a483-c223-491b-a6a0-edfac08bbb95 req-3fdc2c83-03a5-455d-b22f-71a1545c217e service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 21:59:08.589387 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-ec44a483-c223-491b-a6a0-edfac08bbb95 req-3fdc2c83-03a5-455d-b22f-71a1545c217e service nova] Creating event network-changed:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 21:59:08.595053 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-ec44a483-c223-491b-a6a0-edfac08bbb95 req-3fdc2c83-03a5-455d-b22f-71a1545c217e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028897 Mar 26 21:59:08.595664 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3264/6794] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 21:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:36.800892 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-805090396"}} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:36.802046 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:36.808201 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:36.808684 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:36.809478 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:36.809945 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:37.209505 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-e67c2028-18de-4152-94d5-2b82daea6f20 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "POST /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e/action" status: 202 len: 0 microversion: 2.1 time: 0.413610 Mar 26 22:00:37.210142 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3531/6795] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Mar 26 22:00:36 2022] POST /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 26 22:00:41.752406 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-610c6f26-6835-4eb1-95a8-5cc623854f03 req-3b6b5259-645a-4dcc-b775-450fe0cd0435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "name": "network-vif-plugged", "status": "completed", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:41.764051 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-610c6f26-6835-4eb1-95a8-5cc623854f03 req-3b6b5259-645a-4dcc-b775-450fe0cd0435 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:41.764505 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-610c6f26-6835-4eb1-95a8-5cc623854f03 req-3b6b5259-645a-4dcc-b775-450fe0cd0435 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:41.776953 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-610c6f26-6835-4eb1-95a8-5cc623854f03 req-3b6b5259-645a-4dcc-b775-450fe0cd0435 service nova] Creating event network-vif-plugged:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 22:00:41.782969 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-610c6f26-6835-4eb1-95a8-5cc623854f03 req-3b6b5259-645a-4dcc-b775-450fe0cd0435 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115590 Mar 26 22:00:41.783581 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3265/6796] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 22:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:45.376374 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:00:45.377260 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:00:50.895428 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-f60b1c3c-1c44-4263-ac57-6286ed00bd7b req-3d40328a-d702-4ac1-9fd6-b29faedd84f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:50.900607 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:50.901227 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:50.908402 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:50.909192 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:50.910948 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:50.911480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:50.911950 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f60b1c3c-1c44-4263-ac57-6286ed00bd7b req-3d40328a-d702-4ac1-9fd6-b29faedd84f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:50.912413 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-f60b1c3c-1c44-4263-ac57-6286ed00bd7b req-3d40328a-d702-4ac1-9fd6-b29faedd84f0 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:50.924056 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-f60b1c3c-1c44-4263-ac57-6286ed00bd7b req-3d40328a-d702-4ac1-9fd6-b29faedd84f0 service nova] Creating event network-changed:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 22:00:50.929290 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-f60b1c3c-1c44-4263-ac57-6286ed00bd7b req-3d40328a-d702-4ac1-9fd6-b29faedd84f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038932 Mar 26 22:00:50.930125 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3266/6797] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 22:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:50.940183 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Going to try to terminate instance {{(pid=141581) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 22:00:51.031188 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-14d86b63-a4ff-4622-8038-2b423e26bf5c tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 204 len: 0 microversion: 2.1 time: 0.143363 Mar 26 22:00:51.032092 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3532/6798] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 22:00:50 2022] DELETE /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 26 22:00:51.041784 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:51.042728 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:51.049672 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:51.050227 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:51.051087 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:51.051638 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:51.675396 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 22:00:51.684993 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-087cd960-0577-4cc8-ad16-6c13a54d5941 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1685 microversion: 2.1 time: 0.647749 Mar 26 22:00:51.685794 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3267/6799] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:51 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1685 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 26 22:00:52.704524 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:52.705398 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:52.712225 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:52.712703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:52.713503 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:52.713965 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:52.857717 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 22:00:52.866153 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-254fc571-440c-4398-b283-87dec89757da tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 200 len: 1566 microversion: 2.1 time: 0.165950 Mar 26 22:00:52.866816 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3533/6800] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:52 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 22:00:53.306245 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [req-774a0a25-6920-46a7-b4f6-55980bb2f691 req-83419b62-ae6f-4ec2-881e-236d976ce54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb624b64-8485-4347-9277-20bed148857e", "name": "network-vif-deleted", "tag": "f57099c1-6681-4219-b3da-2fef929e89d4"}]} {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:53.314222 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-774a0a25-6920-46a7-b4f6-55980bb2f691 req-83419b62-ae6f-4ec2-881e-236d976ce54a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:53.314680 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [req-774a0a25-6920-46a7-b4f6-55980bb2f691 req-83419b62-ae6f-4ec2-881e-236d976ce54a service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:53.325603 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.compute.server_external_events [req-774a0a25-6920-46a7-b4f6-55980bb2f691 req-83419b62-ae6f-4ec2-881e-236d976ce54a service nova] Creating event network-vif-deleted:f57099c1-6681-4219-b3da-2fef929e89d4 for instance cb624b64-8485-4347-9277-20bed148857e on nch2-master-1 Mar 26 22:00:53.330365 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [req-774a0a25-6920-46a7-b4f6-55980bb2f691 req-83419b62-ae6f-4ec2-881e-236d976ce54a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136959 Mar 26 22:00:53.330963 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3268/6801] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 22:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:53.883169 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:53.883790 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: cb624b64-8485-4347-9277-20bed148857e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:53.890990 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:53.891465 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:53.892953 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:53.893444 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:53.906604 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] HTTP exception thrown: Instance cb624b64-8485-4347-9277-20bed148857e could not be found. Mar 26 22:00:53.907209 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Returning 404 to user: Instance cb624b64-8485-4347-9277-20bed148857e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 22:00:53.908069 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-5043266c-26bb-4542-a980-728d3ea8c78f tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e" status: 404 len: 111 microversion: 2.1 time: 0.028934 Mar 26 22:00:53.908603 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3534/6802] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:53 2022] GET /compute/v2.1/servers/cb624b64-8485-4347-9277-20bed148857e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:55.580844 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:55.581451 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:55.581638 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-a94b841e-d28b-4fee-aea8-32158d804797 req-fad1890c-80a4-4b64-969f-3b9487c270a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:55.588774 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:55.589240 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:55.590025 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:55.590606 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:55.591702 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a94b841e-d28b-4fee-aea8-32158d804797 req-fad1890c-80a4-4b64-969f-3b9487c270a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:55.592308 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-a94b841e-d28b-4fee-aea8-32158d804797 req-fad1890c-80a4-4b64-969f-3b9487c270a7 service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:55.605860 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-a94b841e-d28b-4fee-aea8-32158d804797 req-fad1890c-80a4-4b64-969f-3b9487c270a7 service nova] Creating event network-changed:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 22:00:55.611737 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-a94b841e-d28b-4fee-aea8-32158d804797 req-fad1890c-80a4-4b64-969f-3b9487c270a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 Mar 26 22:00:55.612933 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3535/6803] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 22:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:55.620380 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Going to try to terminate instance {{(pid=141580) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 26 22:00:55.698900 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-a6b2796a-4580-4a3e-874d-99951cb1ebc4 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 204 len: 0 microversion: 2.1 time: 0.123746 Mar 26 22:00:55.699749 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3269/6804] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 22:00:55 2022] DELETE /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 26 22:00:55.711799 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:55.712636 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:55.719680 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:55.720412 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:55.721282 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:55.721810 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:55.881628 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.policy [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141581) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 22:00:55.889623 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-1b30060e-9ee2-4e4c-9958-9d7eed18553a tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1683 microversion: 2.1 time: 0.183866 Mar 26 22:00:55.890421 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3536/6805] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:55 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 22:00:56.907743 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:56.908430 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:56.915432 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:56.915894 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:56.916698 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:56.917150 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:57.052722 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 22:00:57.060175 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-9826bcd6-481c-4065-810e-2ac0c57b707e tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1565 microversion: 2.1 time: 0.157022 Mar 26 22:00:57.060748 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3270/6806] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:56 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 22:00:58.027272 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [req-15164b24-ecb0-4e7d-b2a4-c652e81ede94 req-266b05d6-bd0a-4f57-a671-71b4e84e16fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bab9e24-ca41-4f55-98de-181c7b3f430e", "name": "network-vif-deleted", "tag": "a95bd60f-d949-43c2-9346-3997d3efbc6e"}]} {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 26 22:00:58.036480 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-15164b24-ecb0-4e7d-b2a4-c652e81ede94 req-266b05d6-bd0a-4f57-a671-71b4e84e16fa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:58.036949 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [req-15164b24-ecb0-4e7d-b2a4-c652e81ede94 req-266b05d6-bd0a-4f57-a671-71b4e84e16fa service nova] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:58.051356 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.compute.server_external_events [req-15164b24-ecb0-4e7d-b2a4-c652e81ede94 req-266b05d6-bd0a-4f57-a671-71b4e84e16fa service nova] Creating event network-vif-deleted:a95bd60f-d949-43c2-9346-3997d3efbc6e for instance 5bab9e24-ca41-4f55-98de-181c7b3f430e on nch1-master-1 Mar 26 22:00:58.057093 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [req-15164b24-ecb0-4e7d-b2a4-c652e81ede94 req-266b05d6-bd0a-4f57-a671-71b4e84e16fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038649 Mar 26 22:00:58.057771 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3537/6807] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Mar 26 22:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 26 22:00:58.077860 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:58.078520 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.compute.api [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141580) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:58.086807 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:58.087493 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:58.088300 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:58.088796 ncdv-master-1 devstack@n-api.service[141580]: DEBUG oslo_concurrency.lockutils [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:58.154957 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.policy [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87eef87dfbe04b4f8fadb5d4a9287a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91377f5443a24bebb01fc02288b2f172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141580) authorize /opt/stack/nova/nova/policy.py:199}} Mar 26 22:00:58.163448 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-bc216cf2-ab59-4f7f-bbb0-f064440a5782 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 200 len: 1334 microversion: 2.1 time: 0.089423 Mar 26 22:00:58.164050 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3271/6808] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:58 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 26 22:00:59.181987 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '>' {{(pid=141581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:59.182703 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.compute.api [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] [instance: 5bab9e24-ca41-4f55-98de-181c7b3f430e] Fetching instance by UUID {{(pid=141581) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 26 22:00:59.188976 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:59.189453 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:59.190240 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 26 22:00:59.190698 ncdv-master-1 devstack@n-api.service[141581]: DEBUG oslo_concurrency.lockutils [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Lock "7ca092f8-977d-411e-a825-e2f3eb9c4cf0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 26 22:00:59.204210 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.wsgi [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] HTTP exception thrown: Instance 5bab9e24-ca41-4f55-98de-181c7b3f430e could not be found. Mar 26 22:00:59.204823 ncdv-master-1 devstack@n-api.service[141581]: DEBUG nova.api.openstack.wsgi [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Returning 404 to user: Instance 5bab9e24-ca41-4f55-98de-181c7b3f430e could not be found. {{(pid=141581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 26 22:00:59.205817 ncdv-master-1 devstack@n-api.service[141581]: INFO nova.api.openstack.requestlog [None req-f77160f3-9df2-4836-a132-76a239d11024 tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e" status: 404 len: 111 microversion: 2.1 time: 0.028909 Mar 26 22:00:59.206222 ncdv-master-1 devstack@n-api.service[141581]: [pid: 141581|app: 0|req: 3538/6809] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 22:00:59 2022] GET /compute/v2.1/servers/5bab9e24-ca41-4f55-98de-181c7b3f430e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:59.371824 ncdv-master-1 devstack@n-api.service[141580]: DEBUG nova.api.openstack.wsgi [None req-e2d0085d-6992-41c8-98d5-188e7c2db1ff tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] Calling method '.version_select at 0x7f6e58506c10>' {{(pid=141580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 26 22:00:59.394945 ncdv-master-1 devstack@n-api.service[141580]: INFO nova.api.openstack.requestlog [None req-e2d0085d-6992-41c8-98d5-188e7c2db1ff tempest-TestSnapshotPattern-1847701258 tempest-TestSnapshotPattern-1847701258-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1757504335" status: 202 len: 0 microversion: 2.1 time: 0.026878 Mar 26 22:00:59.395728 ncdv-master-1 devstack@n-api.service[141580]: [pid: 141580|app: 0|req: 3272/6810] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 22:00:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1757504335 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 26 22:02:26.656974 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:02:26.657567 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:04:05.356798 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:04:05.357320 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:04:05.385198 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:04:05.385321 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:04:07.893431 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:04:07.893932 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:05:46.665631 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:05:46.667078 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:05:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:06:00.398635 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:06:00.399152 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:06:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:06:15.644796 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:06:15.645206 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:07:25.364914 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:07:25.365505 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:07:25.391832 ncdv-master-1 devstack@n-api.service[141580]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:07:25.391976 ncdv-master-1 devstack@n-api.service[141580]: Sat Mar 26 22:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:07:27.902372 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:07:27.902901 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:07:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:09:06.674996 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:09:06.675670 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 26 22:09:20.406639 ncdv-master-1 devstack@n-api.service[141581]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 26 22:09:20.407261 ncdv-master-1 devstack@n-api.service[141581]: Sat Mar 26 22:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!